-- Logs begin at Mon 2022-06-20 05:12:24 UTC, end at Mon 2022-06-20 06:33:02 UTC. -- Jun 20 05:56:48.978936 dv-cinder-804035-47-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 20 05:56:48.988539 dv-cinder-804035-47-iscsi devstack@keystone.service[80261]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 20 05:56:48.990568 dv-cinder-804035-47-iscsi devstack@keystone.service[80261]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jun 20 05:56:48 2022] *** Jun 20 05:56:48.990568 dv-cinder-804035-47-iscsi devstack@keystone.service[80261]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 20 05:56:48.990568 dv-cinder-804035-47-iscsi devstack@keystone.service[80261]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 20 05:56:48.990568 dv-cinder-804035-47-iscsi devstack@keystone.service[80261]: nodename: dv-cinder-804035-47-iscsi Jun 20 05:56:48.990568 dv-cinder-804035-47-iscsi devstack@keystone.service[80261]: machine: x86_64 Jun 20 05:56:48.990568 dv-cinder-804035-47-iscsi devstack@keystone.service[80261]: clock source: unix Jun 20 05:56:48.990568 dv-cinder-804035-47-iscsi devstack@keystone.service[80261]: pcre jit disabled Jun 20 05:56:48.990568 dv-cinder-804035-47-iscsi devstack@keystone.service[80261]: detected number of CPU cores: 4 Jun 20 05:56:48.990568 dv-cinder-804035-47-iscsi devstack@keystone.service[80261]: current working directory: / Jun 20 05:56:48.990568 dv-cinder-804035-47-iscsi devstack@keystone.service[80261]: detected binary path: /usr/bin/uwsgi-core Jun 20 05:56:48.990568 dv-cinder-804035-47-iscsi devstack@keystone.service[80261]: your processes number limit is 47680 Jun 20 05:56:48.991135 dv-cinder-804035-47-iscsi devstack@keystone.service[80261]: your memory page size is 4096 bytes Jun 20 05:56:48.991135 dv-cinder-804035-47-iscsi devstack@keystone.service[80261]: detected max file descriptor number: 2048 Jun 20 05:56:48.991135 dv-cinder-804035-47-iscsi devstack@keystone.service[80261]: lock engine: pthread robust mutexes Jun 20 05:56:48.991135 dv-cinder-804035-47-iscsi devstack@keystone.service[80261]: thunder lock: enabled Jun 20 05:56:48.991135 dv-cinder-804035-47-iscsi devstack@keystone.service[80261]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 20 05:56:48.991135 dv-cinder-804035-47-iscsi devstack@keystone.service[80261]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 20 05:56:49.035830 dv-cinder-804035-47-iscsi devstack@keystone.service[80261]: Python main interpreter initialized at 0x5607eacc59c0 Jun 20 05:56:49.035830 dv-cinder-804035-47-iscsi devstack@keystone.service[80261]: python threads support enabled Jun 20 05:56:49.035830 dv-cinder-804035-47-iscsi devstack@keystone.service[80261]: your server socket listen backlog is limited to 100 connections Jun 20 05:56:49.035830 dv-cinder-804035-47-iscsi devstack@keystone.service[80261]: your mercy for graceful operations on workers is 90 seconds Jun 20 05:56:49.036182 dv-cinder-804035-47-iscsi devstack@keystone.service[80261]: mapped 403077 bytes (393 KB) for 2 cores Jun 20 05:56:49.036265 dv-cinder-804035-47-iscsi devstack@keystone.service[80261]: *** Operational MODE: preforking *** Jun 20 05:56:49.036511 dv-cinder-804035-47-iscsi devstack@keystone.service[80261]: *** uWSGI is running in multiple interpreter mode *** Jun 20 05:56:49.036511 dv-cinder-804035-47-iscsi devstack@keystone.service[80261]: spawned uWSGI master process (pid: 80261) Jun 20 05:56:49.036720 dv-cinder-804035-47-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 20 05:56:49.038052 dv-cinder-804035-47-iscsi devstack@keystone.service[80261]: spawned uWSGI worker 1 (pid: 80271, cores: 1) Jun 20 05:56:49.038052 dv-cinder-804035-47-iscsi devstack@keystone.service[80261]: spawned uWSGI worker 2 (pid: 80272, cores: 1) Jun 20 05:56:49.038052 dv-cinder-804035-47-iscsi devstack@keystone.service[80261]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 20 05:56:54.594937 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 05:56:54.594937 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: from cryptography.utils import int_from_bytes Jun 20 05:56:54.595726 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 05:56:54.595726 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: from cryptography.utils import int_from_bytes Jun 20 05:56:54.604288 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 05:56:54.604288 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: from cryptography.utils import int_from_bytes Jun 20 05:56:54.604785 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 05:56:54.604785 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: from cryptography.utils import int_from_bytes Jun 20 05:56:54.645419 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 20 05:56:54.645616 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 20 05:56:54.645816 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] command line args: [] {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 20 05:56:54.646093 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 20 05:56:54.646276 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] ================================================================================ {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 20 05:56:54.646534 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] admin_token = **** {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.646784 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] config_dir = [] {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.646978 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.647167 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] config_source = [] {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.647352 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] debug = True {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.647555 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.648054 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.648177 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.648349 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.648601 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.648862 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] list_limit = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.649047 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] log_config_append = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.649227 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.649431 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] log_dir = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.649613 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] log_file = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.649832 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.650084 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.650332 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.650587 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.650766 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.650981 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.651272 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.651494 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.651730 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.651969 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.652158 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 20 05:56:54.652285 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.652414 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 20 05:56:54.652549 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.652673 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] command line args: [] {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 20 05:56:54.652829 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.652907 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 20 05:56:54.653030 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.653112 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] ================================================================================ {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 20 05:56:54.653239 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.653318 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] admin_token = **** {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.653515 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] config_dir = [] {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.653674 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.39/identity {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.653762 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.653887 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] publish_errors = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.653969 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] config_source = [] {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.654047 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] debug = True {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.654163 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.654250 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.654354 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.654474 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.654558 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.654660 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.654737 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.654917 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.654996 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.655156 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] standard_threads = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.655233 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.655390 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.655468 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] list_limit = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.655574 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] log_config_append = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.655658 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.655757 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.655835 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.655938 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] log_dir = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.656016 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] use_journal = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.656118 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] log_file = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.656203 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] use_json = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.656277 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] use_stderr = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.656374 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.656452 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] use_syslog = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.656625 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.656731 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.656916 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.656995 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.657168 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.657295 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.657383 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.657458 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.657529 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.657659 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.657755 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.657911 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.657997 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.658151 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.658236 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.658400 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.658531 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.658639 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.658719 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.658877 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.658955 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.659126 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.659214 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.659375 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.659453 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.659611 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.659688 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.659861 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.660100 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.660179 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.39/identity {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.660312 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] publish_errors = False {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.660394 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.660547 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.660626 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.660815 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.660906 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.660981 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.661086 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.661238 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.661324 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.661477 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.661577 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.661715 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] standard_threads = False {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.661800 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.661949 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.662057 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.662194 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.662322 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.662407 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.662540 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] use_journal = False {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.662629 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.662703 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] use_json = False {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.662815 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.662893 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] use_stderr = False {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.663045 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] use_syslog = False {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.663128 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.663277 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.663361 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:56:54.663512 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.663590 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.663750 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.663828 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.664001 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.664088 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.664241 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.664319 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.664473 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.664556 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.664740 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.664823 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.664986 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.665064 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.665224 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.665300 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.665464 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.665543 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.665712 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.665789 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.665945 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.666021 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.666184 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.666270 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.666422 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.666504 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.666703 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.666783 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.666976 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.667124 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.667264 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.667399 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.667508 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.667627 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.667767 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.667852 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.668021 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.668106 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.668257 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.668344 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.668500 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.668585 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.668755 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.668838 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.669000 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.669093 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.669242 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.669322 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.669495 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.669573 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.669736 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.669916 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.669988 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.670050 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.670207 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.670301 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.670446 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.670536 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.670685 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.670763 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.670926 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.671005 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.671164 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.671261 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.671399 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.671490 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.671643 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.671756 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.671884 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.671999 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.672120 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.672234 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.672369 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.672480 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.672602 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.672689 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.672854 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.672976 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.673092 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.673170 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.673331 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.673422 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.673548 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.673676 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.673782 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.673862 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.674017 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.674106 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.674256 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.674411 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.674556 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.674634 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.674752 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.674837 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.674955 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.675037 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.675190 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.675273 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.675430 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.675510 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.675669 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.675749 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.675921 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.676001 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.676164 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.676246 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.676404 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.676526 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.676643 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.676743 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.676908 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.676991 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.677150 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.677232 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.677390 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.677469 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.677625 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.677704 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.677878 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.677958 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.678115 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.678196 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.678355 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.678477 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.678590 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.678671 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.678828 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.678907 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.679067 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.679146 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.679302 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.679383 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.679536 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.679614 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.679770 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.679849 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.680008 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.680089 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.680241 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.680320 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.680484 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.680563 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.680747 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.680867 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.680994 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.681112 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.681219 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.681318 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.681489 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.681590 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.683179 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.683270 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.683270 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.683270 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] auth.external = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.683270 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.683539 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.683625 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.683699 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.683772 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.683772 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] auth.password = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.683901 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.683982 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] auth.token = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.684061 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.684222 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.684303 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.684462 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.684541 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.684715 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.684797 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.684961 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.685040 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.685214 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.685295 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.685463 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.685544 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.685700 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.685777 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.685940 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.686018 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] credential.caching = True {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.686189 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.686268 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.686429 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.686507 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.686670 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.686751 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.686909 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.687015 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.687144 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.687231 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.687381 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.687461 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.687615 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.687695 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.687855 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.687949 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.688090 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.688170 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.688334 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.688420 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.688572 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.688654 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.688860 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.688953 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.689103 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.689189 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.689362 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.689444 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.689625 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.689705 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.689868 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.689955 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] federation.caching = True {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.690103 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] auth.external = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.690184 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.690337 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.690417 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.690591 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.690669 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.690829 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.690911 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.691077 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] auth.password = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.691163 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.691310 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] auth.token = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.691390 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.691554 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.691635 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.691792 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.691880 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.692043 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.692129 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.692284 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.692364 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.692532 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.692611 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.692792 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] identity.caching = True {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.692876 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.693032 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.693114 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.693270 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] credential.caching = True {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.693350 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.693511 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.693590 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.693753 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.693833 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.693989 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.694070 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.694225 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.694311 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.694467 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.694549 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.694706 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.694784 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.694961 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.695039 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.695198 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.695279 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.695439 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.695518 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.695673 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.695752 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.695921 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.696002 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.696170 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.696254 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.696421 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.696501 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.696681 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.696783 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.696953 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.697034 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.697198 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] federation.caching = True {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.697285 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.697442 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.697522 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.697686 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.697873 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.698527 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.698626 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.698727 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.698809 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.698985 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.699077 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.699227 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.699318 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.699487 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.699568 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.699730 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.699817 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.699980 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.700068 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.700217 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.700298 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.700468 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.700549 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.700736 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] identity.caching = True {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.700832 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.700984 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.701064 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.701231 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.701310 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.701471 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.701558 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.701703 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.701782 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.701945 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.702025 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.702178 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.702264 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.702420 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.702500 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.702660 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.702740 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.702907 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.702994 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.703141 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.703221 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.703378 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.703458 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.703613 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.703700 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.703860 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.703941 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.704095 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.704175 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.704331 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.704458 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.704584 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.704665 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.704858 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.704955 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.705098 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.705438 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.705596 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.705677 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.705837 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.705918 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.706070 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.706157 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.user = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.706313 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.706394 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.706548 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.706628 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.706787 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.706875 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.707032 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.707112 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.707275 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.707355 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.707522 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.707609 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.707755 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.707835 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.707986 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.708065 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.708224 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.708313 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.708463 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.708543 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.708719 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.708803 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.708959 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.709042 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.709196 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.709282 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.709438 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.709519 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.709682 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.709765 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.709926 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.710005 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.710167 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.710248 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.710402 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.710483 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.710640 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.710720 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.710878 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.710958 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.711119 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.711201 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.711359 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.711439 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.711590 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.711669 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.711823 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.711905 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.712072 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.712151 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.712315 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.712423 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.712551 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.712632 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.712813 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.712895 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.713054 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.713133 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.713289 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] ldap.user = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.713372 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.713618 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.713739 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.713871 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.713960 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.714199 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.714285 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.714360 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.714433 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.714550 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.714631 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.714789 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.714872 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.715033 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] resource.caching = True {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.715113 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.715285 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.715372 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.715543 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.715624 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.715790 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.715879 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.716046 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.716128 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.716279 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.716360 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.716529 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.716608 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.716809 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.716921 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.717056 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.717148 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.717300 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.717381 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.717540 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] role.caching = True {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.717620 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.717789 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] role.driver = sql {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.717958 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.718039 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.718263 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.718342 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.718515 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.718717 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.718798 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.719003 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.719083 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.719254 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.719449 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.719538 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.719739 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.719818 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.719990 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.720191 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.720272 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.720466 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.720584 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.720732 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.720986 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.721066 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.721225 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.721431 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.721624 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.721706 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.721864 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.722085 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.722173 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.722357 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.722462 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.722608 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.722827 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.722907 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.723086 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.723199 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.723343 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.723580 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.723660 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.723828 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.723961 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.724065 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.724301 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.724380 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.724536 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.724754 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.724848 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.725074 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.725154 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] resource.caching = True {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.725325 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.725565 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.725646 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.725804 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.725936 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.726038 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.726276 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] token.caching = True {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.726355 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.726516 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.726648 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.726765 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.727003 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.727082 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.727292 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.727407 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.727497 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.727739 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.727818 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.727985 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.728150 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.728231 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.728473 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.728553 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.728731 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.728904 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] role.caching = True {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.728986 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.729327 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] role.driver = sql {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.729541 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.729620 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.729693 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.729910 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.730060 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.730140 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.730383 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.730464 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.730682 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.730817 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.730949 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] database.connection = **** {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.731200 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.731288 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.731453 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.731586 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.731697 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.731944 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.732024 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.732183 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.732349 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.732430 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.732653 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.732774 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.732921 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.733141 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.733232 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.733410 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.733528 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.733660 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.733901 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.733982 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.734153 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.734281 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.734391 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.734639 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.734718 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.734872 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.735115 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.735253 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.735357 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.735529 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 20 05:56:54.735617 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.736000 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.736389 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.736806 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.737198 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.737565 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.737957 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.738349 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.738725 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.739093 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.739454 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.739815 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.740205 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.740600 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.741030 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.741402 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.741783 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.742145 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.742522 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] token.caching = True {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.742892 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.743274 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.743665 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.744127 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.744579 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.745563 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.746011 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.746467 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.746983 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.747470 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.747957 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.748437 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.748971 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.749502 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.749984 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.750493 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.750942 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.751260 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] database.connection = **** {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.751556 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.751854 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.752139 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.752434 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.752740 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.753029 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.753311 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.753614 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.753947 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.754362 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.754706 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.754960 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.755216 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.755458 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.755713 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.755949 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.756195 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.756435 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:56:54.756610 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 20 05:56:54.772419 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:54.772656 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:54.772910 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:54.781815 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:54.784265 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:54.784502 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:54.784761 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:54.793347 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:54.810532 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:54.810767 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:54.812001 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:54.812245 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:54.953305 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:54.953605 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:55.002271 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:55.002457 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:55.003072 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:55.003312 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:55.066911 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:55.067140 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:55.067301 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:55.067407 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:55.067540 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:55.067626 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:55.067771 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:55.067856 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:55.067989 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:55.068083 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:55.068210 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:55.068431 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:55.093531 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:55.093799 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:55.093911 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:55.093994 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:55.094168 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:55.094303 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:55.094426 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:55.094517 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:55.094595 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:55.094670 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:55.094805 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:55.094890 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:55.095028 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:55.095250 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:55.106398 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:55.106946 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:55.119125 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:55.119364 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:55.119502 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:55.119590 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:55.119831 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:55.119919 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:55.120091 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:55.120183 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:55.120380 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:55.120463 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:55.120604 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:55.120687 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:55.120849 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:55.121071 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:56:55.138584 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.138797 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 20 05:56:55.138882 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.139011 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 20 05:56:55.139134 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.139338 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 20 05:56:55.139421 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.139546 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 20 05:56:55.139628 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.139820 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.139904 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.140084 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.140166 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.140348 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.140430 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.140610 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.151274 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.151584 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.151670 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.151864 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.151948 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.152137 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.152221 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.152420 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.160463 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80272) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:55.161028 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80271) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:55.163778 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80272) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:55.164059 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.164343 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.164619 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80271) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:55.164723 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.164931 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.165013 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.165194 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.165277 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.165466 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.165557 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.165742 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.165849 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.166015 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.166119 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.166289 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.166380 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.167103 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.167277 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.167561 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.167843 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.168118 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.194349 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.195191 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.195976 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80272) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:55.196256 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.196860 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80271) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:55.197127 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.201582 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80272) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:55.201977 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.202263 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.202434 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80271) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:55.202831 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.203119 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.209863 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80272) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:55.210144 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.210657 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80271) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:55.210939 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.214783 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80272) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:55.215070 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.215355 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.215475 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80271) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:55.215640 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.215766 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.215919 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.216074 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.216193 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.216385 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.216480 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.216717 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.216803 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.217025 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.217302 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.217580 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.236604 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.236909 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.239638 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.239920 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.241584 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80272) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:55.244638 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80271) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:55.245792 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.246192 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.248834 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.249239 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.251224 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80272) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:55.254289 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80271) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:55.254861 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80272) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:55.257974 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80271) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:55.258548 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.258848 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.259135 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.259421 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.259701 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.259989 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.261882 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.262185 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.262472 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.262760 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.263041 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.263323 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.279593 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80272) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:55.279879 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.280149 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.280414 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.282993 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80271) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:55.283282 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.283552 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.283830 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.288322 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.290067 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.290347 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.291918 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.293622 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80272) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:55.293769 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.293905 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.294046 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.294186 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.294515 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.294809 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.297281 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80271) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:55.297566 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.297851 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.298163 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.298504 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.308545 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80272) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:55.308846 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.309138 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.309424 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.310973 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.311271 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.311574 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.312374 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80271) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:55.312659 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.312992 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.313277 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.314839 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.315139 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.315437 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.329406 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80272) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:55.332991 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80272) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:55.333720 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80271) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:55.336304 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.337063 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80271) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:55.338077 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.340363 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80272) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:55.340641 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.340917 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.341012 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.342669 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.344320 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80271) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:55.344601 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.344909 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.348328 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.349948 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80272) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:55.352192 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.353213 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.353507 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.353838 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80271) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:55.353923 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.354303 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.357176 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.357471 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.357860 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.358141 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.363450 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80272) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:55.363740 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.364031 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.367205 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80271) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:55.367500 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.367785 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.372588 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80272) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:55.372892 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.373178 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.373459 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.373735 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.374119 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.374414 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.374698 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.374973 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.375250 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.375523 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.375790 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.376073 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.376300 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80271) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:56:55.376385 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.376583 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.376894 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.377176 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.377453 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.377835 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.378122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.378398 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.378675 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.378962 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.379239 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.379506 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.379779 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.380062 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:56:55.414708 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5607eacc59c0 pid: 80272 (default app) Jun 20 05:56:55.418444 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4e9ea-ab99-4c46-96d2-e7f4bfa213c2 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:55.418747 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4e9ea-ab99-4c46-96d2-e7f4bfa213c2 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:55.418832 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5607eacc59c0 pid: 80271 (default app) Jun 20 05:56:55.419032 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4e9ea-ab99-4c46-96d2-e7f4bfa213c2 None None] PATH_INFO: `/v3` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:55.423273 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1/1] 10.222.0.39 () {50 vars in 791 bytes} [Mon Jun 20 05:56:55 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:03.071084 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63bf7e-ee13-469e-82e6-83939ca5be4e None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:03.071681 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63bf7e-ee13-469e-82e6-83939ca5be4e None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:03.071681 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63bf7e-ee13-469e-82e6-83939ca5be4e None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:03.076646 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1/2] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:57:03 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:57:03.082721 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f516dc1-86f5-4823-a8a2-1740df0dd516 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:03.083119 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f516dc1-86f5-4823-a8a2-1740df0dd516 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:03.083269 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f516dc1-86f5-4823-a8a2-1740df0dd516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:03.152489 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: INFO dbcounter [None req-4f516dc1-86f5-4823-a8a2-1740df0dd516 None None] Registered counter for database keystone Jun 20 05:57:03.174050 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG oslo_db.sqlalchemy.engines [None req-4f516dc1-86f5-4823-a8a2-1740df0dd516 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80272) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 05:57:03.180205 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writer thread running {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 05:57:03.358399 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG passlib.handlers.bcrypt [None req-4f516dc1-86f5-4823-a8a2-1740df0dd516 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80272) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 20 05:57:03.358739 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG passlib.handlers.bcrypt [None req-4f516dc1-86f5-4823-a8a2-1740df0dd516 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80272) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 20 05:57:03.413202 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-4f516dc1-86f5-4823-a8a2-1740df0dd516 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:03.414797 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-4f516dc1-86f5-4823-a8a2-1740df0dd516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:03.538370 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 2/3] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 457 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 20 05:57:03.699097 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63bf7e-ee13-469e-82e6-83939ca5be4e None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:03.770514 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: INFO dbcounter [None req-bf63bf7e-ee13-469e-82e6-83939ca5be4e None None] Registered counter for database keystone Jun 20 05:57:03.792818 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG oslo_db.sqlalchemy.engines [None req-bf63bf7e-ee13-469e-82e6-83939ca5be4e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80271) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 05:57:03.799118 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writer thread running {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 05:57:03.929891 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63bf7e-ee13-469e-82e6-83939ca5be4e None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:03.934966 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf05a0c-1524-414e-9204-32fd24257980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:03.935643 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf05a0c-1524-414e-9204-32fd24257980 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:03.935933 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf05a0c-1524-414e-9204-32fd24257980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:03.936215 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf05a0c-1524-414e-9204-32fd24257980 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:03.944417 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf05a0c-1524-414e-9204-32fd24257980 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:03.996188 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: WARNING keystone.common.rbac_enforcer.enforcer [None req-adf05a0c-1524-414e-9204-32fd24257980 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 20 05:57:03.996465 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf05a0c-1524-414e-9204-32fd24257980 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:04.006359 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 2/4] 10.222.0.39 () {58 vars in 1324 bytes} [Mon Jun 20 05:57:03 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 05:57:04.013072 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f516dc1-86f5-4823-a8a2-1740df0dd516 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:04.027864 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f516dc1-86f5-4823-a8a2-1740df0dd516 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:04.032290 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b19bf6-c4b1-4215-a279-e89939012122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:04.033418 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b19bf6-c4b1-4215-a279-e89939012122 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:04.033705 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b19bf6-c4b1-4215-a279-e89939012122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:04.033979 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b19bf6-c4b1-4215-a279-e89939012122 admin admin] PATH_INFO: `/v3/projects/9e16e10aec7d4a579d849fde0e5b0904` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:04.038030 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b19bf6-c4b1-4215-a279-e89939012122 admin admin] RBAC: Authorizing `identity:get_project(project_id=9e16e10aec7d4a579d849fde0e5b0904)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:04.088512 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a9b19bf6-c4b1-4215-a279-e89939012122 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 20 05:57:04.089098 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b19bf6-c4b1-4215-a279-e89939012122 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:04.093402 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 3/5] 10.222.0.39 () {56 vars in 1207 bytes} [Mon Jun 20 05:57:04 2022] GET /identity/v3/projects/9e16e10aec7d4a579d849fde0e5b0904 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:06.156875 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c7479-21d5-4f29-88f8-87877f07805f None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:06.157415 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c7479-21d5-4f29-88f8-87877f07805f None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:06.157415 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c7479-21d5-4f29-88f8-87877f07805f None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:06.161637 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 3/6] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:57:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:06.167528 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9396b7-f42a-4a41-84b8-c2391fcff0bd None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:06.167916 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9396b7-f42a-4a41-84b8-c2391fcff0bd None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:06.168086 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9396b7-f42a-4a41-84b8-c2391fcff0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:06.187478 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-ac9396b7-f42a-4a41-84b8-c2391fcff0bd None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:06.189041 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-ac9396b7-f42a-4a41-84b8-c2391fcff0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:06.197040 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 4/7] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 20 05:57:06.219175 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c7479-21d5-4f29-88f8-87877f07805f None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:06.231710 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c7479-21d5-4f29-88f8-87877f07805f None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:06.235905 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cedefd8-b62b-4b37-94f9-e48b2c2485a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:06.236564 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cedefd8-b62b-4b37-94f9-e48b2c2485a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:06.236896 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cedefd8-b62b-4b37-94f9-e48b2c2485a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:06.237174 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cedefd8-b62b-4b37-94f9-e48b2c2485a9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:06.245539 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cedefd8-b62b-4b37-94f9-e48b2c2485a9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:06.247301 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cedefd8-b62b-4b37-94f9-e48b2c2485a9 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:06.255976 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 4/8] 10.222.0.39 () {58 vars in 1324 bytes} [Mon Jun 20 05:57:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 05:57:06.261825 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9396b7-f42a-4a41-84b8-c2391fcff0bd None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:06.270864 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9396b7-f42a-4a41-84b8-c2391fcff0bd None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:06.275362 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab8a06-3070-449f-9ca9-86adb2cb8fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:06.276219 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab8a06-3070-449f-9ca9-86adb2cb8fa0 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:06.276505 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab8a06-3070-449f-9ca9-86adb2cb8fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:06.276819 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab8a06-3070-449f-9ca9-86adb2cb8fa0 admin admin] PATH_INFO: `/v3/users/665bc0e94a714a5594465a5b89b022aa` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:06.278215 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab8a06-3070-449f-9ca9-86adb2cb8fa0 admin admin] RBAC: Authorizing `identity:get_user(user_id=665bc0e94a714a5594465a5b89b022aa)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:06.280039 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab8a06-3070-449f-9ca9-86adb2cb8fa0 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:06.281647 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 5/9] 10.222.0.39 () {56 vars in 1198 bytes} [Mon Jun 20 05:57:06 2022] GET /identity/v3/users/665bc0e94a714a5594465a5b89b022aa => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:08.356289 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89fa2a5-2ae9-401c-aa90-92f129b16f48 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:08.356826 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89fa2a5-2ae9-401c-aa90-92f129b16f48 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:08.356953 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89fa2a5-2ae9-401c-aa90-92f129b16f48 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:08.358361 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 5/10] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:57:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:08.363500 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b1cd71-e83a-43f5-a007-962caf46e14e None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:08.363910 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b1cd71-e83a-43f5-a007-962caf46e14e None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:08.364120 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b1cd71-e83a-43f5-a007-962caf46e14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:08.381122 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-77b1cd71-e83a-43f5-a007-962caf46e14e None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:08.382293 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-77b1cd71-e83a-43f5-a007-962caf46e14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:08.416228 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb96111-49ba-4617-a656-9eb6cf1c27af None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:08.416524 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb96111-49ba-4617-a656-9eb6cf1c27af None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:08.416845 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb96111-49ba-4617-a656-9eb6cf1c27af None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:08.418356 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 6/11] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:57:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:08.423351 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db266e14-49d9-40a2-ad15-33522dab0b3d None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:08.423641 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db266e14-49d9-40a2-ad15-33522dab0b3d None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:08.423922 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db266e14-49d9-40a2-ad15-33522dab0b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:08.466095 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG passlib.handlers.bcrypt [None req-db266e14-49d9-40a2-ad15-33522dab0b3d None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80271) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 20 05:57:08.466519 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG passlib.handlers.bcrypt [None req-db266e14-49d9-40a2-ad15-33522dab0b3d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80271) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 20 05:57:08.469596 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 6/12] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:08.492163 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b1cd71-e83a-43f5-a007-962caf46e14e None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:08.513812 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-db266e14-49d9-40a2-ad15-33522dab0b3d None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:08.515405 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-db266e14-49d9-40a2-ad15-33522dab0b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:08.515913 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:08.597289 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b1cd71-e83a-43f5-a007-962caf46e14e None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:08.617249 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 7/13] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:57:08.630742 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b2ecab-6392-4c79-b6a4-bbaee94fd0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:08.631541 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2ecab-6392-4c79-b6a4-bbaee94fd0ae None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:08.631827 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2ecab-6392-4c79-b6a4-bbaee94fd0ae None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:08.632105 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2ecab-6392-4c79-b6a4-bbaee94fd0ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:08.640081 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db266e14-49d9-40a2-ad15-33522dab0b3d None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:08.643913 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b2ecab-6392-4c79-b6a4-bbaee94fd0ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:08.656268 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-a8b2ecab-6392-4c79-b6a4-bbaee94fd0ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:57:08.656268 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:08.656268 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:08.656268 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:08.656268 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:08.656268 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:08.656268 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:08.656268 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:08.656268 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:08.656268 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:08.656268 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:08.656268 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:08.656268 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:08.656268 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:08.656268 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:08.656268 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:08.657288 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:08.657288 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:08.657288 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:08.657288 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:08.657288 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:08.657288 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:08.657288 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:08.657288 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:08.657288 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:08.657288 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:08.657288 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:08.657288 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:08.657288 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:08.657288 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:08.657288 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:08.657288 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:08.658120 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:08.658120 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:08.658120 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:08.658120 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:08.658120 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:08.658120 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:08.658120 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:08.658120 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:08.658120 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:08.658120 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:08.658120 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:57:08.658120 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:57:08.658120 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 7/14] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jun 20 05:57:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:57:08.663217 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b2ecab-6392-4c79-b6a4-bbaee94fd0ae None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:08.742914 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db266e14-49d9-40a2-ad15-33522dab0b3d None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:08.746079 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:08.746545 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:08.769590 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b2ecab-6392-4c79-b6a4-bbaee94fd0ae None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:08.782905 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0b7f1-1bd4-4bbc-83fc-01560e0099b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:08.783807 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0b7f1-1bd4-4bbc-83fc-01560e0099b5 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:08.784095 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0b7f1-1bd4-4bbc-83fc-01560e0099b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:08.784380 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0b7f1-1bd4-4bbc-83fc-01560e0099b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:08.804044 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933c494-8449-40d1-91d4-b0a532428d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:08.804734 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933c494-8449-40d1-91d4-b0a532428d27 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:08.805034 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933c494-8449-40d1-91d4-b0a532428d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:08.805313 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933c494-8449-40d1-91d4-b0a532428d27 None admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:08.806589 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3933c494-8449-40d1-91d4-b0a532428d27 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:08.807464 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3933c494-8449-40d1-91d4-b0a532428d27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:08.808899 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3933c494-8449-40d1-91d4-b0a532428d27 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:08.820397 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 8/15] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:08.826929 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933c494-8449-40d1-91d4-b0a532428d27 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:08.852438 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d0b7f1-1bd4-4bbc-83fc-01560e0099b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:08.854290 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d0b7f1-1bd4-4bbc-83fc-01560e0099b5 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:08.926661 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933c494-8449-40d1-91d4-b0a532428d27 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:08.954250 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 8/16] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 05:57:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 20 05:57:08.960206 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0b7f1-1bd4-4bbc-83fc-01560e0099b5 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:08.961351 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d80f6-75bb-4ab6-8951-cb737cd24316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:08.962708 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d80f6-75bb-4ab6-8951-cb737cd24316 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:08.962989 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d80f6-75bb-4ab6-8951-cb737cd24316 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:08.963407 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d80f6-75bb-4ab6-8951-cb737cd24316 None admin] PATH_INFO: `/v3/users/665bc0e94a714a5594465a5b89b022aa` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:08.964441 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:08.964628 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330d80f6-75bb-4ab6-8951-cb737cd24316 None admin] RBAC: Authorizing `identity:get_user(user_id=665bc0e94a714a5594465a5b89b022aa)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:08.966114 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330d80f6-75bb-4ab6-8951-cb737cd24316 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:08.967849 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 9/17] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:08 2022] GET /identity/v3/users/665bc0e94a714a5594465a5b89b022aa => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:08.973003 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d80f6-75bb-4ab6-8951-cb737cd24316 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:08.987964 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:09.063790 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0b7f1-1bd4-4bbc-83fc-01560e0099b5 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:09.075117 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d80f6-75bb-4ab6-8951-cb737cd24316 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:09.097635 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434bac9-2145-4e4c-a01f-3e1b8f056adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:09.098429 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434bac9-2145-4e4c-a01f-3e1b8f056adb None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:09.098711 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434bac9-2145-4e4c-a01f-3e1b8f056adb None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:09.098994 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434bac9-2145-4e4c-a01f-3e1b8f056adb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:09.108519 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff98c9b-1472-433a-b7ad-6e5931404382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:09.109648 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff98c9b-1472-433a-b7ad-6e5931404382 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:09.109942 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff98c9b-1472-433a-b7ad-6e5931404382 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:09.110329 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff98c9b-1472-433a-b7ad-6e5931404382 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:09.111793 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff98c9b-1472-433a-b7ad-6e5931404382 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:09.113665 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff98c9b-1472-433a-b7ad-6e5931404382 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:09.115605 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 10/18] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:57:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:09.119561 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b434bac9-2145-4e4c-a01f-3e1b8f056adb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:09.121059 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b434bac9-2145-4e4c-a01f-3e1b8f056adb None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:09.121774 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff98c9b-1472-433a-b7ad-6e5931404382 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:09.142597 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-b434bac9-2145-4e4c-a01f-3e1b8f056adb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:57:09.142597 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:09.142597 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:09.142597 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:09.142597 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:09.142597 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:09.142597 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:09.142597 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:09.142597 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:09.142597 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:09.142597 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:09.142597 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:09.142597 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:57:09.142597 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:57:09.142597 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:57:09.143443 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:57:09.143443 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:09.143443 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:09.143443 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:09.143443 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:09.143443 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:09.143443 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:09.143443 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:09.143443 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:09.143443 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:09.143443 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:09.143443 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:09.143443 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:09.143443 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:09.143443 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:09.143443 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:09.143443 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:09.144436 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:57:09.144436 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:57:09.144436 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:57:09.144436 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:57:09.144436 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 9/19] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:57:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:57:09.149396 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434bac9-2145-4e4c-a01f-3e1b8f056adb None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:09.205045 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:09.207324 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:09.224807 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff98c9b-1472-433a-b7ad-6e5931404382 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:09.252781 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434bac9-2145-4e4c-a01f-3e1b8f056adb None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:09.258949 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a4171f-4af0-4a15-abcd-2dd49a5b7eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:09.260667 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4171f-4af0-4a15-abcd-2dd49a5b7eba None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:09.260979 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4171f-4af0-4a15-abcd-2dd49a5b7eba None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:09.261254 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4171f-4af0-4a15-abcd-2dd49a5b7eba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:09.262094 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a4171f-4af0-4a15-abcd-2dd49a5b7eba None admin] RBAC: Adding query filter params (role.id=5a64bd8372704de98e75436ff69e46b3, scope.domain.id=default, user.id=665bc0e94a714a5594465a5b89b022aa) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:09.262408 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a4171f-4af0-4a15-abcd-2dd49a5b7eba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:09.263850 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a4171f-4af0-4a15-abcd-2dd49a5b7eba None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:09.270619 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 11/20] 10.222.0.39 () {56 vars in 1322 bytes} [Mon Jun 20 05:57:09 2022] GET /identity/v3/role_assignments?user.id=665bc0e94a714a5594465a5b89b022aa&scope.domain.id=default&role.id=5a64bd8372704de98e75436ff69e46b3 => generated 233 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:09.287404 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c6e438-e5d9-4160-bf9d-945116d1f949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:09.288097 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6e438-e5d9-4160-bf9d-945116d1f949 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:09.288383 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6e438-e5d9-4160-bf9d-945116d1f949 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:09.288660 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6e438-e5d9-4160-bf9d-945116d1f949 None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:09.289454 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c6e438-e5d9-4160-bf9d-945116d1f949 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:09.289768 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c6e438-e5d9-4160-bf9d-945116d1f949 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:09.292437 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c6e438-e5d9-4160-bf9d-945116d1f949 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:09.313815 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 10/21] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:57:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:11.604755 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83dd93-9338-465d-b4c9-04752cea3d4c None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:11.605786 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83dd93-9338-465d-b4c9-04752cea3d4c None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:11.606287 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83dd93-9338-465d-b4c9-04752cea3d4c None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:11.607876 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 12/22] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:57:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:11.613338 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98515c-986d-4c10-9dc5-b3b8412f72db None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:11.613756 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98515c-986d-4c10-9dc5-b3b8412f72db None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:11.613899 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98515c-986d-4c10-9dc5-b3b8412f72db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:11.638561 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-fc98515c-986d-4c10-9dc5-b3b8412f72db None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:11.639987 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-fc98515c-986d-4c10-9dc5-b3b8412f72db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:11.722227 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 11/23] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:11.745816 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b83dd93-9338-465d-b4c9-04752cea3d4c None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:11.872565 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b83dd93-9338-465d-b4c9-04752cea3d4c None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:11.921412 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239b03f-0a8c-4a6c-b8a8-c9899890b1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:11.922219 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239b03f-0a8c-4a6c-b8a8-c9899890b1c0 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:11.922506 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239b03f-0a8c-4a6c-b8a8-c9899890b1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:11.922787 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239b03f-0a8c-4a6c-b8a8-c9899890b1c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:11.937574 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1239b03f-0a8c-4a6c-b8a8-c9899890b1c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:11.945210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-1239b03f-0a8c-4a6c-b8a8-c9899890b1c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:57:11.945210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:11.945210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:11.945210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:11.945210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:11.945210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:11.945210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:11.945210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:11.945210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:11.945210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:11.945210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:11.945210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:11.945210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:11.945210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:11.945210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:11.945210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:11.946045 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:11.946045 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:11.946045 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:11.946045 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:11.946045 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:11.946045 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:11.946045 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:11.946045 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:11.946045 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:11.946045 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:11.946045 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:11.946045 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:11.946045 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:11.946045 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:11.946045 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:11.946045 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:11.947751 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:11.947751 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:11.947751 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:11.947751 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:11.947751 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:11.947751 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:11.947751 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:11.947751 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:11.947751 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:11.947751 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:11.947751 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:57:11.947751 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:57:11.947751 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 13/24] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jun 20 05:57:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:11.952747 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98515c-986d-4c10-9dc5-b3b8412f72db None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:12.010107 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:12.029942 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec6e36-709d-4a37-80e3-81cf442eacba None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:12.030242 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec6e36-709d-4a37-80e3-81cf442eacba None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:12.030498 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec6e36-709d-4a37-80e3-81cf442eacba None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:12.032467 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 14/25] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:57:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:57:12.038149 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab90bf-4de3-4e5c-9fa4-590415294eac None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:12.038415 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab90bf-4de3-4e5c-9fa4-590415294eac None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:12.038698 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab90bf-4de3-4e5c-9fa4-590415294eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:12.048143 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:12.066324 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-c2ab90bf-4de3-4e5c-9fa4-590415294eac None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:12.067535 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-c2ab90bf-4de3-4e5c-9fa4-590415294eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:12.086800 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98515c-986d-4c10-9dc5-b3b8412f72db None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:12.134892 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ede99-1c1d-41c7-8842-fafbbddfec6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:12.136121 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ede99-1c1d-41c7-8842-fafbbddfec6d None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:12.136775 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ede99-1c1d-41c7-8842-fafbbddfec6d None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:12.137398 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ede99-1c1d-41c7-8842-fafbbddfec6d None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:12.138570 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6ede99-1c1d-41c7-8842-fafbbddfec6d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:12.139029 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6ede99-1c1d-41c7-8842-fafbbddfec6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:12.140586 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6ede99-1c1d-41c7-8842-fafbbddfec6d None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:12.157499 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 12/26] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:12.164199 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ede99-1c1d-41c7-8842-fafbbddfec6d None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:12.250193 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 15/27] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:57:12.277424 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c01bfd-479b-4bad-8fad-0d55cbf51696 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:12.278021 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c01bfd-479b-4bad-8fad-0d55cbf51696 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:12.278555 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c01bfd-479b-4bad-8fad-0d55cbf51696 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:12.280102 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 16/28] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:57:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:57:12.287231 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c01bfd-479b-4bad-8fad-0d55cbf51696 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:12.294165 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ede99-1c1d-41c7-8842-fafbbddfec6d None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:12.305423 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:12.332268 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374128a9-cc5b-4f03-aa7a-4161a2ba1cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:12.333512 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374128a9-cc5b-4f03-aa7a-4161a2ba1cc1 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:12.333925 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374128a9-cc5b-4f03-aa7a-4161a2ba1cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:12.334348 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374128a9-cc5b-4f03-aa7a-4161a2ba1cc1 None admin] PATH_INFO: `/v3/users/665bc0e94a714a5594465a5b89b022aa` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:12.336148 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374128a9-cc5b-4f03-aa7a-4161a2ba1cc1 None admin] RBAC: Authorizing `identity:get_user(user_id=665bc0e94a714a5594465a5b89b022aa)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:12.338364 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374128a9-cc5b-4f03-aa7a-4161a2ba1cc1 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:12.340172 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 13/29] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:12 2022] GET /identity/v3/users/665bc0e94a714a5594465a5b89b022aa => generated 247 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:12.341688 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2f8b3-4962-41f1-8fde-65dd43f3a7c2 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:12.342946 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2f8b3-4962-41f1-8fde-65dd43f3a7c2 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:12.343387 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2f8b3-4962-41f1-8fde-65dd43f3a7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:12.363940 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-73b2f8b3-4962-41f1-8fde-65dd43f3a7c2 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:12.365352 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-73b2f8b3-4962-41f1-8fde-65dd43f3a7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:12.416586 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c01bfd-479b-4bad-8fad-0d55cbf51696 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:12.436143 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 14/30] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:12.437692 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f42b44-b83c-43a6-9437-273917204810 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:12.438077 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f42b44-b83c-43a6-9437-273917204810 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:12.438455 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f42b44-b83c-43a6-9437-273917204810 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:12.439815 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 15/31] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:57:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:12.440689 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f42b44-b83c-43a6-9437-273917204810 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:12.458233 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c7373-04dd-4327-8b38-f235306adcb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:12.459321 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c7373-04dd-4327-8b38-f235306adcb0 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:12.459749 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c7373-04dd-4327-8b38-f235306adcb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:12.460194 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c7373-04dd-4327-8b38-f235306adcb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:12.476104 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982c7373-04dd-4327-8b38-f235306adcb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:12.478534 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982c7373-04dd-4327-8b38-f235306adcb0 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:12.479677 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:12.505932 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-982c7373-04dd-4327-8b38-f235306adcb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:57:12.505932 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:12.505932 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:12.505932 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:12.505932 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:12.505932 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:12.505932 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:12.505932 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:12.505932 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:12.505932 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:12.505932 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:12.505932 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:12.505932 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:57:12.505932 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:57:12.505932 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:57:12.507520 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:57:12.507520 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:12.507520 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:12.507520 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:12.507520 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:12.507520 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:12.507520 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:12.507520 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:12.507520 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:12.507520 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:12.507520 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:12.507520 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:12.507520 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:12.507520 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:12.507520 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:12.507520 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:12.507520 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:12.510141 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:57:12.510141 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:57:12.510141 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:57:12.510141 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:57:12.512766 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 17/32] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:57:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:12.515328 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728285ac-c1b9-445a-9827-8e2bd18a6566 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:12.516031 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728285ac-c1b9-445a-9827-8e2bd18a6566 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:12.516789 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728285ac-c1b9-445a-9827-8e2bd18a6566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:12.545130 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-728285ac-c1b9-445a-9827-8e2bd18a6566 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:12.547443 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-728285ac-c1b9-445a-9827-8e2bd18a6566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:12.582549 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f42b44-b83c-43a6-9437-273917204810 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:12.594604 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:12.631869 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb1dbcc-8d2f-460f-88c2-8b95f40f0613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:12.633511 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb1dbcc-8d2f-460f-88c2-8b95f40f0613 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:12.634659 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb1dbcc-8d2f-460f-88c2-8b95f40f0613 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:12.635289 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb1dbcc-8d2f-460f-88c2-8b95f40f0613 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:12.636009 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 18/33] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:12.636927 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728285ac-c1b9-445a-9827-8e2bd18a6566 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:12.637500 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb1dbcc-8d2f-460f-88c2-8b95f40f0613 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:12.639203 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb1dbcc-8d2f-460f-88c2-8b95f40f0613 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:12.642351 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 16/34] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:57:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:12.643326 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb1dbcc-8d2f-460f-88c2-8b95f40f0613 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:12.765066 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728285ac-c1b9-445a-9827-8e2bd18a6566 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:12.781090 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb1dbcc-8d2f-460f-88c2-8b95f40f0613 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:12.787979 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:12.816138 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68395329-a6d8-47e6-85a2-8fac3f4ea730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:12.818355 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68395329-a6d8-47e6-85a2-8fac3f4ea730 None admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:12.818829 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68395329-a6d8-47e6-85a2-8fac3f4ea730 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:12.819119 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68395329-a6d8-47e6-85a2-8fac3f4ea730 None admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:12.819905 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68395329-a6d8-47e6-85a2-8fac3f4ea730 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:12.822046 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68395329-a6d8-47e6-85a2-8fac3f4ea730 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:12.824275 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980344d1-8752-4f5b-905c-505e8e8cefca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:12.825325 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980344d1-8752-4f5b-905c-505e8e8cefca None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:12.825826 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980344d1-8752-4f5b-905c-505e8e8cefca None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:12.826314 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980344d1-8752-4f5b-905c-505e8e8cefca None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:12.828222 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980344d1-8752-4f5b-905c-505e8e8cefca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:12.830865 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980344d1-8752-4f5b-905c-505e8e8cefca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:12.832489 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980344d1-8752-4f5b-905c-505e8e8cefca None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:12.851107 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 17/35] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:57:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:12.852344 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980344d1-8752-4f5b-905c-505e8e8cefca None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:12.893392 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:12.960219 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 19/36] 10.222.0.39 () {60 vars in 1131 bytes} [Mon Jun 20 05:57:12 2022] POST /identity/v3/roles => generated 225 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:57:12.965876 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68395329-a6d8-47e6-85a2-8fac3f4ea730 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:12.969908 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980344d1-8752-4f5b-905c-505e8e8cefca None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:13.012606 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b981ae-7e66-49ce-a2f5-64fb16ecec80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:13.013925 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b981ae-7e66-49ce-a2f5-64fb16ecec80 None admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:13.014411 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b981ae-7e66-49ce-a2f5-64fb16ecec80 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:13.014997 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b981ae-7e66-49ce-a2f5-64fb16ecec80 None admin] PATH_INFO: `/v3/domains/default/users/665bc0e94a714a5594465a5b89b022aa/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:13.026140 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b981ae-7e66-49ce-a2f5-64fb16ecec80 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=665bc0e94a714a5594465a5b89b022aa, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:13.027796 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b981ae-7e66-49ce-a2f5-64fb16ecec80 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:13.108078 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68395329-a6d8-47e6-85a2-8fac3f4ea730 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:13.147022 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47bd15f-2eef-4586-804c-9a5057086548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:13.147738 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47bd15f-2eef-4586-804c-9a5057086548 None admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:13.148020 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47bd15f-2eef-4586-804c-9a5057086548 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:13.148295 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47bd15f-2eef-4586-804c-9a5057086548 None admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:13.149089 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47bd15f-2eef-4586-804c-9a5057086548 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:13.151240 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47bd15f-2eef-4586-804c-9a5057086548 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:13.168070 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 20/37] 10.222.0.39 () {60 vars in 1131 bytes} [Mon Jun 20 05:57:12 2022] POST /identity/v3/roles => generated 219 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:57:13.169644 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47bd15f-2eef-4586-804c-9a5057086548 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:13.170198 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 18/38] 10.222.0.39 () {58 vars in 1361 bytes} [Mon Jun 20 05:57:12 2022] PUT /identity/v3/domains/default/users/665bc0e94a714a5594465a5b89b022aa/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:57:13.172094 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb950d2-4eec-4ee0-ad18-3407b2089de6 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:13.172406 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb950d2-4eec-4ee0-ad18-3407b2089de6 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:13.172818 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb950d2-4eec-4ee0-ad18-3407b2089de6 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:13.178373 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 19/39] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:57:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:13.184217 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb027807-24fe-4cba-9cb7-7b944178a5d6 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:13.184517 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb027807-24fe-4cba-9cb7-7b944178a5d6 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:13.185084 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb027807-24fe-4cba-9cb7-7b944178a5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:13.207259 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-bb027807-24fe-4cba-9cb7-7b944178a5d6 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:13.208918 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-bb027807-24fe-4cba-9cb7-7b944178a5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:13.215773 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:13.298209 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47bd15f-2eef-4586-804c-9a5057086548 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:13.303046 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 20/40] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:57:13.330707 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb027807-24fe-4cba-9cb7-7b944178a5d6 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:13.341884 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd8524a-341f-4772-902e-2df54ddb1890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:13.341884 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd8524a-341f-4772-902e-2df54ddb1890 None admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:13.341884 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd8524a-341f-4772-902e-2df54ddb1890 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:13.342271 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd8524a-341f-4772-902e-2df54ddb1890 None admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:13.342839 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd8524a-341f-4772-902e-2df54ddb1890 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:13.344432 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd8524a-341f-4772-902e-2df54ddb1890 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:13.364827 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:13.384656 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 21/41] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Jun 20 05:57:13 2022] POST /identity/v3/projects => generated 301 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:57:13.472951 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb027807-24fe-4cba-9cb7-7b944178a5d6 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:13.520451 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ca5f6-4a1d-4334-99fc-46cb5334a850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:13.521179 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ca5f6-4a1d-4334-99fc-46cb5334a850 None admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:13.521464 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ca5f6-4a1d-4334-99fc-46cb5334a850 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:13.521742 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ca5f6-4a1d-4334-99fc-46cb5334a850 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:13.522516 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115ca5f6-4a1d-4334-99fc-46cb5334a850 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:13.524081 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115ca5f6-4a1d-4334-99fc-46cb5334a850 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:13.542918 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 21/42] 10.222.0.39 () {60 vars in 1131 bytes} [Mon Jun 20 05:57:13 2022] POST /identity/v3/roles => generated 223 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 05:57:13.684554 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924706e-e84c-4bea-ae26-7f54e9733b28 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:13.685055 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924706e-e84c-4bea-ae26-7f54e9733b28 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:13.685055 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924706e-e84c-4bea-ae26-7f54e9733b28 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:13.686649 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 22/43] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:57:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:13.692065 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc20e1e-ceea-4d37-8b47-12fe8aeb15cd None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:13.692537 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc20e1e-ceea-4d37-8b47-12fe8aeb15cd None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:13.692747 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc20e1e-ceea-4d37-8b47-12fe8aeb15cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:13.711596 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-9fc20e1e-ceea-4d37-8b47-12fe8aeb15cd None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:13.712858 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-9fc20e1e-ceea-4d37-8b47-12fe8aeb15cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:13.785324 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 22/44] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:13.809657 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924706e-e84c-4bea-ae26-7f54e9733b28 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:14.009435 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:14.023164 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924706e-e84c-4bea-ae26-7f54e9733b28 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:14.058842 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c9104a-5dcc-4cbf-8840-faa86952dd3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:14.059663 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9104a-5dcc-4cbf-8840-faa86952dd3d None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:14.059950 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9104a-5dcc-4cbf-8840-faa86952dd3d None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:14.060227 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9104a-5dcc-4cbf-8840-faa86952dd3d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:14.061429 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c9104a-5dcc-4cbf-8840-faa86952dd3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:14.062895 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c9104a-5dcc-4cbf-8840-faa86952dd3d None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:14.064520 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 23/45] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:57:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:14.070019 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc20e1e-ceea-4d37-8b47-12fe8aeb15cd None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:14.085514 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:14.177246 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc20e1e-ceea-4d37-8b47-12fe8aeb15cd None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:14.211203 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa036a-dcad-401f-842e-f92e611185bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:14.212564 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa036a-dcad-401f-842e-f92e611185bd None admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:14.213193 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa036a-dcad-401f-842e-f92e611185bd None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:14.213478 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa036a-dcad-401f-842e-f92e611185bd None admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:14.214206 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa036a-dcad-401f-842e-f92e611185bd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:14.215670 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa036a-dcad-401f-842e-f92e611185bd None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:14.242141 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 23/46] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Jun 20 05:57:14 2022] POST /identity/v3/projects => generated 312 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:57:15.443912 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68ff5e-a7b5-4bb7-90c5-3bae381d88de None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:15.444424 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68ff5e-a7b5-4bb7-90c5-3bae381d88de None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:15.444502 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68ff5e-a7b5-4bb7-90c5-3bae381d88de None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:15.446116 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 24/47] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:57:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:15.453676 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8eff4-607c-486d-90de-60825eb296d1 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:15.453676 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8eff4-607c-486d-90de-60825eb296d1 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:15.453676 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8eff4-607c-486d-90de-60825eb296d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:15.468738 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-d8d8eff4-607c-486d-90de-60825eb296d1 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:15.469911 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-d8d8eff4-607c-486d-90de-60825eb296d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:15.527098 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:15.535026 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 24/48] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:15.557739 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f68ff5e-a7b5-4bb7-90c5-3bae381d88de None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:15.656239 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f68ff5e-a7b5-4bb7-90c5-3bae381d88de None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:15.689690 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f2757-0805-42b8-a6c5-8948e76fa941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:15.690471 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f2757-0805-42b8-a6c5-8948e76fa941 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:15.690754 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f2757-0805-42b8-a6c5-8948e76fa941 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:15.691030 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f2757-0805-42b8-a6c5-8948e76fa941 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:15.701837 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f2757-0805-42b8-a6c5-8948e76fa941 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:15.709573 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-990f2757-0805-42b8-a6c5-8948e76fa941 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:57:15.709573 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:15.709573 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:15.709573 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:15.709573 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:15.709573 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:15.709573 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:15.709573 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:15.709573 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:15.709573 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:15.709573 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:15.709573 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:15.709573 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:15.709573 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:15.709573 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:15.709573 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:15.710571 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:15.710571 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:15.710571 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:15.710571 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:15.710571 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:15.710571 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:15.710571 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:15.710571 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:15.710571 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:15.710571 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:15.710571 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:15.710571 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:15.710571 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:15.710571 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:15.710571 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:15.710571 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:15.711467 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:15.711467 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:15.711467 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:15.711467 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:15.711467 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:15.711467 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:15.711467 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:15.711467 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:15.711467 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:15.711467 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:15.711467 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:57:15.711467 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:57:15.711467 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 25/49] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jun 20 05:57:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:15.716486 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d8eff4-607c-486d-90de-60825eb296d1 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:15.817473 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d8eff4-607c-486d-90de-60825eb296d1 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:15.853241 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1516ac65-c423-4082-b266-8da59aa5c525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:15.853910 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516ac65-c423-4082-b266-8da59aa5c525 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:15.854195 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516ac65-c423-4082-b266-8da59aa5c525 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:15.854584 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516ac65-c423-4082-b266-8da59aa5c525 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:15.855624 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1516ac65-c423-4082-b266-8da59aa5c525 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:15.856173 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1516ac65-c423-4082-b266-8da59aa5c525 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:15.858520 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1516ac65-c423-4082-b266-8da59aa5c525 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:15.868355 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 25/50] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:15.873772 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f2757-0805-42b8-a6c5-8948e76fa941 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:15.892908 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:15.973843 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f2757-0805-42b8-a6c5-8948e76fa941 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:16.006138 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f069d-1251-497f-92a8-0a876880fd83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:16.007011 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f069d-1251-497f-92a8-0a876880fd83 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:16.007294 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f069d-1251-497f-92a8-0a876880fd83 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:16.007569 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f069d-1251-497f-92a8-0a876880fd83 None admin] PATH_INFO: `/v3/users/665bc0e94a714a5594465a5b89b022aa` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:16.009423 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0f069d-1251-497f-92a8-0a876880fd83 None admin] RBAC: Authorizing `identity:get_user(user_id=665bc0e94a714a5594465a5b89b022aa)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:16.010979 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0f069d-1251-497f-92a8-0a876880fd83 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:16.012604 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 26/51] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:15 2022] GET /identity/v3/users/665bc0e94a714a5594465a5b89b022aa => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:16.017979 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1516ac65-c423-4082-b266-8da59aa5c525 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:16.182720 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:16.222849 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1516ac65-c423-4082-b266-8da59aa5c525 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:16.258214 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82970d2e-1108-4bfd-be2a-7f1ff19749aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:16.259222 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82970d2e-1108-4bfd-be2a-7f1ff19749aa None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:16.259358 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82970d2e-1108-4bfd-be2a-7f1ff19749aa None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:16.259625 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82970d2e-1108-4bfd-be2a-7f1ff19749aa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:16.260877 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82970d2e-1108-4bfd-be2a-7f1ff19749aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:16.262340 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82970d2e-1108-4bfd-be2a-7f1ff19749aa None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:16.264089 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 26/52] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:57:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:16.270882 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f069d-1251-497f-92a8-0a876880fd83 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:16.350360 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5c54e-e2f3-42a6-9fd7-37dc968205ba None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:16.350646 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5c54e-e2f3-42a6-9fd7-37dc968205ba None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:16.350933 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5c54e-e2f3-42a6-9fd7-37dc968205ba None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:16.353038 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 27/53] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:57:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:57:16.358064 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7337c9-5d45-495c-adda-479db5e644ef None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:16.358356 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7337c9-5d45-495c-adda-479db5e644ef None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:16.358643 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7337c9-5d45-495c-adda-479db5e644ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:16.360615 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:16.376863 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-0e7337c9-5d45-495c-adda-479db5e644ef None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:16.378084 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-0e7337c9-5d45-495c-adda-479db5e644ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:16.381974 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f069d-1251-497f-92a8-0a876880fd83 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:16.422137 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43676872-15c8-44b4-8649-f8de80f93732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:16.422873 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43676872-15c8-44b4-8649-f8de80f93732 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:16.423157 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43676872-15c8-44b4-8649-f8de80f93732 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:16.423437 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43676872-15c8-44b4-8649-f8de80f93732 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:16.424272 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43676872-15c8-44b4-8649-f8de80f93732 None admin] RBAC: Adding query filter params (role.id=5a64bd8372704de98e75436ff69e46b3, scope.domain.id=default, user.id=665bc0e94a714a5594465a5b89b022aa) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:16.424583 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43676872-15c8-44b4-8649-f8de80f93732 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:16.426068 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43676872-15c8-44b4-8649-f8de80f93732 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:16.434462 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 27/54] 10.222.0.39 () {56 vars in 1322 bytes} [Mon Jun 20 05:57:16 2022] GET /identity/v3/role_assignments?user.id=665bc0e94a714a5594465a5b89b022aa&scope.domain.id=default&role.id=5a64bd8372704de98e75436ff69e46b3 => generated 530 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:16.466651 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 28/55] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:57:16.491672 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43676872-15c8-44b4-8649-f8de80f93732 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:16.617568 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43676872-15c8-44b4-8649-f8de80f93732 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:16.656962 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb1d607-dff4-4da3-a820-5ce0f3ae4ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:16.657766 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1d607-dff4-4da3-a820-5ce0f3ae4ac5 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:16.658052 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1d607-dff4-4da3-a820-5ce0f3ae4ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:16.658424 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1d607-dff4-4da3-a820-5ce0f3ae4ac5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:16.659718 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb1d607-dff4-4da3-a820-5ce0f3ae4ac5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:16.661345 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb1d607-dff4-4da3-a820-5ce0f3ae4ac5 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:16.663031 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 28/56] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:57:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:16.669661 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7337c9-5d45-495c-adda-479db5e644ef None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:16.730395 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:16.779603 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7337c9-5d45-495c-adda-479db5e644ef None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:16.815770 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a49a3-0a4d-46a1-b2c9-1898ebe8e55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:16.816433 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a49a3-0a4d-46a1-b2c9-1898ebe8e55b None admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:16.816741 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a49a3-0a4d-46a1-b2c9-1898ebe8e55b None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:16.817015 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a49a3-0a4d-46a1-b2c9-1898ebe8e55b None admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:16.817726 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1a49a3-0a4d-46a1-b2c9-1898ebe8e55b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:16.819164 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1a49a3-0a4d-46a1-b2c9-1898ebe8e55b None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:16.846159 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 29/57] 10.222.0.39 () {60 vars in 1140 bytes} [Mon Jun 20 05:57:16 2022] POST /identity/v3/projects => generated 298 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:57:18.911133 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc04da7-4fb0-4e5e-8235-c9404ab5d360 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:18.911626 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc04da7-4fb0-4e5e-8235-c9404ab5d360 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:18.911626 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc04da7-4fb0-4e5e-8235-c9404ab5d360 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:18.913005 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 29/58] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:57:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:18.918772 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456339e-2299-40aa-9bd6-dca7648d39d3 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:18.919180 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456339e-2299-40aa-9bd6-dca7648d39d3 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:18.919340 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456339e-2299-40aa-9bd6-dca7648d39d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:18.936510 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-c456339e-2299-40aa-9bd6-dca7648d39d3 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:18.937741 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-c456339e-2299-40aa-9bd6-dca7648d39d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:19.001719 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 30/59] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:19.026100 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc04da7-4fb0-4e5e-8235-c9404ab5d360 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:19.044576 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:19.127399 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc04da7-4fb0-4e5e-8235-c9404ab5d360 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:19.159084 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61182270-7999-44e7-b0e6-28e141ae6206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:19.159863 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61182270-7999-44e7-b0e6-28e141ae6206 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:19.160146 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61182270-7999-44e7-b0e6-28e141ae6206 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:19.160422 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61182270-7999-44e7-b0e6-28e141ae6206 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:19.161656 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61182270-7999-44e7-b0e6-28e141ae6206 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:19.163039 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61182270-7999-44e7-b0e6-28e141ae6206 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:19.165275 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 30/60] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:57:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:19.170882 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456339e-2299-40aa-9bd6-dca7648d39d3 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:19.210968 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:19.269526 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456339e-2299-40aa-9bd6-dca7648d39d3 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:19.302896 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51fbb61-e4fc-49f2-9172-a35d98895ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:19.303560 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51fbb61-e4fc-49f2-9172-a35d98895ec1 None admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:19.303847 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51fbb61-e4fc-49f2-9172-a35d98895ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:19.304130 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51fbb61-e4fc-49f2-9172-a35d98895ec1 None admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:19.304870 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51fbb61-e4fc-49f2-9172-a35d98895ec1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:19.306474 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51fbb61-e4fc-49f2-9172-a35d98895ec1 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:19.331392 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 31/61] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Jun 20 05:57:19 2022] POST /identity/v3/users => generated 275 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 05:57:22.496792 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb4658-114c-4bc8-ad52-f9000fcffea6 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:22.497299 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb4658-114c-4bc8-ad52-f9000fcffea6 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:22.497371 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb4658-114c-4bc8-ad52-f9000fcffea6 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:22.498895 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 31/62] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:57:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:22.503956 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841af4ef-1e78-4496-9ba7-8f34dadffbca None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:22.504365 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841af4ef-1e78-4496-9ba7-8f34dadffbca None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:22.504531 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841af4ef-1e78-4496-9ba7-8f34dadffbca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:22.533775 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-841af4ef-1e78-4496-9ba7-8f34dadffbca None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:22.535027 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-841af4ef-1e78-4496-9ba7-8f34dadffbca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:22.560739 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62363a9-525f-4d11-a434-c3fc12c14e6d None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:22.560739 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62363a9-525f-4d11-a434-c3fc12c14e6d None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:22.560739 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62363a9-525f-4d11-a434-c3fc12c14e6d None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:22.561884 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 32/63] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:57:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:57:22.578125 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba2ec4-b2e5-43b1-a305-6271af5ce796 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:22.578620 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba2ec4-b2e5-43b1-a305-6271af5ce796 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:22.579310 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba2ec4-b2e5-43b1-a305-6271af5ce796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:22.612917 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-34ba2ec4-b2e5-43b1-a305-6271af5ce796 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:22.614690 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-34ba2ec4-b2e5-43b1-a305-6271af5ce796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:22.627957 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 32/64] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:22.666742 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841af4ef-1e78-4496-9ba7-8f34dadffbca None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:22.705264 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:22.738676 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 33/65] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:57:22.741153 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480e6d6-ba9f-4368-bc1b-4f96e4be8f85 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:22.741589 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480e6d6-ba9f-4368-bc1b-4f96e4be8f85 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:22.742157 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480e6d6-ba9f-4368-bc1b-4f96e4be8f85 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:22.745039 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 34/66] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:57:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:22.751035 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a955165-d9d4-47e3-939b-05c7f3cf798f None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:22.751323 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a955165-d9d4-47e3-939b-05c7f3cf798f None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:22.751600 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a955165-d9d4-47e3-939b-05c7f3cf798f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:22.771103 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-6a955165-d9d4-47e3-939b-05c7f3cf798f None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:22.772291 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-6a955165-d9d4-47e3-939b-05c7f3cf798f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:22.783077 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:22.800373 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841af4ef-1e78-4496-9ba7-8f34dadffbca None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:22.844925 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47989034-2bd2-4059-8c3d-35db24246931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:22.846087 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47989034-2bd2-4059-8c3d-35db24246931 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:22.846585 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47989034-2bd2-4059-8c3d-35db24246931 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:22.847073 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47989034-2bd2-4059-8c3d-35db24246931 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:22.852827 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 35/67] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:22.853838 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a955165-d9d4-47e3-939b-05c7f3cf798f None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:22.859588 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47989034-2bd2-4059-8c3d-35db24246931 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:22.870293 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-47989034-2bd2-4059-8c3d-35db24246931 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:57:22.870293 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:22.870293 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:22.870293 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:22.870293 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:22.870293 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:22.870293 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:22.870293 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:22.870293 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:22.870293 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:22.870293 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:22.870293 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:22.870293 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:22.870293 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:22.870293 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:22.870293 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:22.871228 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:22.871228 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:22.871228 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:22.871228 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:22.871228 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:22.871228 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:22.871228 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:22.871228 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:22.871228 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:22.871228 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:22.871228 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:22.871228 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:22.871228 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:22.871228 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:22.871228 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:22.871228 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:22.871997 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:22.871997 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:22.871997 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:22.871997 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:22.871997 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:22.871997 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:22.871997 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:22.871997 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:22.871997 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:22.871997 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:22.871997 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:57:22.871997 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:57:22.874381 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 33/68] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:57:22.881971 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47989034-2bd2-4059-8c3d-35db24246931 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:22.984009 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a955165-d9d4-47e3-939b-05c7f3cf798f None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:23.009376 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:23.024457 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f3553-ee25-4152-bb8e-824d6ebeb221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:23.025702 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f3553-ee25-4152-bb8e-824d6ebeb221 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:23.026273 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f3553-ee25-4152-bb8e-824d6ebeb221 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:23.026764 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f3553-ee25-4152-bb8e-824d6ebeb221 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:23.029188 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47989034-2bd2-4059-8c3d-35db24246931 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:23.038540 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f3553-ee25-4152-bb8e-824d6ebeb221 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:23.047418 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-601f3553-ee25-4152-bb8e-824d6ebeb221 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:57:23.047418 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:23.047418 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:23.047418 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:23.047418 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:23.047418 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:23.047418 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:23.047418 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:23.047418 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:23.047418 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:23.047418 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:23.047418 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:23.047418 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:23.047418 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:23.047418 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:23.047418 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:23.048286 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:23.048286 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:23.048286 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:23.048286 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:23.048286 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:23.048286 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:23.048286 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:23.048286 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:23.048286 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:23.048286 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:23.048286 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:23.048286 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:23.048286 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:23.048286 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:23.048286 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:23.048286 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:23.049416 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:23.049416 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:23.049416 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:23.049416 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:23.049416 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:23.049416 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:23.049416 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:23.049416 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:23.049416 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:23.049416 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:23.049416 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:57:23.049416 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:57:23.051576 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 36/69] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jun 20 05:57:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:23.052654 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f3553-ee25-4152-bb8e-824d6ebeb221 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:23.058481 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:23.071281 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082a26a-cae9-4741-bab7-ee683b2779b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:23.072496 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082a26a-cae9-4741-bab7-ee683b2779b9 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:23.072810 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082a26a-cae9-4741-bab7-ee683b2779b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:23.073090 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082a26a-cae9-4741-bab7-ee683b2779b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:23.090728 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e082a26a-cae9-4741-bab7-ee683b2779b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:23.098670 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-e082a26a-cae9-4741-bab7-ee683b2779b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:57:23.098670 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:23.098670 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:23.098670 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:23.098670 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:23.098670 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:23.098670 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:23.098670 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:23.098670 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:23.098670 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:23.098670 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:23.098670 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:23.098670 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:23.098670 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:23.098670 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:23.098670 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:23.099533 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:23.099533 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:23.099533 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:23.099533 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:23.099533 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:23.099533 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:23.099533 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:23.099533 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:23.099533 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:23.099533 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:23.099533 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:23.099533 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:23.099533 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:23.099533 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:23.099533 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:23.099533 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:23.100277 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:23.100277 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:23.100277 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:23.100277 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:23.100277 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:23.100277 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:23.100277 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:23.100277 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:23.100277 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:23.100277 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:23.100277 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:57:23.100277 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:57:23.100277 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 34/70] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jun 20 05:57:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:23.100921 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082a26a-cae9-4741-bab7-ee683b2779b9 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:23.174191 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f3553-ee25-4152-bb8e-824d6ebeb221 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:23.207916 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082a26a-cae9-4741-bab7-ee683b2779b9 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:23.214316 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdcd324-3567-4b66-a400-613c63d60ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:23.214996 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdcd324-3567-4b66-a400-613c63d60ca7 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:23.215685 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdcd324-3567-4b66-a400-613c63d60ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:23.215968 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdcd324-3567-4b66-a400-613c63d60ca7 None admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:23.216752 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdcd324-3567-4b66-a400-613c63d60ca7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:23.217416 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdcd324-3567-4b66-a400-613c63d60ca7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:23.219125 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdcd324-3567-4b66-a400-613c63d60ca7 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:23.233068 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 37/71] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jun 20 05:57:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:23.233068 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29d915-095f-418e-9046-56b2f6e11305 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:23.233068 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29d915-095f-418e-9046-56b2f6e11305 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:23.233068 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29d915-095f-418e-9046-56b2f6e11305 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:23.233068 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 38/72] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:57:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:23.233068 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd29d915-095f-418e-9046-56b2f6e11305 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:23.254657 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af365a-5ced-44e5-979d-4a4d8e68e738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:23.255523 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af365a-5ced-44e5-979d-4a4d8e68e738 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:23.255808 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af365a-5ced-44e5-979d-4a4d8e68e738 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:23.256087 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af365a-5ced-44e5-979d-4a4d8e68e738 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:23.256901 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24af365a-5ced-44e5-979d-4a4d8e68e738 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:23.257356 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24af365a-5ced-44e5-979d-4a4d8e68e738 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:23.260252 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24af365a-5ced-44e5-979d-4a4d8e68e738 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:23.273812 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 35/73] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jun 20 05:57:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:23.273812 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af365a-5ced-44e5-979d-4a4d8e68e738 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:23.279235 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:23.310429 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:23.347475 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd29d915-095f-418e-9046-56b2f6e11305 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:23.369715 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af365a-5ced-44e5-979d-4a4d8e68e738 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:23.380301 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f56020-5f69-4a74-8b3d-cf7a5612b63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:23.381000 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f56020-5f69-4a74-8b3d-cf7a5612b63c None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:23.381282 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f56020-5f69-4a74-8b3d-cf7a5612b63c None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:23.381558 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f56020-5f69-4a74-8b3d-cf7a5612b63c None admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:23.382304 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f56020-5f69-4a74-8b3d-cf7a5612b63c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:23.382609 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f56020-5f69-4a74-8b3d-cf7a5612b63c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:23.384936 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f56020-5f69-4a74-8b3d-cf7a5612b63c None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:23.392812 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 39/74] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:23.393990 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b471a-6620-48e5-a4a2-ecf9bfeed500 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:23.394278 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b471a-6620-48e5-a4a2-ecf9bfeed500 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:23.394563 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b471a-6620-48e5-a4a2-ecf9bfeed500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:23.403257 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f7f7bb-661d-40fa-b9fe-ca9e631a3b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:23.404130 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7f7bb-661d-40fa-b9fe-ca9e631a3b43 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:23.404415 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7f7bb-661d-40fa-b9fe-ca9e631a3b43 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:23.404691 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7f7bb-661d-40fa-b9fe-ca9e631a3b43 None admin] PATH_INFO: `/v3/users/d4a868efb70f4b3e8d5794974975fc27` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:23.410303 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-e40b471a-6620-48e5-a4a2-ecf9bfeed500 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:23.411486 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-e40b471a-6620-48e5-a4a2-ecf9bfeed500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:23.420137 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f7f7bb-661d-40fa-b9fe-ca9e631a3b43 None admin] RBAC: Authorizing `identity:get_user(user_id=d4a868efb70f4b3e8d5794974975fc27)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:23.421641 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f7f7bb-661d-40fa-b9fe-ca9e631a3b43 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:23.423318 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 36/75] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:23 2022] GET /identity/v3/users/d4a868efb70f4b3e8d5794974975fc27 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:23.424678 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d896323-64f4-4380-a12c-3a9d29a1a9af None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:23.424986 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d896323-64f4-4380-a12c-3a9d29a1a9af None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:23.425455 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d896323-64f4-4380-a12c-3a9d29a1a9af None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:23.426686 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 37/76] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:57:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:23.427382 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d896323-64f4-4380-a12c-3a9d29a1a9af None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:23.483549 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 40/77] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:23.484617 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b471a-6620-48e5-a4a2-ecf9bfeed500 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:23.494417 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:23.537475 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d896323-64f4-4380-a12c-3a9d29a1a9af None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:23.552129 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:23.569813 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415a433-e41c-4fb7-a380-7b1b76a666ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:23.571320 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415a433-e41c-4fb7-a380-7b1b76a666ba None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:23.571617 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415a433-e41c-4fb7-a380-7b1b76a666ba None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:23.571896 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415a433-e41c-4fb7-a380-7b1b76a666ba None admin] PATH_INFO: `/v3/users/d4a868efb70f4b3e8d5794974975fc27` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:23.573142 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415a433-e41c-4fb7-a380-7b1b76a666ba None admin] RBAC: Authorizing `identity:get_user(user_id=d4a868efb70f4b3e8d5794974975fc27)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:23.574590 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415a433-e41c-4fb7-a380-7b1b76a666ba None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:23.576222 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 38/78] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:23 2022] GET /identity/v3/users/d4a868efb70f4b3e8d5794974975fc27 => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:23.577093 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415a433-e41c-4fb7-a380-7b1b76a666ba None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:23.595446 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b471a-6620-48e5-a4a2-ecf9bfeed500 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:23.630214 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0176e645-de9d-4798-b8ba-c0ffd8b94f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:23.631087 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176e645-de9d-4798-b8ba-c0ffd8b94f0e None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:23.631377 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176e645-de9d-4798-b8ba-c0ffd8b94f0e None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:23.631661 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176e645-de9d-4798-b8ba-c0ffd8b94f0e None admin] PATH_INFO: `/v3/users/665bc0e94a714a5594465a5b89b022aa` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:23.633765 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0176e645-de9d-4798-b8ba-c0ffd8b94f0e None admin] RBAC: Authorizing `identity:get_user(user_id=665bc0e94a714a5594465a5b89b022aa)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:23.635436 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0176e645-de9d-4798-b8ba-c0ffd8b94f0e None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:23.637119 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 41/79] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:23 2022] GET /identity/v3/users/665bc0e94a714a5594465a5b89b022aa => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:23.638269 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd872be2-8053-480e-803c-8276ff1caad1 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:23.638565 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd872be2-8053-480e-803c-8276ff1caad1 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:23.638843 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd872be2-8053-480e-803c-8276ff1caad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:23.655269 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-dd872be2-8053-480e-803c-8276ff1caad1 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:23.656473 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-dd872be2-8053-480e-803c-8276ff1caad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:23.678090 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415a433-e41c-4fb7-a380-7b1b76a666ba None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:23.707893 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:23.714394 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad199480-848d-4277-be8b-9ae32713a841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:23.715053 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad199480-848d-4277-be8b-9ae32713a841 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:23.715344 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad199480-848d-4277-be8b-9ae32713a841 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:23.715628 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad199480-848d-4277-be8b-9ae32713a841 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:23.723821 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 42/80] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:23.724558 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd872be2-8053-480e-803c-8276ff1caad1 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:23.790421 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad199480-848d-4277-be8b-9ae32713a841 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:23.791820 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad199480-848d-4277-be8b-9ae32713a841 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:23.798413 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:23.844653 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd872be2-8053-480e-803c-8276ff1caad1 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:23.878122 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd741e-810a-414c-8686-b43822b2bc32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:23.878910 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd741e-810a-414c-8686-b43822b2bc32 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:23.879195 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd741e-810a-414c-8686-b43822b2bc32 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:23.879472 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd741e-810a-414c-8686-b43822b2bc32 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:23.880631 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affd741e-810a-414c-8686-b43822b2bc32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:23.882125 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affd741e-810a-414c-8686-b43822b2bc32 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:23.884419 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 43/81] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:57:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:23.885291 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd741e-810a-414c-8686-b43822b2bc32 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:23.900354 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 39/82] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 05:57:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:57:23.900354 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad199480-848d-4277-be8b-9ae32713a841 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:23.928267 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:23.986115 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd741e-810a-414c-8686-b43822b2bc32 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:23.999559 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad199480-848d-4277-be8b-9ae32713a841 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:24.010885 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:24.023350 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1034809-e657-4e62-a802-869ef59435e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:24.024557 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1034809-e657-4e62-a802-869ef59435e7 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:24.024901 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1034809-e657-4e62-a802-869ef59435e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:24.025159 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1034809-e657-4e62-a802-869ef59435e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:24.032906 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a2193-c9eb-4089-9ee7-dc5ac19d443d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:24.033563 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a2193-c9eb-4089-9ee7-dc5ac19d443d None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:24.033850 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a2193-c9eb-4089-9ee7-dc5ac19d443d None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:24.034131 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a2193-c9eb-4089-9ee7-dc5ac19d443d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:24.093544 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1034809-e657-4e62-a802-869ef59435e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:24.094958 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1034809-e657-4e62-a802-869ef59435e7 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:24.100801 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6a2193-c9eb-4089-9ee7-dc5ac19d443d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:24.102428 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6a2193-c9eb-4089-9ee7-dc5ac19d443d None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:24.131779 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:24.196054 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 44/83] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 05:57:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:57:24.204122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 40/84] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 05:57:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:57:24.204122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a2193-c9eb-4089-9ee7-dc5ac19d443d None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:24.204345 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1034809-e657-4e62-a802-869ef59435e7 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:24.225834 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:24.298212 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a2193-c9eb-4089-9ee7-dc5ac19d443d None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:24.300186 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1034809-e657-4e62-a802-869ef59435e7 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:24.327453 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:24.333017 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb417d1-7ca6-4b50-ba89-29f48cf12cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:24.333686 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb417d1-7ca6-4b50-ba89-29f48cf12cb5 None admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:24.333972 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb417d1-7ca6-4b50-ba89-29f48cf12cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:24.334250 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb417d1-7ca6-4b50-ba89-29f48cf12cb5 None admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:24.334961 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb417d1-7ca6-4b50-ba89-29f48cf12cb5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:24.335053 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc63f0-a86f-46b2-a0cf-591431f877ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:24.335801 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc63f0-a86f-46b2-a0cf-591431f877ca None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:24.336675 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc63f0-a86f-46b2-a0cf-591431f877ca None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:24.336937 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc63f0-a86f-46b2-a0cf-591431f877ca None admin] PATH_INFO: `/v3/roles/member` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:24.337160 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb417d1-7ca6-4b50-ba89-29f48cf12cb5 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:24.347142 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cc63f0-a86f-46b2-a0cf-591431f877ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:24.355037 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-d7cc63f0-a86f-46b2-a0cf-591431f877ca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:57:24.355037 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:24.355037 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:24.355037 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:24.355037 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:24.355037 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:24.355037 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:24.355037 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:24.355037 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:24.355037 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:24.355037 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:24.355037 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:24.355037 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:24.355037 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:24.355037 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:24.355037 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:24.366309 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:24.366309 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:24.366309 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:24.366309 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:24.366309 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:24.366309 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:24.366309 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:24.366309 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:24.366309 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:24.366309 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:24.366309 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:24.366309 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:24.366309 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:24.366309 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:24.366309 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:24.366309 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:24.367059 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:24.367059 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:24.367059 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:24.367059 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:24.367059 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:24.367059 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:24.367059 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:24.367059 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:24.367059 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:24.367059 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:24.367059 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:57:24.367059 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:57:24.368000 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 41/85] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Jun 20 05:57:24 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:57:24.368000 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb417d1-7ca6-4b50-ba89-29f48cf12cb5 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:24.368122 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 45/86] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:24.368122 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc63f0-a86f-46b2-a0cf-591431f877ca None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:24.474948 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:24.488379 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb417d1-7ca6-4b50-ba89-29f48cf12cb5 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:24.495369 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc63f0-a86f-46b2-a0cf-591431f877ca None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:24.529171 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba3728-f003-4373-88ea-25b48ab421d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:24.530021 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba3728-f003-4373-88ea-25b48ab421d6 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:24.530306 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba3728-f003-4373-88ea-25b48ab421d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:24.530581 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba3728-f003-4373-88ea-25b48ab421d6 None admin] PATH_INFO: `/v3/projects/852ede50488445d795524cf072c12f7e` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:24.531890 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ba3728-f003-4373-88ea-25b48ab421d6 None admin] RBAC: Authorizing `identity:get_project(project_id=852ede50488445d795524cf072c12f7e)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:24.533553 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ba3728-f003-4373-88ea-25b48ab421d6 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:24.535304 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 42/87] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:24 2022] GET /identity/v3/projects/852ede50488445d795524cf072c12f7e => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:24.536087 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba3728-f003-4373-88ea-25b48ab421d6 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:24.540240 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5093bb-3963-402d-8859-5b8b88079859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:24.541210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5093bb-3963-402d-8859-5b8b88079859 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:24.541426 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5093bb-3963-402d-8859-5b8b88079859 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:24.541702 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5093bb-3963-402d-8859-5b8b88079859 None admin] PATH_INFO: `/v3/projects/852ede50488445d795524cf072c12f7e` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:24.542921 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5093bb-3963-402d-8859-5b8b88079859 None admin] RBAC: Authorizing `identity:get_project(project_id=852ede50488445d795524cf072c12f7e)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:24.544955 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5093bb-3963-402d-8859-5b8b88079859 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:24.546319 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 46/88] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:24 2022] GET /identity/v3/projects/852ede50488445d795524cf072c12f7e => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:24.547461 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5093bb-3963-402d-8859-5b8b88079859 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:24.603955 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:24.660844 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba3728-f003-4373-88ea-25b48ab421d6 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:24.666649 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5093bb-3963-402d-8859-5b8b88079859 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:24.705170 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13871df7-9155-4518-93f9-ca3569b649d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:24.706085 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13871df7-9155-4518-93f9-ca3569b649d4 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:24.706523 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13871df7-9155-4518-93f9-ca3569b649d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:24.706961 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13871df7-9155-4518-93f9-ca3569b649d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:24.707058 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8a408-cc74-483d-9f3b-4be308656af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:24.707959 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13871df7-9155-4518-93f9-ca3569b649d4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:24.708083 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8a408-cc74-483d-9f3b-4be308656af8 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:24.708277 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13871df7-9155-4518-93f9-ca3569b649d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:24.708385 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8a408-cc74-483d-9f3b-4be308656af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:24.708585 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8a408-cc74-483d-9f3b-4be308656af8 None admin] PATH_INFO: `/v3/projects/852ede50488445d795524cf072c12f7e` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:24.709819 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc8a408-cc74-483d-9f3b-4be308656af8 None admin] RBAC: Authorizing `identity:get_project(project_id=852ede50488445d795524cf072c12f7e)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:24.711329 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc8a408-cc74-483d-9f3b-4be308656af8 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:24.713206 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 43/89] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:24 2022] GET /identity/v3/projects/852ede50488445d795524cf072c12f7e => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:24.714060 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8a408-cc74-483d-9f3b-4be308656af8 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:24.714341 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13871df7-9155-4518-93f9-ca3569b649d4 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:24.727001 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 47/90] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jun 20 05:57:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:24.728103 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13871df7-9155-4518-93f9-ca3569b649d4 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:24.745976 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:24.839873 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13871df7-9155-4518-93f9-ca3569b649d4 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:24.844087 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8a408-cc74-483d-9f3b-4be308656af8 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:24.869977 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:24.882041 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666edd9-3cb5-43a6-97e0-bae676e90906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:24.882829 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666edd9-3cb5-43a6-97e0-bae676e90906 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:24.883254 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666edd9-3cb5-43a6-97e0-bae676e90906 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:24.883642 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666edd9-3cb5-43a6-97e0-bae676e90906 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:24.884605 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6666edd9-3cb5-43a6-97e0-bae676e90906 None admin] RBAC: Adding query filter params (role.id=c34cf84397a64ab0ad2a06daa8e13d88, scope.project.id=852ede50488445d795524cf072c12f7e, user.id=d4a868efb70f4b3e8d5794974975fc27) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:24.885034 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6666edd9-3cb5-43a6-97e0-bae676e90906 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:24.886615 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6666edd9-3cb5-43a6-97e0-bae676e90906 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:24.888537 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc82833-0163-40d1-8383-97776247768d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:24.889768 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc82833-0163-40d1-8383-97776247768d None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:24.890227 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc82833-0163-40d1-8383-97776247768d None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:24.890971 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc82833-0163-40d1-8383-97776247768d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:24.893029 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc82833-0163-40d1-8383-97776247768d None admin] RBAC: Adding query filter params (role.id=844adf3fdfaf458faa6fcbcf641d4182, scope.project.id=852ede50488445d795524cf072c12f7e, user.id=d4a868efb70f4b3e8d5794974975fc27) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:24.893676 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc82833-0163-40d1-8383-97776247768d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:24.895399 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc82833-0163-40d1-8383-97776247768d None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:24.900853 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 44/91] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jun 20 05:57:24 2022] GET /identity/v3/role_assignments?user.id=d4a868efb70f4b3e8d5794974975fc27&scope.project.id=852ede50488445d795524cf072c12f7e&role.id=c34cf84397a64ab0ad2a06daa8e13d88 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:24.901969 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666edd9-3cb5-43a6-97e0-bae676e90906 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:24.902722 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 48/92] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jun 20 05:57:24 2022] GET /identity/v3/role_assignments?user.id=d4a868efb70f4b3e8d5794974975fc27&scope.project.id=852ede50488445d795524cf072c12f7e&role.id=844adf3fdfaf458faa6fcbcf641d4182 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:24.903700 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc82833-0163-40d1-8383-97776247768d None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:25.042828 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:25.095923 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc82833-0163-40d1-8383-97776247768d None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:25.160957 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adefd0b-4de0-466f-8019-d32e93f5fbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:25.161781 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adefd0b-4de0-466f-8019-d32e93f5fbfc None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:25.162067 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adefd0b-4de0-466f-8019-d32e93f5fbfc None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:25.162465 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adefd0b-4de0-466f-8019-d32e93f5fbfc None admin] PATH_INFO: `/v3/users/d4a868efb70f4b3e8d5794974975fc27` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:25.163729 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adefd0b-4de0-466f-8019-d32e93f5fbfc None admin] RBAC: Authorizing `identity:get_user(user_id=d4a868efb70f4b3e8d5794974975fc27)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:25.168247 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adefd0b-4de0-466f-8019-d32e93f5fbfc None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:25.168247 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 49/93] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:24 2022] GET /identity/v3/users/d4a868efb70f4b3e8d5794974975fc27 => generated 275 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:25.174512 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adefd0b-4de0-466f-8019-d32e93f5fbfc None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:25.208723 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666edd9-3cb5-43a6-97e0-bae676e90906 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:25.283808 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55796634-4f3e-4248-a82e-6b1dca0751d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:25.284490 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55796634-4f3e-4248-a82e-6b1dca0751d0 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:25.284802 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55796634-4f3e-4248-a82e-6b1dca0751d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:25.285086 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55796634-4f3e-4248-a82e-6b1dca0751d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:25.285941 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55796634-4f3e-4248-a82e-6b1dca0751d0 None admin] RBAC: Adding query filter params (role.id=5a64bd8372704de98e75436ff69e46b3, scope.project.id=852ede50488445d795524cf072c12f7e, user.id=665bc0e94a714a5594465a5b89b022aa) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:25.286262 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55796634-4f3e-4248-a82e-6b1dca0751d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:25.291705 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55796634-4f3e-4248-a82e-6b1dca0751d0 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:25.323333 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 45/94] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jun 20 05:57:24 2022] GET /identity/v3/role_assignments?user.id=665bc0e94a714a5594465a5b89b022aa&scope.project.id=852ede50488445d795524cf072c12f7e&role.id=5a64bd8372704de98e75436ff69e46b3 => generated 259 bytes in 422 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:25.355270 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adefd0b-4de0-466f-8019-d32e93f5fbfc None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:25.404585 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8208ee1f-64d3-4b91-bb61-dccc5b1334b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:25.405292 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8208ee1f-64d3-4b91-bb61-dccc5b1334b8 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:25.405581 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8208ee1f-64d3-4b91-bb61-dccc5b1334b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:25.405861 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8208ee1f-64d3-4b91-bb61-dccc5b1334b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:25.423032 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:25.494465 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8208ee1f-64d3-4b91-bb61-dccc5b1334b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:25.495983 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8208ee1f-64d3-4b91-bb61-dccc5b1334b8 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:25.605441 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 50/95] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 05:57:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:57:25.611162 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55796634-4f3e-4248-a82e-6b1dca0751d0 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:25.668802 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:25.727968 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55796634-4f3e-4248-a82e-6b1dca0751d0 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:25.766573 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20287f22-223c-421c-b7a8-492d6d6da091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:25.767445 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20287f22-223c-421c-b7a8-492d6d6da091 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:25.767736 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20287f22-223c-421c-b7a8-492d6d6da091 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:25.768013 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20287f22-223c-421c-b7a8-492d6d6da091 None admin] PATH_INFO: `/v3/projects/3120272f83de4e19b4f75c9ef9e3379d` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:25.769265 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20287f22-223c-421c-b7a8-492d6d6da091 None admin] RBAC: Authorizing `identity:get_project(project_id=3120272f83de4e19b4f75c9ef9e3379d)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:25.770739 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20287f22-223c-421c-b7a8-492d6d6da091 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:25.772472 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 46/96] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:25 2022] GET /identity/v3/projects/3120272f83de4e19b4f75c9ef9e3379d => generated 312 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:25.778594 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8208ee1f-64d3-4b91-bb61-dccc5b1334b8 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:25.838787 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:25.888342 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8208ee1f-64d3-4b91-bb61-dccc5b1334b8 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:25.926574 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e90e1a-4b4e-454c-beed-374648310b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:25.927246 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e90e1a-4b4e-454c-beed-374648310b73 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:25.927538 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e90e1a-4b4e-454c-beed-374648310b73 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:25.927817 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e90e1a-4b4e-454c-beed-374648310b73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:25.928659 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e90e1a-4b4e-454c-beed-374648310b73 None admin] RBAC: Adding query filter params (role.id=c34cf84397a64ab0ad2a06daa8e13d88, scope.project.id=3120272f83de4e19b4f75c9ef9e3379d, user.id=d4a868efb70f4b3e8d5794974975fc27) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:25.929007 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e90e1a-4b4e-454c-beed-374648310b73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:25.931051 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e90e1a-4b4e-454c-beed-374648310b73 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:25.937571 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 51/97] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jun 20 05:57:25 2022] GET /identity/v3/role_assignments?user.id=d4a868efb70f4b3e8d5794974975fc27&scope.project.id=3120272f83de4e19b4f75c9ef9e3379d&role.id=c34cf84397a64ab0ad2a06daa8e13d88 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:27.119686 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0667a7-72cc-4048-9e6e-da73a2b00646 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:27.120205 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0667a7-72cc-4048-9e6e-da73a2b00646 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:27.120279 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0667a7-72cc-4048-9e6e-da73a2b00646 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:27.121668 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 47/98] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:57:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:27.130639 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e317a7-8bab-4075-8c45-c88d542cf155 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:27.131167 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e317a7-8bab-4075-8c45-c88d542cf155 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:27.131241 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e317a7-8bab-4075-8c45-c88d542cf155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:27.150505 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-87e317a7-8bab-4075-8c45-c88d542cf155 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:27.151722 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-87e317a7-8bab-4075-8c45-c88d542cf155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:27.224891 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 52/99] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:57:27.269698 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0667a7-72cc-4048-9e6e-da73a2b00646 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:27.298969 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752fbab-2253-45b1-89dc-107e76de9508 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:27.299267 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752fbab-2253-45b1-89dc-107e76de9508 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:27.299544 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752fbab-2253-45b1-89dc-107e76de9508 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:27.301119 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 53/100] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:57:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:57:27.313638 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eac814-869e-47db-b5c1-e3f6791fd493 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:27.313933 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eac814-869e-47db-b5c1-e3f6791fd493 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:27.314236 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eac814-869e-47db-b5c1-e3f6791fd493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:27.346169 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-45eac814-869e-47db-b5c1-e3f6791fd493 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:27.347370 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-45eac814-869e-47db-b5c1-e3f6791fd493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:27.421268 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:27.482451 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 54/101] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:57:27.484117 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0667a7-72cc-4048-9e6e-da73a2b00646 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:27.506042 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:27.526758 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef4456-8163-473e-84a9-3baa6c6043d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:27.527566 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef4456-8163-473e-84a9-3baa6c6043d0 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:27.527850 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef4456-8163-473e-84a9-3baa6c6043d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:27.528126 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef4456-8163-473e-84a9-3baa6c6043d0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:27.530807 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eac814-869e-47db-b5c1-e3f6791fd493 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:27.564175 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef4456-8163-473e-84a9-3baa6c6043d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:27.580947 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-e4ef4456-8163-473e-84a9-3baa6c6043d0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:57:27.580947 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:27.580947 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:27.580947 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:27.580947 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:27.580947 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:27.580947 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:27.580947 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:27.580947 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:27.580947 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:27.580947 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:27.580947 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:27.580947 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:27.580947 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:27.580947 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:27.580947 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:27.581819 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:27.581819 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:27.581819 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:27.581819 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:27.581819 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:27.581819 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:27.581819 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:27.581819 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:27.581819 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:27.581819 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:27.581819 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:27.581819 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:27.581819 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:27.581819 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:27.581819 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:27.581819 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:27.582583 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:27.582583 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:27.582583 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:27.582583 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:27.582583 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:27.582583 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:27.582583 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:27.582583 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:27.582583 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:27.582583 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:27.582583 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:57:27.582583 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:57:27.582583 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 48/102] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:27.592162 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef4456-8163-473e-84a9-3baa6c6043d0 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:27.715532 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eac814-869e-47db-b5c1-e3f6791fd493 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:27.760084 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879ad88-ec28-4313-a2a5-42fe559ee3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:27.760917 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879ad88-ec28-4313-a2a5-42fe559ee3cd None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:27.761205 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879ad88-ec28-4313-a2a5-42fe559ee3cd None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:27.761487 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879ad88-ec28-4313-a2a5-42fe559ee3cd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:27.762755 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0879ad88-ec28-4313-a2a5-42fe559ee3cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:27.766199 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0879ad88-ec28-4313-a2a5-42fe559ee3cd None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:27.766199 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 55/103] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:57:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:27.771692 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879ad88-ec28-4313-a2a5-42fe559ee3cd None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:27.787459 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef4456-8163-473e-84a9-3baa6c6043d0 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:27.815772 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:27.856255 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a81f41-fb84-42dd-89eb-9fb377eac6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:27.857437 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a81f41-fb84-42dd-89eb-9fb377eac6ed None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:27.857918 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a81f41-fb84-42dd-89eb-9fb377eac6ed None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:27.858386 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a81f41-fb84-42dd-89eb-9fb377eac6ed None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:27.859334 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a81f41-fb84-42dd-89eb-9fb377eac6ed None admin] RBAC: Adding query filter params (name=reader) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:27.859953 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a81f41-fb84-42dd-89eb-9fb377eac6ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:27.861658 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a81f41-fb84-42dd-89eb-9fb377eac6ed None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:27.878055 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 49/104] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jun 20 05:57:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:27.887770 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a81f41-fb84-42dd-89eb-9fb377eac6ed None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:27.889826 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879ad88-ec28-4313-a2a5-42fe559ee3cd None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:27.973353 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd47c11-2add-43db-8c43-0c3b69b929e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:27.973942 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd47c11-2add-43db-8c43-0c3b69b929e8 None admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:27.974229 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd47c11-2add-43db-8c43-0c3b69b929e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:27.974518 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd47c11-2add-43db-8c43-0c3b69b929e8 None admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:27.976133 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd47c11-2add-43db-8c43-0c3b69b929e8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:27.978262 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd47c11-2add-43db-8c43-0c3b69b929e8 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:27.994829 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:28.039653 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 56/105] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Jun 20 05:57:27 2022] POST /identity/v3/projects => generated 302 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:57:28.103223 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a81f41-fb84-42dd-89eb-9fb377eac6ed None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:28.154675 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3236765f-dab5-4b34-b7f4-8d32281f909f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:28.156464 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236765f-dab5-4b34-b7f4-8d32281f909f None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:28.156980 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236765f-dab5-4b34-b7f4-8d32281f909f None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:28.157516 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236765f-dab5-4b34-b7f4-8d32281f909f None admin] PATH_INFO: `/v3/users/58fcdd90c83d4239a67aae0eb17c0102` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:28.178998 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3236765f-dab5-4b34-b7f4-8d32281f909f None admin] RBAC: Authorizing `identity:get_user(user_id=58fcdd90c83d4239a67aae0eb17c0102)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:28.186159 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3236765f-dab5-4b34-b7f4-8d32281f909f None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:28.188561 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 50/106] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:27 2022] GET /identity/v3/users/58fcdd90c83d4239a67aae0eb17c0102 => generated 289 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:28.197929 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd47c11-2add-43db-8c43-0c3b69b929e8 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:28.235314 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5177683f-75dd-40a7-9cf3-9a3509e46b83 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:28.235961 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5177683f-75dd-40a7-9cf3-9a3509e46b83 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:28.236579 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5177683f-75dd-40a7-9cf3-9a3509e46b83 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:28.238531 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 51/107] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:57:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:28.244746 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefafe1d-2033-4e77-9458-af644f3a1116 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:28.245305 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefafe1d-2033-4e77-9458-af644f3a1116 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:28.245775 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefafe1d-2033-4e77-9458-af644f3a1116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:28.274583 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-aefafe1d-2033-4e77-9458-af644f3a1116 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:28.276287 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-aefafe1d-2033-4e77-9458-af644f3a1116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:28.362391 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:28.377244 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd47c11-2add-43db-8c43-0c3b69b929e8 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:28.411138 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 52/108] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:57:28.430473 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d692e-a0f0-4cd3-a148-37a1ae103924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:28.431144 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d692e-a0f0-4cd3-a148-37a1ae103924 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:28.431434 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d692e-a0f0-4cd3-a148-37a1ae103924 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:28.431720 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d692e-a0f0-4cd3-a148-37a1ae103924 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:28.437614 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd524a-5b58-4db5-93f2-2b1fa7f49ad7 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:28.437905 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd524a-5b58-4db5-93f2-2b1fa7f49ad7 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:28.438188 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd524a-5b58-4db5-93f2-2b1fa7f49ad7 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:28.439572 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 53/109] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:57:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:28.446904 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f740d6-0235-4c0e-b92c-f440e6a5ea1c None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:28.446904 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f740d6-0235-4c0e-b92c-f440e6a5ea1c None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:28.446904 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f740d6-0235-4c0e-b92c-f440e6a5ea1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:28.465020 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-e1f740d6-0235-4c0e-b92c-f440e6a5ea1c None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:28.466224 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-e1f740d6-0235-4c0e-b92c-f440e6a5ea1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:28.503520 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:28.506087 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071d692e-a0f0-4cd3-a148-37a1ae103924 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:28.507737 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071d692e-a0f0-4cd3-a148-37a1ae103924 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:28.544260 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 54/110] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:28.545245 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f740d6-0235-4c0e-b92c-f440e6a5ea1c None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:28.609139 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:28.627580 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 57/111] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 05:57:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:57:28.628268 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d692e-a0f0-4cd3-a148-37a1ae103924 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:28.660546 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f740d6-0235-4c0e-b92c-f440e6a5ea1c None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:28.702369 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d10a9-89c5-4be7-88a1-fe34762265ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:28.703184 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d10a9-89c5-4be7-88a1-fe34762265ee None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:28.703468 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d10a9-89c5-4be7-88a1-fe34762265ee None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:28.704250 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d10a9-89c5-4be7-88a1-fe34762265ee None admin] PATH_INFO: `/v3/roles/member` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:28.717428 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d10a9-89c5-4be7-88a1-fe34762265ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:28.726007 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-b43d10a9-89c5-4be7-88a1-fe34762265ee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:57:28.726007 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:28.726007 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:28.726007 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:28.726007 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:28.726007 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:28.726007 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:28.726007 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:28.726007 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:28.726007 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:28.726007 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:28.726007 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:28.726007 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:28.726007 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:28.726007 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:28.726007 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:28.726974 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:28.726974 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:28.726974 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:28.726974 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:28.726974 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:28.726974 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:28.726974 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:28.726974 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:28.726974 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:28.726974 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:28.726974 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:28.726974 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:28.726974 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:28.726974 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:28.726974 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:28.726974 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:28.727735 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:28.727735 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:28.727735 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:28.727735 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:28.727735 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:28.727735 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:28.727735 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:28.727735 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:28.727735 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:28.727735 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:28.727735 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:57:28.727735 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:57:28.727735 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 55/112] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:28.728356 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d10a9-89c5-4be7-88a1-fe34762265ee None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:28.761152 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:28.839325 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d692e-a0f0-4cd3-a148-37a1ae103924 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:28.876872 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e284be9-647f-4a1e-bf20-14fdaa195f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:28.877667 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e284be9-647f-4a1e-bf20-14fdaa195f14 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:28.877959 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e284be9-647f-4a1e-bf20-14fdaa195f14 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:28.878402 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e284be9-647f-4a1e-bf20-14fdaa195f14 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:28.888780 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e284be9-647f-4a1e-bf20-14fdaa195f14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:28.889840 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d10a9-89c5-4be7-88a1-fe34762265ee None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:28.897443 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-9e284be9-647f-4a1e-bf20-14fdaa195f14 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:57:28.897443 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:28.897443 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:28.897443 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:28.897443 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:28.897443 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:28.897443 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:28.897443 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:28.897443 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:28.897443 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:28.897443 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:28.897443 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:28.897443 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:28.897443 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:28.897443 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:28.897443 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:28.899113 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:28.899113 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:28.899113 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:28.899113 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:28.899113 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:28.899113 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:28.899113 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:28.899113 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:28.899113 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:28.899113 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:28.899113 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:28.899113 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:28.899113 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:28.899113 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:28.899113 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:28.899113 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:28.899903 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:28.899903 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:28.899903 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:28.899903 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:28.899903 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:28.899903 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:28.899903 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:28.899903 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:28.899903 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:28.899903 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:28.899903 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:57:28.899903 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:57:28.899903 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 58/113] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jun 20 05:57:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:28.901638 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e284be9-647f-4a1e-bf20-14fdaa195f14 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:28.930427 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa71f7cf-2879-4e00-b536-849c463c4cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:28.931296 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71f7cf-2879-4e00-b536-849c463c4cd1 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:28.931585 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71f7cf-2879-4e00-b536-849c463c4cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:28.931866 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71f7cf-2879-4e00-b536-849c463c4cd1 None admin] PATH_INFO: `/v3/projects/852ede50488445d795524cf072c12f7e` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:28.933109 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa71f7cf-2879-4e00-b536-849c463c4cd1 None admin] RBAC: Authorizing `identity:get_project(project_id=852ede50488445d795524cf072c12f7e)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:28.934575 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa71f7cf-2879-4e00-b536-849c463c4cd1 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:28.936461 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 56/114] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:28 2022] GET /identity/v3/projects/852ede50488445d795524cf072c12f7e => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:28.942245 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a95e8-cbca-4b4c-840a-93a2ba4b5ecb None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:28.942534 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a95e8-cbca-4b4c-840a-93a2ba4b5ecb None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:28.942824 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a95e8-cbca-4b4c-840a-93a2ba4b5ecb None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:28.944388 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 57/115] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:57:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:28.945696 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423975f-39bf-4363-89e3-0600d428afae None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:28.946200 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423975f-39bf-4363-89e3-0600d428afae None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:28.946487 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423975f-39bf-4363-89e3-0600d428afae None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:28.947974 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 58/116] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:57:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:28.949516 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8423975f-39bf-4363-89e3-0600d428afae None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:28.961771 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:29.018147 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e284be9-647f-4a1e-bf20-14fdaa195f14 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:29.047355 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:29.053402 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19d3ce-61e5-4f7f-b5e7-e9524b5d74bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:29.054083 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19d3ce-61e5-4f7f-b5e7-e9524b5d74bf None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:29.054486 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19d3ce-61e5-4f7f-b5e7-e9524b5d74bf None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:29.054768 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19d3ce-61e5-4f7f-b5e7-e9524b5d74bf None admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:29.055529 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c19d3ce-61e5-4f7f-b5e7-e9524b5d74bf None admin] RBAC: Adding query filter params (name=member) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:29.055843 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c19d3ce-61e5-4f7f-b5e7-e9524b5d74bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:29.057280 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c19d3ce-61e5-4f7f-b5e7-e9524b5d74bf None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:29.062381 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8423975f-39bf-4363-89e3-0600d428afae None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:29.071873 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 59/117] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jun 20 05:57:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:29.071873 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19d3ce-61e5-4f7f-b5e7-e9524b5d74bf None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:29.098254 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee5742-ff59-4621-a3df-c87da436cf9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:29.098925 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee5742-ff59-4621-a3df-c87da436cf9d None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:29.099208 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee5742-ff59-4621-a3df-c87da436cf9d None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:29.099484 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee5742-ff59-4621-a3df-c87da436cf9d None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:29.100228 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee5742-ff59-4621-a3df-c87da436cf9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:29.100533 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee5742-ff59-4621-a3df-c87da436cf9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:29.102473 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee5742-ff59-4621-a3df-c87da436cf9d None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:29.115407 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 59/118] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:29.115407 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fc6fa-afc6-4080-99b4-d829d02ff8fc None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:29.115407 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fc6fa-afc6-4080-99b4-d829d02ff8fc None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:29.115407 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fc6fa-afc6-4080-99b4-d829d02ff8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:29.131739 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-bd2fc6fa-afc6-4080-99b4-d829d02ff8fc None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:29.133512 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-bd2fc6fa-afc6-4080-99b4-d829d02ff8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:29.184194 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19d3ce-61e5-4f7f-b5e7-e9524b5d74bf None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:29.199102 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:29.218724 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 60/119] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:29.218724 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e64025-0cf0-4005-8c5a-bc7283883c24 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:29.218724 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e64025-0cf0-4005-8c5a-bc7283883c24 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:29.218724 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e64025-0cf0-4005-8c5a-bc7283883c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:29.232163 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2c016f-8824-4b7a-b05d-e9e53e30fec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:29.232690 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-f5e64025-0cf0-4005-8c5a-bc7283883c24 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:29.233068 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c016f-8824-4b7a-b05d-e9e53e30fec8 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:29.233421 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c016f-8824-4b7a-b05d-e9e53e30fec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:29.233803 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c016f-8824-4b7a-b05d-e9e53e30fec8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:29.234173 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-f5e64025-0cf0-4005-8c5a-bc7283883c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:29.234827 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2c016f-8824-4b7a-b05d-e9e53e30fec8 None admin] RBAC: Adding query filter params (role.id=2c6f4a5c6a944218bdf2bc9684eea581, scope.project.id=852ede50488445d795524cf072c12f7e, user.id=58fcdd90c83d4239a67aae0eb17c0102) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:29.235210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2c016f-8824-4b7a-b05d-e9e53e30fec8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:29.236940 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2c016f-8824-4b7a-b05d-e9e53e30fec8 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:29.243385 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 60/120] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jun 20 05:57:29 2022] GET /identity/v3/role_assignments?user.id=58fcdd90c83d4239a67aae0eb17c0102&scope.project.id=852ede50488445d795524cf072c12f7e&role.id=2c6f4a5c6a944218bdf2bc9684eea581 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:29.244214 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2c016f-8824-4b7a-b05d-e9e53e30fec8 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:29.347362 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 61/121] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:29.348428 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e64025-0cf0-4005-8c5a-bc7283883c24 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:29.366177 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:29.389430 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2c016f-8824-4b7a-b05d-e9e53e30fec8 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:29.437115 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da3bd60-a0d0-4ce9-8410-c5f8d19a36f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:29.438795 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3bd60-a0d0-4ce9-8410-c5f8d19a36f0 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:29.438914 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3bd60-a0d0-4ce9-8410-c5f8d19a36f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:29.439108 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3bd60-a0d0-4ce9-8410-c5f8d19a36f0 None admin] PATH_INFO: `/v3/users/d4a868efb70f4b3e8d5794974975fc27` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:29.443788 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da3bd60-a0d0-4ce9-8410-c5f8d19a36f0 None admin] RBAC: Authorizing `identity:get_user(user_id=d4a868efb70f4b3e8d5794974975fc27)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:29.445688 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da3bd60-a0d0-4ce9-8410-c5f8d19a36f0 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:29.449465 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 61/122] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:29 2022] GET /identity/v3/users/d4a868efb70f4b3e8d5794974975fc27 => generated 275 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:29.454589 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da3bd60-a0d0-4ce9-8410-c5f8d19a36f0 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:29.490980 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e64025-0cf0-4005-8c5a-bc7283883c24 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:29.504227 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:29.526818 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0c38e-0d25-48b4-ab7f-8183cfded9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:29.527699 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0c38e-0d25-48b4-ab7f-8183cfded9b0 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:29.527989 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0c38e-0d25-48b4-ab7f-8183cfded9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:29.528269 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0c38e-0d25-48b4-ab7f-8183cfded9b0 None admin] PATH_INFO: `/v3/users/665bc0e94a714a5594465a5b89b022aa` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:29.529510 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f0c38e-0d25-48b4-ab7f-8183cfded9b0 None admin] RBAC: Authorizing `identity:get_user(user_id=665bc0e94a714a5594465a5b89b022aa)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:29.530987 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f0c38e-0d25-48b4-ab7f-8183cfded9b0 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:29.532640 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 62/123] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:29 2022] GET /identity/v3/users/665bc0e94a714a5594465a5b89b022aa => generated 247 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:29.533439 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0c38e-0d25-48b4-ab7f-8183cfded9b0 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:29.568516 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da3bd60-a0d0-4ce9-8410-c5f8d19a36f0 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:29.608538 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4235228-2fbb-4274-b22a-917fbb752439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:29.609715 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4235228-2fbb-4274-b22a-917fbb752439 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:29.610219 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4235228-2fbb-4274-b22a-917fbb752439 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:29.610710 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4235228-2fbb-4274-b22a-917fbb752439 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:29.626550 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:29.629469 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4235228-2fbb-4274-b22a-917fbb752439 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:29.639606 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-d4235228-2fbb-4274-b22a-917fbb752439 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:57:29.639606 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:29.639606 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:29.639606 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:29.639606 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:29.639606 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:29.639606 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:29.639606 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:29.639606 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:29.639606 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:29.639606 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:29.639606 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:29.639606 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:29.639606 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:29.639606 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:29.639606 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:29.640542 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:29.640542 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:29.640542 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:29.640542 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:29.640542 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:29.640542 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:29.640542 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:29.640542 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:29.640542 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:29.640542 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:29.640542 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:29.640542 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:29.640542 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:29.640542 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:29.640542 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:29.640542 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:29.641331 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:29.641331 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:29.641331 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:29.641331 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:29.641331 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:29.641331 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:29.641331 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:29.641331 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:29.641331 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:29.641331 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:29.641331 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:57:29.641331 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:57:29.641331 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 62/124] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jun 20 05:57:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:29.641992 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4235228-2fbb-4274-b22a-917fbb752439 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:29.661563 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0c38e-0d25-48b4-ab7f-8183cfded9b0 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:29.707405 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf76fbd0-18e5-422f-9332-319a891a9d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:29.708211 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76fbd0-18e5-422f-9332-319a891a9d13 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:29.708500 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76fbd0-18e5-422f-9332-319a891a9d13 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:29.708814 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76fbd0-18e5-422f-9332-319a891a9d13 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:29.722813 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf76fbd0-18e5-422f-9332-319a891a9d13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:29.734926 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-bf76fbd0-18e5-422f-9332-319a891a9d13 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:57:29.734926 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:29.734926 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:29.734926 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:29.734926 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:29.734926 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:29.734926 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:29.734926 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:29.734926 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:29.734926 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:29.734926 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:29.734926 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:29.734926 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:29.734926 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:29.734926 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:29.734926 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:29.736625 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:29.736625 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:29.736625 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:29.736625 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:29.736625 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:29.736625 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:29.736625 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:29.736625 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:29.736625 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:29.736625 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:29.736625 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:29.736625 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:29.736625 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:29.736625 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:29.736625 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:29.736625 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:29.737440 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:29.737440 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:29.737440 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:29.737440 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:29.737440 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:29.737440 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:29.737440 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:29.737440 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:29.737440 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:29.737440 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:29.737440 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:57:29.737440 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:57:29.737440 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 63/125] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:29.737440 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf76fbd0-18e5-422f-9332-319a891a9d13 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:29.764786 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4235228-2fbb-4274-b22a-917fbb752439 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:29.797073 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:29.804301 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c9302-a619-454f-80d5-225b5a60cbeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:29.805487 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c9302-a619-454f-80d5-225b5a60cbeb None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:29.806132 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c9302-a619-454f-80d5-225b5a60cbeb None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:29.806714 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c9302-a619-454f-80d5-225b5a60cbeb None admin] PATH_INFO: `/v3/projects/852ede50488445d795524cf072c12f7e` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:29.808214 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2c9302-a619-454f-80d5-225b5a60cbeb None admin] RBAC: Authorizing `identity:get_project(project_id=852ede50488445d795524cf072c12f7e)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:29.810228 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2c9302-a619-454f-80d5-225b5a60cbeb None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:29.817097 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 63/126] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:29 2022] GET /identity/v3/projects/852ede50488445d795524cf072c12f7e => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:29.818301 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c9302-a619-454f-80d5-225b5a60cbeb None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:29.859964 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf76fbd0-18e5-422f-9332-319a891a9d13 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:29.902839 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d2b6c-64ea-457c-9243-7eecf47eba8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:29.904158 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d2b6c-64ea-457c-9243-7eecf47eba8a None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:29.904466 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d2b6c-64ea-457c-9243-7eecf47eba8a None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:29.904776 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d2b6c-64ea-457c-9243-7eecf47eba8a None admin] PATH_INFO: `/v3/projects/852ede50488445d795524cf072c12f7e` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:29.906414 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34d2b6c-64ea-457c-9243-7eecf47eba8a None admin] RBAC: Authorizing `identity:get_project(project_id=852ede50488445d795524cf072c12f7e)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:29.908194 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34d2b6c-64ea-457c-9243-7eecf47eba8a None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:29.910873 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 64/127] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:29 2022] GET /identity/v3/projects/852ede50488445d795524cf072c12f7e => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:29.911490 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d2b6c-64ea-457c-9243-7eecf47eba8a None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:29.923401 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:29.935966 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c9302-a619-454f-80d5-225b5a60cbeb None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:29.984174 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37504573-0fbd-461d-abf7-dc920e22702c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:29.985448 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37504573-0fbd-461d-abf7-dc920e22702c None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:29.985745 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37504573-0fbd-461d-abf7-dc920e22702c None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:29.986033 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37504573-0fbd-461d-abf7-dc920e22702c None admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:29.986805 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37504573-0fbd-461d-abf7-dc920e22702c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:29.987126 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37504573-0fbd-461d-abf7-dc920e22702c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:29.989239 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37504573-0fbd-461d-abf7-dc920e22702c None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:30.004834 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 64/128] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jun 20 05:57:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:30.004834 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37504573-0fbd-461d-abf7-dc920e22702c None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:30.036742 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d2b6c-64ea-457c-9243-7eecf47eba8a None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:30.050152 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:30.075843 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87956f60-013e-4dba-8b84-0b865338b102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:30.077025 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87956f60-013e-4dba-8b84-0b865338b102 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:30.077519 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87956f60-013e-4dba-8b84-0b865338b102 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:30.077998 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87956f60-013e-4dba-8b84-0b865338b102 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:30.079217 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87956f60-013e-4dba-8b84-0b865338b102 None admin] RBAC: Adding query filter params (name=member) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:30.079744 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87956f60-013e-4dba-8b84-0b865338b102 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:30.081367 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87956f60-013e-4dba-8b84-0b865338b102 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:30.090945 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 65/129] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jun 20 05:57:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:30.092081 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87956f60-013e-4dba-8b84-0b865338b102 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:30.135566 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37504573-0fbd-461d-abf7-dc920e22702c None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:30.170353 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:30.177292 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c208c7b8-cf4c-4e69-8bfc-264c759ea016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:30.178513 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208c7b8-cf4c-4e69-8bfc-264c759ea016 None admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:30.179063 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208c7b8-cf4c-4e69-8bfc-264c759ea016 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:30.180078 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208c7b8-cf4c-4e69-8bfc-264c759ea016 None admin] PATH_INFO: `/v3/projects/852ede50488445d795524cf072c12f7e/users/d4a868efb70f4b3e8d5794974975fc27/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:30.182667 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c208c7b8-cf4c-4e69-8bfc-264c759ea016 None admin] RBAC: Authorizing `identity:create_grant(project_id=852ede50488445d795524cf072c12f7e, user_id=d4a868efb70f4b3e8d5794974975fc27, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:30.184737 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c208c7b8-cf4c-4e69-8bfc-264c759ea016 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:30.202761 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 65/130] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jun 20 05:57:30 2022] PUT /identity/v3/projects/852ede50488445d795524cf072c12f7e/users/d4a868efb70f4b3e8d5794974975fc27/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:57:30.208556 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87956f60-013e-4dba-8b84-0b865338b102 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:30.209839 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c208c7b8-cf4c-4e69-8bfc-264c759ea016 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:30.255713 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e76523-62cf-4677-9672-176dce3ae10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:30.256681 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e76523-62cf-4677-9672-176dce3ae10e None admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:30.257052 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e76523-62cf-4677-9672-176dce3ae10e None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:30.257949 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e76523-62cf-4677-9672-176dce3ae10e None admin] PATH_INFO: `/v3/projects/852ede50488445d795524cf072c12f7e/users/665bc0e94a714a5594465a5b89b022aa/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:30.262702 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e76523-62cf-4677-9672-176dce3ae10e None admin] RBAC: Authorizing `identity:create_grant(project_id=852ede50488445d795524cf072c12f7e, user_id=665bc0e94a714a5594465a5b89b022aa, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:30.264468 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e76523-62cf-4677-9672-176dce3ae10e None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:30.286450 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 66/131] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jun 20 05:57:30 2022] PUT /identity/v3/projects/852ede50488445d795524cf072c12f7e/users/665bc0e94a714a5594465a5b89b022aa/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:57:30.288222 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e76523-62cf-4677-9672-176dce3ae10e None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:30.436285 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e76523-62cf-4677-9672-176dce3ae10e None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:30.470168 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:30.474420 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:30.482832 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a42b683-d64a-4b1c-bde3-34c6a6aecb69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:30.484277 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42b683-d64a-4b1c-bde3-34c6a6aecb69 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:30.484596 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42b683-d64a-4b1c-bde3-34c6a6aecb69 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:30.484923 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42b683-d64a-4b1c-bde3-34c6a6aecb69 None admin] PATH_INFO: `/v3/users/d4a868efb70f4b3e8d5794974975fc27` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:30.486577 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a42b683-d64a-4b1c-bde3-34c6a6aecb69 None admin] RBAC: Authorizing `identity:get_user(user_id=d4a868efb70f4b3e8d5794974975fc27)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:30.488096 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a42b683-d64a-4b1c-bde3-34c6a6aecb69 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:30.490532 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 67/132] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:30 2022] GET /identity/v3/users/d4a868efb70f4b3e8d5794974975fc27 => generated 275 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:30.497960 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a42b683-d64a-4b1c-bde3-34c6a6aecb69 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:30.500627 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c208c7b8-cf4c-4e69-8bfc-264c759ea016 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:30.601991 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd65f97f-74ae-4acc-9153-a2b629f44017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:30.602896 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65f97f-74ae-4acc-9153-a2b629f44017 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:30.603182 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65f97f-74ae-4acc-9153-a2b629f44017 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:30.603466 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65f97f-74ae-4acc-9153-a2b629f44017 None admin] PATH_INFO: `/v3/users/d4a868efb70f4b3e8d5794974975fc27` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:30.604773 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd65f97f-74ae-4acc-9153-a2b629f44017 None admin] RBAC: Authorizing `identity:get_user(user_id=d4a868efb70f4b3e8d5794974975fc27)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:30.606262 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd65f97f-74ae-4acc-9153-a2b629f44017 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:30.607936 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 66/133] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:30 2022] GET /identity/v3/users/d4a868efb70f4b3e8d5794974975fc27 => generated 275 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:30.614108 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd65f97f-74ae-4acc-9153-a2b629f44017 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:30.636682 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a42b683-d64a-4b1c-bde3-34c6a6aecb69 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:30.710687 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3dbae-bb56-4720-be3b-a8ea990c4e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:30.712728 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3dbae-bb56-4720-be3b-a8ea990c4e39 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:30.713398 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3dbae-bb56-4720-be3b-a8ea990c4e39 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:30.715041 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3dbae-bb56-4720-be3b-a8ea990c4e39 None admin] PATH_INFO: `/v3/projects/3120272f83de4e19b4f75c9ef9e3379d` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:30.717343 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def3dbae-bb56-4720-be3b-a8ea990c4e39 None admin] RBAC: Authorizing `identity:get_project(project_id=3120272f83de4e19b4f75c9ef9e3379d)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:30.719641 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def3dbae-bb56-4720-be3b-a8ea990c4e39 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:30.723834 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 68/134] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:30 2022] GET /identity/v3/projects/3120272f83de4e19b4f75c9ef9e3379d => generated 312 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:30.725892 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e609ae9-cb3c-4f10-ad5f-9b44ddd9c5b7 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:30.727087 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e609ae9-cb3c-4f10-ad5f-9b44ddd9c5b7 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:30.730031 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e609ae9-cb3c-4f10-ad5f-9b44ddd9c5b7 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:30.732732 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 69/135] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:57:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:30.734422 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e609ae9-cb3c-4f10-ad5f-9b44ddd9c5b7 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:30.783474 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd65f97f-74ae-4acc-9153-a2b629f44017 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:30.824545 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:30.847600 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e37003-9ee6-435d-8227-874167d6bd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:30.848523 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e37003-9ee6-435d-8227-874167d6bd4c None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:30.848848 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e37003-9ee6-435d-8227-874167d6bd4c None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:30.849132 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e37003-9ee6-435d-8227-874167d6bd4c None admin] PATH_INFO: `/v3/projects/852ede50488445d795524cf072c12f7e` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:30.850346 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e37003-9ee6-435d-8227-874167d6bd4c None admin] RBAC: Authorizing `identity:get_project(project_id=852ede50488445d795524cf072c12f7e)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:30.855506 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e37003-9ee6-435d-8227-874167d6bd4c None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:30.859989 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 67/136] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:30 2022] GET /identity/v3/projects/852ede50488445d795524cf072c12f7e => generated 298 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:30.861298 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e39192-3aab-4ce9-adb9-4d5c4e776f95 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:30.861588 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e39192-3aab-4ce9-adb9-4d5c4e776f95 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:30.861869 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e39192-3aab-4ce9-adb9-4d5c4e776f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:30.892564 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-11e39192-3aab-4ce9-adb9-4d5c4e776f95 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:30.893810 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-11e39192-3aab-4ce9-adb9-4d5c4e776f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:30.900574 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e609ae9-cb3c-4f10-ad5f-9b44ddd9c5b7 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:30.944876 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:30.960092 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19480b46-cacb-43d3-a2ec-a4a780b656d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:30.962014 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19480b46-cacb-43d3-a2ec-a4a780b656d4 None admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:30.962285 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19480b46-cacb-43d3-a2ec-a4a780b656d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:30.962570 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19480b46-cacb-43d3-a2ec-a4a780b656d4 None admin] PATH_INFO: `/v3/projects/3120272f83de4e19b4f75c9ef9e3379d/users/d4a868efb70f4b3e8d5794974975fc27/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:30.964636 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19480b46-cacb-43d3-a2ec-a4a780b656d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=3120272f83de4e19b4f75c9ef9e3379d, user_id=d4a868efb70f4b3e8d5794974975fc27, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:30.966231 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19480b46-cacb-43d3-a2ec-a4a780b656d4 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:30.983970 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 70/137] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jun 20 05:57:30 2022] PUT /identity/v3/projects/3120272f83de4e19b4f75c9ef9e3379d/users/d4a868efb70f4b3e8d5794974975fc27/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:57:30.989104 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19480b46-cacb-43d3-a2ec-a4a780b656d4 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:31.075868 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 68/138] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:31.147525 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19480b46-cacb-43d3-a2ec-a4a780b656d4 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:31.170150 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e39192-3aab-4ce9-adb9-4d5c4e776f95 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:31.196351 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:31.215345 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a9d1f-337b-429e-acdc-4c19715ac214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:31.216180 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a9d1f-337b-429e-acdc-4c19715ac214 None admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:31.216466 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a9d1f-337b-429e-acdc-4c19715ac214 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:31.217006 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a9d1f-337b-429e-acdc-4c19715ac214 None admin] PATH_INFO: `/v3/projects/852ede50488445d795524cf072c12f7e/users/d4a868efb70f4b3e8d5794974975fc27/roles/844adf3fdfaf458faa6fcbcf641d4182` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:31.223457 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190a9d1f-337b-429e-acdc-4c19715ac214 None admin] RBAC: Authorizing `identity:create_grant(project_id=852ede50488445d795524cf072c12f7e, user_id=d4a868efb70f4b3e8d5794974975fc27, role_id=844adf3fdfaf458faa6fcbcf641d4182)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:31.225158 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190a9d1f-337b-429e-acdc-4c19715ac214 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:31.248098 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 71/139] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jun 20 05:57:30 2022] PUT /identity/v3/projects/852ede50488445d795524cf072c12f7e/users/d4a868efb70f4b3e8d5794974975fc27/roles/844adf3fdfaf458faa6fcbcf641d4182 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:57:31.336412 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e39192-3aab-4ce9-adb9-4d5c4e776f95 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:31.376563 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f0c5b-a2dc-4960-935e-30c51b015b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:31.377470 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f0c5b-a2dc-4960-935e-30c51b015b82 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:31.377753 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f0c5b-a2dc-4960-935e-30c51b015b82 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:31.378026 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f0c5b-a2dc-4960-935e-30c51b015b82 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:31.379263 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f0c5b-a2dc-4960-935e-30c51b015b82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:31.380751 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f0c5b-a2dc-4960-935e-30c51b015b82 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:31.383296 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 69/140] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:57:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:31.388978 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a9d1f-337b-429e-acdc-4c19715ac214 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:31.547339 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a9d1f-337b-429e-acdc-4c19715ac214 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:31.590865 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc45a23-36b8-4b87-9fd5-6e6c0f280500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:31.591554 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc45a23-36b8-4b87-9fd5-6e6c0f280500 None admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:31.591843 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc45a23-36b8-4b87-9fd5-6e6c0f280500 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:31.592129 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc45a23-36b8-4b87-9fd5-6e6c0f280500 None admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:31.592896 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc45a23-36b8-4b87-9fd5-6e6c0f280500 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:31.594351 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc45a23-36b8-4b87-9fd5-6e6c0f280500 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:31.609987 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7614b-db91-4c44-99be-dba9fb6384f9 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:31.610160 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7614b-db91-4c44-99be-dba9fb6384f9 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:31.611016 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7614b-db91-4c44-99be-dba9fb6384f9 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:31.614201 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 70/141] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:57:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:31.620654 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec72888-35e2-41d7-88e8-56b332374bd0 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:31.621265 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec72888-35e2-41d7-88e8-56b332374bd0 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:31.622067 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec72888-35e2-41d7-88e8-56b332374bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:31.626314 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 72/142] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Jun 20 05:57:31 2022] POST /identity/v3/users => generated 283 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:57:31.654041 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-9ec72888-35e2-41d7-88e8-56b332374bd0 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:31.655277 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-9ec72888-35e2-41d7-88e8-56b332374bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:31.705069 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:31.751404 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 71/143] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:57:31.774654 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc45a23-36b8-4b87-9fd5-6e6c0f280500 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:31.845419 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:31.942708 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc45a23-36b8-4b87-9fd5-6e6c0f280500 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:31.990763 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaa4ba2-b95f-4113-a8fc-792a5ade71e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:31.991647 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa4ba2-b95f-4113-a8fc-792a5ade71e8 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:31.991940 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa4ba2-b95f-4113-a8fc-792a5ade71e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:31.992214 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa4ba2-b95f-4113-a8fc-792a5ade71e8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:32.009039 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaa4ba2-b95f-4113-a8fc-792a5ade71e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:32.016837 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-feaa4ba2-b95f-4113-a8fc-792a5ade71e8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:57:32.016837 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:32.016837 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:32.016837 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:32.016837 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:32.016837 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:32.016837 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:32.016837 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:32.016837 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:32.016837 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:32.016837 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:32.016837 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:32.016837 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:32.016837 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:32.016837 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:32.016837 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:32.017661 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:32.017661 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:32.017661 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:32.017661 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:32.017661 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:32.017661 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:32.017661 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:32.017661 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:32.017661 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:32.017661 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:32.017661 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:32.017661 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:32.017661 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:32.017661 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:32.017661 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:32.017661 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:32.018877 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:32.018877 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:32.018877 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:32.018877 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:32.018877 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:32.018877 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:32.018877 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:32.018877 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:32.018877 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:32.018877 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:32.018877 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:57:32.018877 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:57:32.018877 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 73/144] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:32.026185 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec72888-35e2-41d7-88e8-56b332374bd0 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:32.148421 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec72888-35e2-41d7-88e8-56b332374bd0 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:32.192337 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb92d51-df37-48ef-84f3-44cc0abd5d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:32.193063 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb92d51-df37-48ef-84f3-44cc0abd5d11 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:32.193351 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb92d51-df37-48ef-84f3-44cc0abd5d11 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:32.193633 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb92d51-df37-48ef-84f3-44cc0abd5d11 None admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:32.194481 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb92d51-df37-48ef-84f3-44cc0abd5d11 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:32.195468 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb92d51-df37-48ef-84f3-44cc0abd5d11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:32.196757 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb92d51-df37-48ef-84f3-44cc0abd5d11 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:32.206435 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 72/145] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jun 20 05:57:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:32.212556 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaa4ba2-b95f-4113-a8fc-792a5ade71e8 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:32.375868 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:32.378836 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaa4ba2-b95f-4113-a8fc-792a5ade71e8 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:32.420728 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c4d9f-6652-43f0-b4dd-9c3e6f761984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:32.421550 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c4d9f-6652-43f0-b4dd-9c3e6f761984 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:32.421835 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c4d9f-6652-43f0-b4dd-9c3e6f761984 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:32.422114 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c4d9f-6652-43f0-b4dd-9c3e6f761984 None admin] PATH_INFO: `/v3/users/58fcdd90c83d4239a67aae0eb17c0102` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:32.423344 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c4d9f-6652-43f0-b4dd-9c3e6f761984 None admin] RBAC: Authorizing `identity:get_user(user_id=58fcdd90c83d4239a67aae0eb17c0102)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:32.424826 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c4d9f-6652-43f0-b4dd-9c3e6f761984 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:32.426471 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 74/146] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:32 2022] GET /identity/v3/users/58fcdd90c83d4239a67aae0eb17c0102 => generated 289 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:32.433185 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb92d51-df37-48ef-84f3-44cc0abd5d11 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:32.475456 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:32.569129 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb92d51-df37-48ef-84f3-44cc0abd5d11 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:32.606940 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a185d3-bcb6-4525-8351-3a3a0772aef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:32.607857 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a185d3-bcb6-4525-8351-3a3a0772aef7 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:32.608187 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a185d3-bcb6-4525-8351-3a3a0772aef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:32.608471 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a185d3-bcb6-4525-8351-3a3a0772aef7 None admin] PATH_INFO: `/v3/projects/852ede50488445d795524cf072c12f7e` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:32.610949 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a185d3-bcb6-4525-8351-3a3a0772aef7 None admin] RBAC: Authorizing `identity:get_project(project_id=852ede50488445d795524cf072c12f7e)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:32.612433 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a185d3-bcb6-4525-8351-3a3a0772aef7 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:32.614369 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 73/147] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:32 2022] GET /identity/v3/projects/852ede50488445d795524cf072c12f7e => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:32.620418 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c4d9f-6652-43f0-b4dd-9c3e6f761984 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:32.751759 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c4d9f-6652-43f0-b4dd-9c3e6f761984 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:32.800594 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d015573-525c-4512-b2d4-1d48c28e6664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:32.801744 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d015573-525c-4512-b2d4-1d48c28e6664 None admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:32.802172 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d015573-525c-4512-b2d4-1d48c28e6664 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:32.802675 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d015573-525c-4512-b2d4-1d48c28e6664 None admin] PATH_INFO: `/v3/projects/852ede50488445d795524cf072c12f7e/users/58fcdd90c83d4239a67aae0eb17c0102/roles/2c6f4a5c6a944218bdf2bc9684eea581` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:32.805571 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d015573-525c-4512-b2d4-1d48c28e6664 None admin] RBAC: Authorizing `identity:create_grant(project_id=852ede50488445d795524cf072c12f7e, user_id=58fcdd90c83d4239a67aae0eb17c0102, role_id=2c6f4a5c6a944218bdf2bc9684eea581)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:32.807216 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d015573-525c-4512-b2d4-1d48c28e6664 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:32.827902 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 75/148] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jun 20 05:57:32 2022] PUT /identity/v3/projects/852ede50488445d795524cf072c12f7e/users/58fcdd90c83d4239a67aae0eb17c0102/roles/2c6f4a5c6a944218bdf2bc9684eea581 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:57:33.571826 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d1309-f7dd-4e23-a811-97e0afeb33b8 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:33.572353 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d1309-f7dd-4e23-a811-97e0afeb33b8 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:33.572435 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d1309-f7dd-4e23-a811-97e0afeb33b8 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:33.574081 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 74/149] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:57:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:33.582892 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b9ca0-325d-4e8d-a8e0-aeccb25eb435 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:33.583401 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b9ca0-325d-4e8d-a8e0-aeccb25eb435 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:33.583477 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b9ca0-325d-4e8d-a8e0-aeccb25eb435 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:33.585144 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 76/150] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:57:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:33.592138 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75e261-9c6d-43cb-9502-9befeea07d10 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:33.592435 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75e261-9c6d-43cb-9502-9befeea07d10 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:33.592741 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75e261-9c6d-43cb-9502-9befeea07d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:33.594171 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624c8b9-14e9-4dd1-af9e-1ce4c8d97cab None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:33.594458 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624c8b9-14e9-4dd1-af9e-1ce4c8d97cab None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:33.594734 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624c8b9-14e9-4dd1-af9e-1ce4c8d97cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:33.633503 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-ed75e261-9c6d-43cb-9502-9befeea07d10 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:33.634698 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-ed75e261-9c6d-43cb-9502-9befeea07d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:33.642092 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-b624c8b9-14e9-4dd1-af9e-1ce4c8d97cab None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:33.643287 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-b624c8b9-14e9-4dd1-af9e-1ce4c8d97cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:33.699462 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:33.778928 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 77/151] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:33.795045 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 75/152] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:57:33.826298 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b624c8b9-14e9-4dd1-af9e-1ce4c8d97cab None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:33.865944 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed75e261-9c6d-43cb-9502-9befeea07d10 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:33.913075 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:33.940062 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b624c8b9-14e9-4dd1-af9e-1ce4c8d97cab None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:33.983893 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7142000b-0594-4dbc-b8cc-a8c98b1dcd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:33.984725 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142000b-0594-4dbc-b8cc-a8c98b1dcd00 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:33.985021 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142000b-0594-4dbc-b8cc-a8c98b1dcd00 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:33.985300 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142000b-0594-4dbc-b8cc-a8c98b1dcd00 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:34.000339 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7142000b-0594-4dbc-b8cc-a8c98b1dcd00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:34.010322 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-7142000b-0594-4dbc-b8cc-a8c98b1dcd00 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:57:34.010322 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:34.010322 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:34.010322 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:34.010322 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:34.010322 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:34.010322 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:34.010322 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:34.010322 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:34.010322 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:34.010322 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:34.010322 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:34.010322 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:34.010322 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:34.010322 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:34.010322 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:34.011217 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:34.011217 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:34.011217 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:34.011217 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:34.011217 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:34.011217 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:34.011217 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:34.011217 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:34.011217 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:34.011217 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:34.011217 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:34.011217 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:34.011217 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:34.011217 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:34.011217 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:34.011217 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:34.011982 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:34.011982 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:34.011982 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:34.011982 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:34.011982 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:34.011982 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:34.011982 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:34.011982 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:34.011982 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:34.011982 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:34.011982 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:57:34.011982 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:57:34.011982 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 78/153] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jun 20 05:57:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:34.018910 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7142000b-0594-4dbc-b8cc-a8c98b1dcd00 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:34.044395 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:34.131416 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed75e261-9c6d-43cb-9502-9befeea07d10 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:34.167516 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7142000b-0594-4dbc-b8cc-a8c98b1dcd00 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:34.231910 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c16ee5-5b3d-430a-a029-af7ece3ee615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:34.232863 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c16ee5-5b3d-430a-a029-af7ece3ee615 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:34.233152 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c16ee5-5b3d-430a-a029-af7ece3ee615 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:34.233430 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c16ee5-5b3d-430a-a029-af7ece3ee615 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:34.234512 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde22d5-ddef-4e28-868a-c8d413479c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:34.235567 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde22d5-ddef-4e28-868a-c8d413479c08 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:34.236045 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde22d5-ddef-4e28-868a-c8d413479c08 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:34.236512 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde22d5-ddef-4e28-868a-c8d413479c08 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:34.237597 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bde22d5-ddef-4e28-868a-c8d413479c08 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:34.238116 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bde22d5-ddef-4e28-868a-c8d413479c08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:34.239716 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bde22d5-ddef-4e28-868a-c8d413479c08 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:34.256032 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c16ee5-5b3d-430a-a029-af7ece3ee615 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:34.260360 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 79/154] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:34.268469 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-a9c16ee5-5b3d-430a-a029-af7ece3ee615 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:57:34.268469 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:34.268469 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:34.268469 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:34.268469 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:34.268469 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:34.268469 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:34.268469 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:34.268469 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:34.268469 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:34.268469 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:34.268469 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:34.268469 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:34.268469 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:34.268469 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:34.268469 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:34.269375 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:34.269375 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:34.269375 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:34.269375 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:34.269375 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:34.269375 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:34.269375 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:34.269375 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:34.269375 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:34.269375 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:34.269375 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:34.269375 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:34.269375 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:34.269375 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:34.269375 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:34.269375 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:34.270346 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:34.270346 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:34.270346 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:34.270346 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:34.270346 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:34.270346 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:34.270346 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:34.270346 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:34.270346 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:34.270346 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:34.270346 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:57:34.270346 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:57:34.270346 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 76/155] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 404 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:57:34.272499 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde22d5-ddef-4e28-868a-c8d413479c08 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:34.282483 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c16ee5-5b3d-430a-a029-af7ece3ee615 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:34.429028 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:34.430114 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:34.476647 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde22d5-ddef-4e28-868a-c8d413479c08 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:34.478506 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c16ee5-5b3d-430a-a029-af7ece3ee615 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:34.537340 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b7f82-179b-4617-825b-5223bf34502e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:34.538767 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b7f82-179b-4617-825b-5223bf34502e None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:34.539526 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b7f82-179b-4617-825b-5223bf34502e None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:34.539526 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b7f82-179b-4617-825b-5223bf34502e None admin] PATH_INFO: `/v3/users/665bc0e94a714a5594465a5b89b022aa` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:34.540815 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382b7f82-179b-4617-825b-5223bf34502e None admin] RBAC: Authorizing `identity:get_user(user_id=665bc0e94a714a5594465a5b89b022aa)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:34.542265 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382b7f82-179b-4617-825b-5223bf34502e None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:34.543905 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 80/156] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:34 2022] GET /identity/v3/users/665bc0e94a714a5594465a5b89b022aa => generated 247 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:34.549556 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab87fb8-87cd-4a09-b390-0461c7c46a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:34.550246 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab87fb8-87cd-4a09-b390-0461c7c46a6a None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:34.550527 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab87fb8-87cd-4a09-b390-0461c7c46a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:34.550798 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab87fb8-87cd-4a09-b390-0461c7c46a6a None admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:34.551555 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab87fb8-87cd-4a09-b390-0461c7c46a6a None admin] RBAC: Adding query filter params (name=member) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:34.551860 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab87fb8-87cd-4a09-b390-0461c7c46a6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:34.553272 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab87fb8-87cd-4a09-b390-0461c7c46a6a None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:34.555046 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf87517-12c9-43a2-9cf0-24d1398bc454 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:34.555561 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf87517-12c9-43a2-9cf0-24d1398bc454 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:34.556123 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf87517-12c9-43a2-9cf0-24d1398bc454 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:34.557642 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 81/157] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:57:34 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:34.558462 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf87517-12c9-43a2-9cf0-24d1398bc454 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:34.563901 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 77/158] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jun 20 05:57:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:34.565431 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2dc54-bda3-4bc8-a2bc-5d7343fff815 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:34.566032 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2dc54-bda3-4bc8-a2bc-5d7343fff815 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:34.566538 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2dc54-bda3-4bc8-a2bc-5d7343fff815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:34.589189 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-3ce2dc54-bda3-4bc8-a2bc-5d7343fff815 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:34.594833 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-3ce2dc54-bda3-4bc8-a2bc-5d7343fff815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:34.755035 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf87517-12c9-43a2-9cf0-24d1398bc454 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:34.778125 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 78/159] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:34.778979 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce2dc54-bda3-4bc8-a2bc-5d7343fff815 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:34.831236 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e3b39-2801-48b6-ad38-40e620399f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:34.831901 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e3b39-2801-48b6-ad38-40e620399f33 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:34.832181 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e3b39-2801-48b6-ad38-40e620399f33 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:34.832457 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e3b39-2801-48b6-ad38-40e620399f33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:34.876922 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:34.971601 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:34.992744 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e3b39-2801-48b6-ad38-40e620399f33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:34.994406 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e3b39-2801-48b6-ad38-40e620399f33 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:35.050923 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce2dc54-bda3-4bc8-a2bc-5d7343fff815 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:35.150102 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df8f58a-e7cf-4be5-b10c-0234ac9d4f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:35.150997 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8f58a-e7cf-4be5-b10c-0234ac9d4f9e None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:35.151275 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8f58a-e7cf-4be5-b10c-0234ac9d4f9e None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:35.151547 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8f58a-e7cf-4be5-b10c-0234ac9d4f9e None admin] PATH_INFO: `/v3/users/d4a868efb70f4b3e8d5794974975fc27` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:35.157515 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df8f58a-e7cf-4be5-b10c-0234ac9d4f9e None admin] RBAC: Authorizing `identity:get_user(user_id=d4a868efb70f4b3e8d5794974975fc27)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:35.159012 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df8f58a-e7cf-4be5-b10c-0234ac9d4f9e None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:35.160688 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 79/160] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:34 2022] GET /identity/v3/users/d4a868efb70f4b3e8d5794974975fc27 => generated 275 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:35.161463 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df8f58a-e7cf-4be5-b10c-0234ac9d4f9e None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:35.225280 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 82/161] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 05:57:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 667 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:57:35.226954 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fee569-3a1e-40b6-9c62-8871ee8952df None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:35.227239 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fee569-3a1e-40b6-9c62-8871ee8952df None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:35.227517 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fee569-3a1e-40b6-9c62-8871ee8952df None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:35.228968 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 83/162] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:57:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:35.233528 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fee569-3a1e-40b6-9c62-8871ee8952df None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:35.341560 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:35.434876 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df8f58a-e7cf-4be5-b10c-0234ac9d4f9e None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:35.448216 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fee569-3a1e-40b6-9c62-8871ee8952df None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:35.494846 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da7b0e-a2b7-4d86-b18c-91713cd20e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:35.495517 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da7b0e-a2b7-4d86-b18c-91713cd20e56 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:35.495913 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da7b0e-a2b7-4d86-b18c-91713cd20e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:35.496352 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da7b0e-a2b7-4d86-b18c-91713cd20e56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:35.532499 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed26caa-e455-4ba2-989f-3a8ea2292912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:35.533603 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed26caa-e455-4ba2-989f-3a8ea2292912 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:35.534029 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed26caa-e455-4ba2-989f-3a8ea2292912 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:35.534447 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed26caa-e455-4ba2-989f-3a8ea2292912 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:35.548280 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:35.553181 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed26caa-e455-4ba2-989f-3a8ea2292912 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:35.564629 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-5ed26caa-e455-4ba2-989f-3a8ea2292912 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:57:35.564629 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:35.564629 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:35.564629 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:35.564629 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:35.564629 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:35.564629 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:35.564629 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:35.564629 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:35.564629 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:35.564629 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:35.564629 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:35.564629 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:35.564629 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:35.564629 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:35.564629 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:35.565528 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:35.565528 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:35.565528 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:35.565528 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:35.565528 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:35.565528 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:35.565528 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:35.565528 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:35.565528 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:35.565528 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:35.565528 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:35.565528 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:35.565528 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:35.565528 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:35.565528 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:35.565528 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:35.566304 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:35.566304 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:35.566304 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:35.566304 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:35.566304 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:35.566304 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:35.566304 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:35.566304 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:35.566304 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:35.566304 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:35.566304 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:57:35.566304 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:57:35.566304 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 80/163] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 405 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:35.567432 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a42032-2165-4c0f-a9e5-7991766f45d7 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:35.567432 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a42032-2165-4c0f-a9e5-7991766f45d7 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:35.567673 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a42032-2165-4c0f-a9e5-7991766f45d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:35.598591 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06da7b0e-a2b7-4d86-b18c-91713cd20e56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:35.598747 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-93a42032-2165-4c0f-a9e5-7991766f45d7 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:35.599780 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-93a42032-2165-4c0f-a9e5-7991766f45d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:35.602222 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06da7b0e-a2b7-4d86-b18c-91713cd20e56 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:35.660892 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:35.686236 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 81/164] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:35.687111 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a42032-2165-4c0f-a9e5-7991766f45d7 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:35.814837 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a42032-2165-4c0f-a9e5-7991766f45d7 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:35.846159 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:35.856475 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e937fb-5cd0-4dca-a844-e7c0e6608982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:35.857719 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e937fb-5cd0-4dca-a844-e7c0e6608982 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:35.858324 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e937fb-5cd0-4dca-a844-e7c0e6608982 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:35.858795 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e937fb-5cd0-4dca-a844-e7c0e6608982 None admin] PATH_INFO: `/v3/projects/852ede50488445d795524cf072c12f7e` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:35.860262 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e937fb-5cd0-4dca-a844-e7c0e6608982 None admin] RBAC: Authorizing `identity:get_project(project_id=852ede50488445d795524cf072c12f7e)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:35.862183 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e937fb-5cd0-4dca-a844-e7c0e6608982 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:35.864422 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 82/165] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:35 2022] GET /identity/v3/projects/852ede50488445d795524cf072c12f7e => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:35.865918 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c2fed-b04a-4fdb-9a38-57d891cccd14 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:35.867161 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c2fed-b04a-4fdb-9a38-57d891cccd14 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:35.867675 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c2fed-b04a-4fdb-9a38-57d891cccd14 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:35.869179 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 83/166] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:57:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:35.870209 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c2fed-b04a-4fdb-9a38-57d891cccd14 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:35.884154 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 84/167] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 05:57:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 655 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:57:35.884888 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da7b0e-a2b7-4d86-b18c-91713cd20e56 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:35.993042 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c2fed-b04a-4fdb-9a38-57d891cccd14 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:36.032312 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f36dfac-4ac1-4261-8fe9-ae9c2f77a7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:36.033401 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f36dfac-4ac1-4261-8fe9-ae9c2f77a7a9 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:36.033906 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f36dfac-4ac1-4261-8fe9-ae9c2f77a7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:36.034496 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f36dfac-4ac1-4261-8fe9-ae9c2f77a7a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:36.035455 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f36dfac-4ac1-4261-8fe9-ae9c2f77a7a9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:36.035967 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f36dfac-4ac1-4261-8fe9-ae9c2f77a7a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:36.037698 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f36dfac-4ac1-4261-8fe9-ae9c2f77a7a9 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:36.047902 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 84/168] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jun 20 05:57:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:36.049081 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f36dfac-4ac1-4261-8fe9-ae9c2f77a7a9 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:36.109316 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da7b0e-a2b7-4d86-b18c-91713cd20e56 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:36.144126 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:36.153912 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340cb6e6-fb30-44fd-9aa0-a7550fd9e747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:36.155206 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340cb6e6-fb30-44fd-9aa0-a7550fd9e747 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:36.155682 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340cb6e6-fb30-44fd-9aa0-a7550fd9e747 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:36.156225 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340cb6e6-fb30-44fd-9aa0-a7550fd9e747 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:36.169689 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340cb6e6-fb30-44fd-9aa0-a7550fd9e747 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:36.182226 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-340cb6e6-fb30-44fd-9aa0-a7550fd9e747 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:57:36.182226 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:36.182226 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:36.182226 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:36.182226 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:36.182226 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:36.182226 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:36.182226 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:36.182226 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:36.182226 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:36.182226 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:36.182226 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:36.182226 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:36.182226 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:36.182226 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:36.182226 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:36.183210 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:36.183210 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:36.183210 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:36.183210 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:36.183210 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:36.183210 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:36.183210 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:36.183210 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:36.183210 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:36.183210 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:36.183210 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:36.183210 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:36.183210 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:36.183210 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:36.183210 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:36.183210 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:36.184046 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:36.184046 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:36.184046 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:36.184046 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:36.184046 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:36.184046 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:36.184046 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:36.184046 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:36.184046 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:36.184046 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:36.184046 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:57:36.184046 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:57:36.187324 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 85/169] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jun 20 05:57:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:36.193762 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb76f3-ca35-496a-9cee-dc3ed54ec12f None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:36.201657 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb76f3-ca35-496a-9cee-dc3ed54ec12f None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:36.202248 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb76f3-ca35-496a-9cee-dc3ed54ec12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:36.236719 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-b4bb76f3-ca35-496a-9cee-dc3ed54ec12f None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:36.238312 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-b4bb76f3-ca35-496a-9cee-dc3ed54ec12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:36.240732 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:36.258837 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f36dfac-4ac1-4261-8fe9-ae9c2f77a7a9 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:36.333624 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 86/170] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:36.334743 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bb76f3-ca35-496a-9cee-dc3ed54ec12f None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:36.349472 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411318dc-d614-46d7-b8c7-64dba93279ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:36.350163 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411318dc-d614-46d7-b8c7-64dba93279ca None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:36.350451 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411318dc-d614-46d7-b8c7-64dba93279ca None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:36.350872 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411318dc-d614-46d7-b8c7-64dba93279ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:36.351962 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411318dc-d614-46d7-b8c7-64dba93279ca None admin] RBAC: Adding query filter params (role.id=5a64bd8372704de98e75436ff69e46b3, scope.project.id=852ede50488445d795524cf072c12f7e, user.id=665bc0e94a714a5594465a5b89b022aa) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:36.352276 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411318dc-d614-46d7-b8c7-64dba93279ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:36.353753 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411318dc-d614-46d7-b8c7-64dba93279ca None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:36.368859 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 85/171] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jun 20 05:57:36 2022] GET /identity/v3/role_assignments?user.id=665bc0e94a714a5594465a5b89b022aa&scope.project.id=852ede50488445d795524cf072c12f7e&role.id=5a64bd8372704de98e75436ff69e46b3 => generated 608 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:36.374316 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411318dc-d614-46d7-b8c7-64dba93279ca None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:36.571432 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bb76f3-ca35-496a-9cee-dc3ed54ec12f None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:36.602004 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411318dc-d614-46d7-b8c7-64dba93279ca None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:36.611254 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27390325-1390-4d95-aa83-cdbd37ee0df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:36.611254 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27390325-1390-4d95-aa83-cdbd37ee0df9 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:36.611668 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27390325-1390-4d95-aa83-cdbd37ee0df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:36.611963 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27390325-1390-4d95-aa83-cdbd37ee0df9 None admin] PATH_INFO: `/v3/projects/852ede50488445d795524cf072c12f7e` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:36.613236 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27390325-1390-4d95-aa83-cdbd37ee0df9 None admin] RBAC: Authorizing `identity:get_project(project_id=852ede50488445d795524cf072c12f7e)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:36.614720 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27390325-1390-4d95-aa83-cdbd37ee0df9 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:36.616657 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 87/172] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:36 2022] GET /identity/v3/projects/852ede50488445d795524cf072c12f7e => generated 298 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:36.617566 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27390325-1390-4d95-aa83-cdbd37ee0df9 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:36.626779 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:36.627102 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:36.643769 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7bb177-abb6-4589-801a-fae019f1691b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:36.644943 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7bb177-abb6-4589-801a-fae019f1691b None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:36.645360 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7bb177-abb6-4589-801a-fae019f1691b None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:36.645774 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7bb177-abb6-4589-801a-fae019f1691b None admin] PATH_INFO: `/v3/users/d4a868efb70f4b3e8d5794974975fc27` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:36.649678 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7bb177-abb6-4589-801a-fae019f1691b None admin] RBAC: Authorizing `identity:get_user(user_id=d4a868efb70f4b3e8d5794974975fc27)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:36.649678 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7bb177-abb6-4589-801a-fae019f1691b None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:36.650620 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 86/173] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:36 2022] GET /identity/v3/users/d4a868efb70f4b3e8d5794974975fc27 => generated 275 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:36.653232 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7bb177-abb6-4589-801a-fae019f1691b None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:36.749765 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27390325-1390-4d95-aa83-cdbd37ee0df9 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:36.773327 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7bb177-abb6-4589-801a-fae019f1691b None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:36.784455 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fe7683-8c4c-4a08-afc6-e56f225b851b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:36.785157 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe7683-8c4c-4a08-afc6-e56f225b851b None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:36.785441 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe7683-8c4c-4a08-afc6-e56f225b851b None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:36.785717 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe7683-8c4c-4a08-afc6-e56f225b851b None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:36.786471 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fe7683-8c4c-4a08-afc6-e56f225b851b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:36.786780 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fe7683-8c4c-4a08-afc6-e56f225b851b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:36.788717 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fe7683-8c4c-4a08-afc6-e56f225b851b None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:36.796640 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 88/174] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jun 20 05:57:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:36.802182 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d7e5d-abcd-4e46-ab4a-b0637085c569 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:36.802472 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d7e5d-abcd-4e46-ab4a-b0637085c569 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:36.802751 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d7e5d-abcd-4e46-ab4a-b0637085c569 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:36.804823 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 89/175] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:57:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:36.808960 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196101f3-7a67-468c-b5bb-d65f1a4ae321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:36.809434 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039133e3-e324-47c8-95be-2374c07c505f None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:36.809717 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039133e3-e324-47c8-95be-2374c07c505f None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:36.809824 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196101f3-7a67-468c-b5bb-d65f1a4ae321 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:36.809989 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039133e3-e324-47c8-95be-2374c07c505f None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:36.810078 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196101f3-7a67-468c-b5bb-d65f1a4ae321 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:36.810293 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196101f3-7a67-468c-b5bb-d65f1a4ae321 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:36.811252 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 90/176] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:57:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:36.812055 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039133e3-e324-47c8-95be-2374c07c505f None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:36.821120 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196101f3-7a67-468c-b5bb-d65f1a4ae321 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:36.829076 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-196101f3-7a67-468c-b5bb-d65f1a4ae321 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:57:36.829076 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:36.829076 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:36.829076 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:36.829076 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:36.829076 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:36.829076 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:36.829076 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:36.829076 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:36.829076 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:36.829076 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:36.829076 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:36.829076 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:36.829076 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:36.829076 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:36.829076 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:36.830069 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:36.830069 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:36.830069 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:36.830069 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:36.830069 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:36.830069 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:36.830069 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:36.830069 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:36.830069 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:36.830069 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:36.830069 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:36.830069 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:36.830069 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:36.830069 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:36.830069 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:36.830069 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:36.830856 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:36.830856 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:36.830856 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:36.830856 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:36.830856 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:36.830856 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:36.830856 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:36.830856 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:36.830856 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:36.830856 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:36.830856 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:57:36.830856 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:57:36.830856 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 87/177] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jun 20 05:57:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:36.831505 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196101f3-7a67-468c-b5bb-d65f1a4ae321 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:36.880847 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:36.888757 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:36.916426 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039133e3-e324-47c8-95be-2374c07c505f None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:36.945230 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196101f3-7a67-468c-b5bb-d65f1a4ae321 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:36.954353 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107d271e-a900-4a16-b6f0-e5c3477f5412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:36.955008 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d271e-a900-4a16-b6f0-e5c3477f5412 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:36.955285 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d271e-a900-4a16-b6f0-e5c3477f5412 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:36.955554 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d271e-a900-4a16-b6f0-e5c3477f5412 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:36.956381 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107d271e-a900-4a16-b6f0-e5c3477f5412 None admin] RBAC: Adding query filter params (role.id=c34cf84397a64ab0ad2a06daa8e13d88, scope.project.id=852ede50488445d795524cf072c12f7e, user.id=d4a868efb70f4b3e8d5794974975fc27) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:36.956690 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107d271e-a900-4a16-b6f0-e5c3477f5412 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:36.958140 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107d271e-a900-4a16-b6f0-e5c3477f5412 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:36.964501 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 91/178] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jun 20 05:57:36 2022] GET /identity/v3/role_assignments?user.id=d4a868efb70f4b3e8d5794974975fc27&scope.project.id=852ede50488445d795524cf072c12f7e&role.id=c34cf84397a64ab0ad2a06daa8e13d88 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:36.965749 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1d716-bb90-42dd-82b9-52c8a114c068 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:36.966032 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1d716-bb90-42dd-82b9-52c8a114c068 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:36.966307 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1d716-bb90-42dd-82b9-52c8a114c068 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:36.967548 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 92/179] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:57:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:36.968253 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de1d716-bb90-42dd-82b9-52c8a114c068 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:36.983065 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675310de-8c7b-40fd-b6bc-942ab3493cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:36.984060 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675310de-8c7b-40fd-b6bc-942ab3493cf9 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:36.984519 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675310de-8c7b-40fd-b6bc-942ab3493cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:36.985006 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675310de-8c7b-40fd-b6bc-942ab3493cf9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:37.071692 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675310de-8c7b-40fd-b6bc-942ab3493cf9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:37.073777 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675310de-8c7b-40fd-b6bc-942ab3493cf9 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:37.095399 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de1d716-bb90-42dd-82b9-52c8a114c068 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:37.129057 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:37.134663 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:37.136055 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f7f58-0bad-4eb1-903b-9fef72f4ccf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:37.136969 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f7f58-0bad-4eb1-903b-9fef72f4ccf3 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:37.137669 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f7f58-0bad-4eb1-903b-9fef72f4ccf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:37.137669 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f7f58-0bad-4eb1-903b-9fef72f4ccf3 None admin] PATH_INFO: `/v3/users/d4a868efb70f4b3e8d5794974975fc27` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:37.139617 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60f7f58-0bad-4eb1-903b-9fef72f4ccf3 None admin] RBAC: Authorizing `identity:get_user(user_id=d4a868efb70f4b3e8d5794974975fc27)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:37.140595 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60f7f58-0bad-4eb1-903b-9fef72f4ccf3 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:37.142741 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 93/180] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:36 2022] GET /identity/v3/users/d4a868efb70f4b3e8d5794974975fc27 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:37.143610 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748c7a1-9830-4e14-ba49-cbe0de6f8bf5 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:37.143898 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748c7a1-9830-4e14-ba49-cbe0de6f8bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:37.144169 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748c7a1-9830-4e14-ba49-cbe0de6f8bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:37.170369 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-7748c7a1-9830-4e14-ba49-cbe0de6f8bf5 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:37.170935 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-7748c7a1-9830-4e14-ba49-cbe0de6f8bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:37.201894 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 88/181] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 05:57:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:57:37.203914 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a53a5-8ba0-477c-a2bb-b280cca96ef1 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:37.204204 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a53a5-8ba0-477c-a2bb-b280cca96ef1 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:37.204486 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a53a5-8ba0-477c-a2bb-b280cca96ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:37.222218 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-7c0a53a5-8ba0-477c-a2bb-b280cca96ef1 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:37.223446 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-7c0a53a5-8ba0-477c-a2bb-b280cca96ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:37.248298 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 94/182] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:37.249618 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748c7a1-9830-4e14-ba49-cbe0de6f8bf5 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:37.312230 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 89/183] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:37.313875 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da52670-69d3-4706-8b5f-dd0f0d859643 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:37.314151 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da52670-69d3-4706-8b5f-dd0f0d859643 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:37.314429 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da52670-69d3-4706-8b5f-dd0f0d859643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:37.342045 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-6da52670-69d3-4706-8b5f-dd0f0d859643 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:37.343227 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-6da52670-69d3-4706-8b5f-dd0f0d859643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:37.368234 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748c7a1-9830-4e14-ba49-cbe0de6f8bf5 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:37.395850 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:37.401790 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae8519-82e2-4675-974a-e891dfc10c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:37.402456 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae8519-82e2-4675-974a-e891dfc10c69 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:37.402787 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae8519-82e2-4675-974a-e891dfc10c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:37.403054 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae8519-82e2-4675-974a-e891dfc10c69 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:37.403798 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cae8519-82e2-4675-974a-e891dfc10c69 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:37.404096 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cae8519-82e2-4675-974a-e891dfc10c69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:37.405550 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cae8519-82e2-4675-974a-e891dfc10c69 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:37.410237 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 90/184] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:37.411063 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da52670-69d3-4706-8b5f-dd0f0d859643 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:37.420390 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 95/185] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:37.421214 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae8519-82e2-4675-974a-e891dfc10c69 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:37.424631 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:37.514725 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da52670-69d3-4706-8b5f-dd0f0d859643 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:37.527967 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae8519-82e2-4675-974a-e891dfc10c69 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:37.552652 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95321b2b-f142-45e7-be2d-9e21fbfd8985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:37.553344 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95321b2b-f142-45e7-be2d-9e21fbfd8985 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:37.554155 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95321b2b-f142-45e7-be2d-9e21fbfd8985 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:37.554621 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95321b2b-f142-45e7-be2d-9e21fbfd8985 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:37.565012 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7740d0-8756-4173-819a-2c13ce119776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:37.565886 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7740d0-8756-4173-819a-2c13ce119776 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:37.566172 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7740d0-8756-4173-819a-2c13ce119776 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:37.566446 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7740d0-8756-4173-819a-2c13ce119776 None admin] PATH_INFO: `/v3/projects/3120272f83de4e19b4f75c9ef9e3379d` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:37.567683 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7740d0-8756-4173-819a-2c13ce119776 None admin] RBAC: Authorizing `identity:get_project(project_id=3120272f83de4e19b4f75c9ef9e3379d)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:37.569251 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7740d0-8756-4173-819a-2c13ce119776 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:37.571346 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 96/186] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:37 2022] GET /identity/v3/projects/3120272f83de4e19b4f75c9ef9e3379d => generated 312 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:37.572118 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7740d0-8756-4173-819a-2c13ce119776 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:37.625798 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95321b2b-f142-45e7-be2d-9e21fbfd8985 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:37.627389 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95321b2b-f142-45e7-be2d-9e21fbfd8985 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:37.630724 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:37.638494 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:37.673098 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7740d0-8756-4173-819a-2c13ce119776 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:37.706875 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76772b96-e62a-417c-8e9f-c7814aa9a404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:37.707670 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76772b96-e62a-417c-8e9f-c7814aa9a404 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:37.707954 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76772b96-e62a-417c-8e9f-c7814aa9a404 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:37.708234 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76772b96-e62a-417c-8e9f-c7814aa9a404 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:37.718516 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76772b96-e62a-417c-8e9f-c7814aa9a404 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:37.726432 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 91/187] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 05:57:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:57:37.726576 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-76772b96-e62a-417c-8e9f-c7814aa9a404 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:57:37.726576 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:37.726576 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:37.726576 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:37.726576 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:37.726576 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:37.726576 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:37.726576 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:37.726576 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:37.726576 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:37.726576 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:37.726576 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:37.726576 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:37.726576 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:37.726576 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:37.726576 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:37.727361 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:37.727361 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:37.727361 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:37.727361 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:37.727361 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:37.727361 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:37.727361 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:37.727361 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:37.727361 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:37.727361 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:37.727361 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:37.727361 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:37.727361 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:37.727361 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:37.727361 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:37.727361 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:37.732904 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:37.732904 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:37.732904 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:37.732904 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:37.732904 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:37.732904 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:37.732904 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:37.732904 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:37.732904 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:37.732904 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:37.732904 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:57:37.732904 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:57:37.733492 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95321b2b-f142-45e7-be2d-9e21fbfd8985 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:37.733568 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 97/188] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:37.733568 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76772b96-e62a-417c-8e9f-c7814aa9a404 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:37.825202 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95321b2b-f142-45e7-be2d-9e21fbfd8985 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:37.829547 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76772b96-e62a-417c-8e9f-c7814aa9a404 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:37.836378 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:37.848844 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:37.860070 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca9aa65-ca6f-43e4-baa6-334a68179100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:37.860903 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9aa65-ca6f-43e4-baa6-334a68179100 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:37.861193 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9aa65-ca6f-43e4-baa6-334a68179100 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:37.861468 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9aa65-ca6f-43e4-baa6-334a68179100 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:37.863667 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f43f5f-e99b-4300-a6e0-ba1b6cecd84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:37.864841 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f43f5f-e99b-4300-a6e0-ba1b6cecd84f None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:37.865129 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f43f5f-e99b-4300-a6e0-ba1b6cecd84f None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:37.865407 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f43f5f-e99b-4300-a6e0-ba1b6cecd84f None admin] PATH_INFO: `/v3/users/c5009dd5fc444faeb4a1974029f0fed9` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:37.872764 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca9aa65-ca6f-43e4-baa6-334a68179100 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:37.879079 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f43f5f-e99b-4300-a6e0-ba1b6cecd84f None admin] RBAC: Authorizing `identity:get_user(user_id=c5009dd5fc444faeb4a1974029f0fed9)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:37.880540 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f43f5f-e99b-4300-a6e0-ba1b6cecd84f None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:37.880829 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-cca9aa65-ca6f-43e4-baa6-334a68179100 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:57:37.880829 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:37.880829 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:37.880829 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:37.880829 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:37.880829 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:37.880829 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:37.880829 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:37.880829 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:37.880829 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:37.880829 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:37.880829 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:37.880829 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:37.880829 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:37.880829 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:37.880829 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:37.882404 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:37.882404 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:37.882404 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:37.882404 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:37.882404 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:37.882404 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:37.882404 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:37.882404 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:37.882404 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:37.882404 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:37.882404 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:37.882404 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:37.882404 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:37.882404 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:37.882404 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:37.882404 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:37.883279 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:37.883279 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:37.883279 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:37.883279 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:37.883279 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:37.883279 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:37.883279 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:37.883279 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:37.883279 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:37.883279 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:37.883279 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:57:37.883279 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:57:37.883279 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 92/189] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jun 20 05:57:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:37.883917 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 98/190] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:37 2022] GET /identity/v3/users/c5009dd5fc444faeb4a1974029f0fed9 => generated 283 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:37.883985 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca9aa65-ca6f-43e4-baa6-334a68179100 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:37.884314 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f43f5f-e99b-4300-a6e0-ba1b6cecd84f None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:37.983766 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f43f5f-e99b-4300-a6e0-ba1b6cecd84f None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:37.984386 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca9aa65-ca6f-43e4-baa6-334a68179100 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:38.020055 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b4d9e-f4e1-44c9-b73f-aa17ea149454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:38.020484 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce0a00e-8632-4515-ae32-63b331d22981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:38.020809 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b4d9e-f4e1-44c9-b73f-aa17ea149454 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:38.021093 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b4d9e-f4e1-44c9-b73f-aa17ea149454 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:38.021317 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0a00e-8632-4515-ae32-63b331d22981 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:38.021410 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b4d9e-f4e1-44c9-b73f-aa17ea149454 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:38.021600 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0a00e-8632-4515-ae32-63b331d22981 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:38.021958 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0a00e-8632-4515-ae32-63b331d22981 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:38.022374 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93b4d9e-f4e1-44c9-b73f-aa17ea149454 None admin] RBAC: Adding query filter params (role.id=c34cf84397a64ab0ad2a06daa8e13d88, scope.project.id=3120272f83de4e19b4f75c9ef9e3379d, user.id=d4a868efb70f4b3e8d5794974975fc27) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:38.022682 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93b4d9e-f4e1-44c9-b73f-aa17ea149454 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:38.023476 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce0a00e-8632-4515-ae32-63b331d22981 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:38.024125 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93b4d9e-f4e1-44c9-b73f-aa17ea149454 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:38.024960 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce0a00e-8632-4515-ae32-63b331d22981 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:38.026589 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 93/191] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:57:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:38.027362 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce0a00e-8632-4515-ae32-63b331d22981 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:38.039470 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 99/192] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jun 20 05:57:37 2022] GET /identity/v3/role_assignments?user.id=d4a868efb70f4b3e8d5794974975fc27&scope.project.id=3120272f83de4e19b4f75c9ef9e3379d&role.id=c34cf84397a64ab0ad2a06daa8e13d88 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:38.039470 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b4d9e-f4e1-44c9-b73f-aa17ea149454 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:38.072199 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:38.095181 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:38.141588 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce0a00e-8632-4515-ae32-63b331d22981 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:38.162139 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b4d9e-f4e1-44c9-b73f-aa17ea149454 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:38.179608 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43676e8b-8441-4cce-8277-838064adaa05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:38.180520 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43676e8b-8441-4cce-8277-838064adaa05 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:38.181720 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43676e8b-8441-4cce-8277-838064adaa05 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:38.181720 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43676e8b-8441-4cce-8277-838064adaa05 None admin] PATH_INFO: `/v3/projects/852ede50488445d795524cf072c12f7e` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:38.182981 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43676e8b-8441-4cce-8277-838064adaa05 None admin] RBAC: Authorizing `identity:get_project(project_id=852ede50488445d795524cf072c12f7e)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:38.184556 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43676e8b-8441-4cce-8277-838064adaa05 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:38.186639 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 94/193] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:38 2022] GET /identity/v3/projects/852ede50488445d795524cf072c12f7e => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:38.187079 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43676e8b-8441-4cce-8277-838064adaa05 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:38.209783 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c3ef8-def0-4ce1-a263-934554371c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:38.210871 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c3ef8-def0-4ce1-a263-934554371c3d None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:38.211151 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c3ef8-def0-4ce1-a263-934554371c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:38.211432 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c3ef8-def0-4ce1-a263-934554371c3d None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:38.212350 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34c3ef8-def0-4ce1-a263-934554371c3d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:38.213008 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34c3ef8-def0-4ce1-a263-934554371c3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:38.214400 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34c3ef8-def0-4ce1-a263-934554371c3d None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:38.224343 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 100/194] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jun 20 05:57:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:38.225085 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c3ef8-def0-4ce1-a263-934554371c3d None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:38.303127 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43676e8b-8441-4cce-8277-838064adaa05 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:38.311574 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:38.326302 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c3ef8-def0-4ce1-a263-934554371c3d None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:38.330114 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:38.338274 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad3e0f-ef08-4b78-bcd3-93966ac4f1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:38.338947 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad3e0f-ef08-4b78-bcd3-93966ac4f1a7 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:38.339227 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad3e0f-ef08-4b78-bcd3-93966ac4f1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:38.339502 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad3e0f-ef08-4b78-bcd3-93966ac4f1a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:38.340246 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ad3e0f-ef08-4b78-bcd3-93966ac4f1a7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:38.340555 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ad3e0f-ef08-4b78-bcd3-93966ac4f1a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:38.341978 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ad3e0f-ef08-4b78-bcd3-93966ac4f1a7 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:38.349900 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 95/195] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jun 20 05:57:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:38.351190 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad3e0f-ef08-4b78-bcd3-93966ac4f1a7 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:38.368043 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf86e0c-5272-414d-af86-a36807face53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:38.368711 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf86e0c-5272-414d-af86-a36807face53 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:38.368999 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf86e0c-5272-414d-af86-a36807face53 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:38.369362 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf86e0c-5272-414d-af86-a36807face53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:38.435548 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf86e0c-5272-414d-af86-a36807face53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:38.437063 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf86e0c-5272-414d-af86-a36807face53 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:38.450569 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad3e0f-ef08-4b78-bcd3-93966ac4f1a7 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:38.486548 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb8f48-1fb0-40ff-bac7-197523bc62a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:38.487215 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb8f48-1fb0-40ff-bac7-197523bc62a8 None admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:38.487495 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb8f48-1fb0-40ff-bac7-197523bc62a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:38.487769 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb8f48-1fb0-40ff-bac7-197523bc62a8 None admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:38.488473 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcb8f48-1fb0-40ff-bac7-197523bc62a8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:38.489936 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcb8f48-1fb0-40ff-bac7-197523bc62a8 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:38.514228 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 96/196] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Jun 20 05:57:38 2022] POST /identity/v3/users => generated 297 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:57:38.514876 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb8f48-1fb0-40ff-bac7-197523bc62a8 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:38.546367 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:38.552798 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 101/197] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 05:57:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:57:38.553879 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf86e0c-5272-414d-af86-a36807face53 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:38.557496 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:38.643197 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb8f48-1fb0-40ff-bac7-197523bc62a8 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:38.682876 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf86e0c-5272-414d-af86-a36807face53 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:38.687175 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66831d0-a1c3-4f11-ab5b-71624b879e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:38.687851 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66831d0-a1c3-4f11-ab5b-71624b879e50 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:38.688139 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66831d0-a1c3-4f11-ab5b-71624b879e50 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:38.688422 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66831d0-a1c3-4f11-ab5b-71624b879e50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:38.689303 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66831d0-a1c3-4f11-ab5b-71624b879e50 None admin] RBAC: Adding query filter params (role.id=844adf3fdfaf458faa6fcbcf641d4182, scope.project.id=852ede50488445d795524cf072c12f7e, user.id=d4a868efb70f4b3e8d5794974975fc27) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:38.689625 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66831d0-a1c3-4f11-ab5b-71624b879e50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:38.691476 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66831d0-a1c3-4f11-ab5b-71624b879e50 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:38.699149 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 97/198] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jun 20 05:57:38 2022] GET /identity/v3/role_assignments?user.id=d4a868efb70f4b3e8d5794974975fc27&scope.project.id=852ede50488445d795524cf072c12f7e&role.id=844adf3fdfaf458faa6fcbcf641d4182 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:38.699511 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66831d0-a1c3-4f11-ab5b-71624b879e50 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:38.744942 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dba6be-25dd-4249-887a-6fd77feee19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:38.745869 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dba6be-25dd-4249-887a-6fd77feee19f None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:38.746149 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dba6be-25dd-4249-887a-6fd77feee19f None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:38.746419 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dba6be-25dd-4249-887a-6fd77feee19f None admin] PATH_INFO: `/v3/users/58fcdd90c83d4239a67aae0eb17c0102` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:38.749220 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dba6be-25dd-4249-887a-6fd77feee19f None admin] RBAC: Authorizing `identity:get_user(user_id=58fcdd90c83d4239a67aae0eb17c0102)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:38.750694 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dba6be-25dd-4249-887a-6fd77feee19f None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:38.756842 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 102/199] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:38 2022] GET /identity/v3/users/58fcdd90c83d4239a67aae0eb17c0102 => generated 289 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:38.756842 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dba6be-25dd-4249-887a-6fd77feee19f None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:38.834073 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:38.854695 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66831d0-a1c3-4f11-ab5b-71624b879e50 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:38.862275 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:38.902965 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6779861-6e82-4d3a-91bf-6e77b4844d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:38.903903 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6779861-6e82-4d3a-91bf-6e77b4844d1a None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:38.904186 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6779861-6e82-4d3a-91bf-6e77b4844d1a None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:38.904285 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dba6be-25dd-4249-887a-6fd77feee19f None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:38.904462 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6779861-6e82-4d3a-91bf-6e77b4844d1a None admin] PATH_INFO: `/v3/users/c5009dd5fc444faeb4a1974029f0fed9` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:38.905735 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6779861-6e82-4d3a-91bf-6e77b4844d1a None admin] RBAC: Authorizing `identity:get_user(user_id=c5009dd5fc444faeb4a1974029f0fed9)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:38.907329 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6779861-6e82-4d3a-91bf-6e77b4844d1a None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:38.909453 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 98/200] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:38 2022] GET /identity/v3/users/c5009dd5fc444faeb4a1974029f0fed9 => generated 283 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:38.910121 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6779861-6e82-4d3a-91bf-6e77b4844d1a None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:38.955381 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868fc07c-1311-4dcc-bea8-ab2e52a7c4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:38.956262 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868fc07c-1311-4dcc-bea8-ab2e52a7c4f0 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:38.956547 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868fc07c-1311-4dcc-bea8-ab2e52a7c4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:38.956857 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868fc07c-1311-4dcc-bea8-ab2e52a7c4f0 None admin] PATH_INFO: `/v3/projects/b5e41057319e4800939cb6fcbdcd1024` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:38.958134 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868fc07c-1311-4dcc-bea8-ab2e52a7c4f0 None admin] RBAC: Authorizing `identity:get_project(project_id=b5e41057319e4800939cb6fcbdcd1024)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:38.959577 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868fc07c-1311-4dcc-bea8-ab2e52a7c4f0 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:38.963327 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 103/201] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:38 2022] GET /identity/v3/projects/b5e41057319e4800939cb6fcbdcd1024 => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:38.963452 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868fc07c-1311-4dcc-bea8-ab2e52a7c4f0 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:39.040088 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6779861-6e82-4d3a-91bf-6e77b4844d1a None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:39.083822 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa65547-86a3-43ca-865d-e4707a2b7904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:39.084534 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa65547-86a3-43ca-865d-e4707a2b7904 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:39.084971 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa65547-86a3-43ca-865d-e4707a2b7904 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:39.085163 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868fc07c-1311-4dcc-bea8-ab2e52a7c4f0 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:39.085609 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa65547-86a3-43ca-865d-e4707a2b7904 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:39.118583 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:39.134521 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5693763e-1925-4fa0-acb2-e49b45ad5e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:39.135188 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693763e-1925-4fa0-acb2-e49b45ad5e5f None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:39.135477 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693763e-1925-4fa0-acb2-e49b45ad5e5f None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:39.135755 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693763e-1925-4fa0-acb2-e49b45ad5e5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:39.146871 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:39.175516 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa65547-86a3-43ca-865d-e4707a2b7904 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:39.177044 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa65547-86a3-43ca-865d-e4707a2b7904 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:39.214176 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5693763e-1925-4fa0-acb2-e49b45ad5e5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:39.215635 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5693763e-1925-4fa0-acb2-e49b45ad5e5f None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:39.312318 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 99/202] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 05:57:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:57:39.313647 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa65547-86a3-43ca-865d-e4707a2b7904 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:39.331090 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 104/203] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 05:57:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:57:39.331935 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5693763e-1925-4fa0-acb2-e49b45ad5e5f None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:39.378011 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:39.397483 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:39.449493 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5693763e-1925-4fa0-acb2-e49b45ad5e5f None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:39.463291 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa65547-86a3-43ca-865d-e4707a2b7904 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:39.496976 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2742ad6f-ad9d-4c5d-8a7f-a4eb9688a152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:39.498110 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742ad6f-ad9d-4c5d-8a7f-a4eb9688a152 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:39.498392 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742ad6f-ad9d-4c5d-8a7f-a4eb9688a152 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:39.499070 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742ad6f-ad9d-4c5d-8a7f-a4eb9688a152 None admin] PATH_INFO: `/v3/projects/852ede50488445d795524cf072c12f7e` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:39.500786 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2742ad6f-ad9d-4c5d-8a7f-a4eb9688a152 None admin] RBAC: Authorizing `identity:get_project(project_id=852ede50488445d795524cf072c12f7e)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:39.502656 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2742ad6f-ad9d-4c5d-8a7f-a4eb9688a152 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:39.503385 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c2256a-fccc-4452-9bd9-964bb102a70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:39.504044 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2256a-fccc-4452-9bd9-964bb102a70f None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:39.504322 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2256a-fccc-4452-9bd9-964bb102a70f None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:39.504490 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 105/204] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:39 2022] GET /identity/v3/projects/852ede50488445d795524cf072c12f7e => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:39.504582 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2256a-fccc-4452-9bd9-964bb102a70f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:39.505341 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2742ad6f-ad9d-4c5d-8a7f-a4eb9688a152 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:39.505468 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c2256a-fccc-4452-9bd9-964bb102a70f None admin] RBAC: Adding query filter params (role.id=5a64bd8372704de98e75436ff69e46b3, scope.project.id=b5e41057319e4800939cb6fcbdcd1024, user.id=c5009dd5fc444faeb4a1974029f0fed9) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:39.505797 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c2256a-fccc-4452-9bd9-964bb102a70f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:39.507904 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c2256a-fccc-4452-9bd9-964bb102a70f None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:39.519029 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 100/205] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jun 20 05:57:39 2022] GET /identity/v3/role_assignments?user.id=c5009dd5fc444faeb4a1974029f0fed9&scope.project.id=b5e41057319e4800939cb6fcbdcd1024&role.id=5a64bd8372704de98e75436ff69e46b3 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:39.519820 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c2256a-fccc-4452-9bd9-964bb102a70f None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:39.714780 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2742ad6f-ad9d-4c5d-8a7f-a4eb9688a152 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:39.720222 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c2256a-fccc-4452-9bd9-964bb102a70f None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:39.731926 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:39.763104 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4547744-ed8a-49b5-a929-4d8828448573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:39.763979 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4547744-ed8a-49b5-a929-4d8828448573 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:39.764263 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4547744-ed8a-49b5-a929-4d8828448573 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:39.764542 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4547744-ed8a-49b5-a929-4d8828448573 None admin] PATH_INFO: `/v3/projects/b5e41057319e4800939cb6fcbdcd1024` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:39.765058 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:39.765783 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4547744-ed8a-49b5-a929-4d8828448573 None admin] RBAC: Authorizing `identity:get_project(project_id=b5e41057319e4800939cb6fcbdcd1024)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:39.767241 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4547744-ed8a-49b5-a929-4d8828448573 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:39.769308 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 106/206] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:39 2022] GET /identity/v3/projects/b5e41057319e4800939cb6fcbdcd1024 => generated 302 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:39.777746 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4547744-ed8a-49b5-a929-4d8828448573 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:39.781341 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420bd3ff-8b90-439b-9e8d-3ef4778821a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:39.782124 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420bd3ff-8b90-439b-9e8d-3ef4778821a3 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:39.782407 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420bd3ff-8b90-439b-9e8d-3ef4778821a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:39.782682 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420bd3ff-8b90-439b-9e8d-3ef4778821a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:39.783527 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420bd3ff-8b90-439b-9e8d-3ef4778821a3 None admin] RBAC: Adding query filter params (role.id=2c6f4a5c6a944218bdf2bc9684eea581, scope.project.id=852ede50488445d795524cf072c12f7e, user.id=58fcdd90c83d4239a67aae0eb17c0102) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:39.783838 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420bd3ff-8b90-439b-9e8d-3ef4778821a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:39.785329 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420bd3ff-8b90-439b-9e8d-3ef4778821a3 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:39.799781 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 101/207] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jun 20 05:57:39 2022] GET /identity/v3/role_assignments?user.id=58fcdd90c83d4239a67aae0eb17c0102&scope.project.id=852ede50488445d795524cf072c12f7e&role.id=2c6f4a5c6a944218bdf2bc9684eea581 => generated 608 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:39.914732 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4547744-ed8a-49b5-a929-4d8828448573 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:39.972236 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaeb2ee-5898-4d9a-8d65-073372c380d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:39.972870 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaeb2ee-5898-4d9a-8d65-073372c380d1 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:39.973155 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaeb2ee-5898-4d9a-8d65-073372c380d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:39.973430 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaeb2ee-5898-4d9a-8d65-073372c380d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:39.974286 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaeb2ee-5898-4d9a-8d65-073372c380d1 None admin] RBAC: Adding query filter params (role.id=844adf3fdfaf458faa6fcbcf641d4182, scope.project.id=b5e41057319e4800939cb6fcbdcd1024, user.id=c5009dd5fc444faeb4a1974029f0fed9) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:39.974590 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaeb2ee-5898-4d9a-8d65-073372c380d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:39.976221 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaeb2ee-5898-4d9a-8d65-073372c380d1 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:39.986677 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 107/208] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jun 20 05:57:39 2022] GET /identity/v3/role_assignments?user.id=c5009dd5fc444faeb4a1974029f0fed9&scope.project.id=b5e41057319e4800939cb6fcbdcd1024&role.id=844adf3fdfaf458faa6fcbcf641d4182 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:40.974028 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420fc13-4896-4c88-8080-0119e8c555e1 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:40.974558 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420fc13-4896-4c88-8080-0119e8c555e1 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:40.974634 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420fc13-4896-4c88-8080-0119e8c555e1 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:40.976437 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 102/209] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:57:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:40.982568 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058f20a-c732-40d2-8d77-cb83b364d322 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:40.983453 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058f20a-c732-40d2-8d77-cb83b364d322 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:40.983926 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058f20a-c732-40d2-8d77-cb83b364d322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:40.998621 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a680db-9f28-4026-9c9a-fc6bb6bd54d3 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:40.999121 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a680db-9f28-4026-9c9a-fc6bb6bd54d3 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:40.999613 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a680db-9f28-4026-9c9a-fc6bb6bd54d3 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:41.001244 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 103/210] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:57:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:41.003063 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-d058f20a-c732-40d2-8d77-cb83b364d322 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:41.004260 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-d058f20a-c732-40d2-8d77-cb83b364d322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:41.007672 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dea072-1cd3-4b92-aae9-6109ef9b288f None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:41.008165 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dea072-1cd3-4b92-aae9-6109ef9b288f None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:41.008446 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dea072-1cd3-4b92-aae9-6109ef9b288f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:41.027990 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-98dea072-1cd3-4b92-aae9-6109ef9b288f None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:41.029514 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-98dea072-1cd3-4b92-aae9-6109ef9b288f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:41.077066 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:41.104733 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 108/211] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:57:41.112902 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 104/212] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:57:41.121382 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d058f20a-c732-40d2-8d77-cb83b364d322 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:41.138074 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dea072-1cd3-4b92-aae9-6109ef9b288f None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:41.229330 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d058f20a-c732-40d2-8d77-cb83b364d322 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:41.253718 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dea072-1cd3-4b92-aae9-6109ef9b288f None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:41.265435 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ba9b9-3528-4ac0-9bce-582d3fdce323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:41.266481 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ba9b9-3528-4ac0-9bce-582d3fdce323 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:41.266892 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ba9b9-3528-4ac0-9bce-582d3fdce323 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:41.267338 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ba9b9-3528-4ac0-9bce-582d3fdce323 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:41.268735 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ba9b9-3528-4ac0-9bce-582d3fdce323 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:41.270349 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ba9b9-3528-4ac0-9bce-582d3fdce323 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:41.270753 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:41.273157 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 109/213] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:57:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:41.279262 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ba9b9-3528-4ac0-9bce-582d3fdce323 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:41.295954 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca6ee3-74e8-4bac-ac4d-78d8f666e5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:41.296852 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca6ee3-74e8-4bac-ac4d-78d8f666e5a1 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:41.297137 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca6ee3-74e8-4bac-ac4d-78d8f666e5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:41.297408 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca6ee3-74e8-4bac-ac4d-78d8f666e5a1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:41.313587 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca6ee3-74e8-4bac-ac4d-78d8f666e5a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:41.325293 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-c5ca6ee3-74e8-4bac-ac4d-78d8f666e5a1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:57:41.325293 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:41.325293 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:41.325293 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:41.325293 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:41.325293 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:41.325293 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:41.325293 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:41.325293 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:41.325293 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:41.325293 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:41.325293 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:41.325293 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:41.325293 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:41.325293 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:41.325293 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:41.326224 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:41.326224 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:41.326224 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:41.326224 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:41.326224 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:41.326224 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:41.326224 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:41.326224 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:41.326224 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:41.326224 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:41.326224 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:41.326224 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:41.326224 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:41.326224 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:41.326224 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:41.326224 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:41.326987 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:41.326987 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:41.326987 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:41.326987 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:41.326987 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:41.326987 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:41.326987 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:41.326987 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:41.326987 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:41.326987 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:41.326987 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:57:41.326987 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:57:41.328919 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:41.331559 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 105/214] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:57:41.337884 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca6ee3-74e8-4bac-ac4d-78d8f666e5a1 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:41.400665 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ba9b9-3528-4ac0-9bce-582d3fdce323 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:41.446462 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317454fa-6b40-4302-8a6d-c77806a3b840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:41.448071 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317454fa-6b40-4302-8a6d-c77806a3b840 None admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:41.448571 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317454fa-6b40-4302-8a6d-c77806a3b840 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:41.449051 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317454fa-6b40-4302-8a6d-c77806a3b840 None admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:41.450230 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317454fa-6b40-4302-8a6d-c77806a3b840 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:41.452687 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317454fa-6b40-4302-8a6d-c77806a3b840 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:41.472051 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca6ee3-74e8-4bac-ac4d-78d8f666e5a1 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:41.484203 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 110/215] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Jun 20 05:57:41 2022] POST /identity/v3/users => generated 297 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:57:41.524250 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8419d12-9fee-49a6-8a8f-0f795f0837e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:41.525041 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8419d12-9fee-49a6-8a8f-0f795f0837e9 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:41.525333 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8419d12-9fee-49a6-8a8f-0f795f0837e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:41.525611 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8419d12-9fee-49a6-8a8f-0f795f0837e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:41.526391 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8419d12-9fee-49a6-8a8f-0f795f0837e9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:41.526706 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8419d12-9fee-49a6-8a8f-0f795f0837e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:41.528213 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8419d12-9fee-49a6-8a8f-0f795f0837e9 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:41.539162 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 106/216] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jun 20 05:57:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:41.545029 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317454fa-6b40-4302-8a6d-c77806a3b840 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:41.655734 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:41.663385 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317454fa-6b40-4302-8a6d-c77806a3b840 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:41.700835 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc50578-496b-4b5f-9f37-1dacbbe793b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:41.701729 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc50578-496b-4b5f-9f37-1dacbbe793b4 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:41.702012 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc50578-496b-4b5f-9f37-1dacbbe793b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:41.702286 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc50578-496b-4b5f-9f37-1dacbbe793b4 None admin] PATH_INFO: `/v3/users/941c3a240a6b4eb889fd9d7045f52588` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:41.718663 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc50578-496b-4b5f-9f37-1dacbbe793b4 None admin] RBAC: Authorizing `identity:get_user(user_id=941c3a240a6b4eb889fd9d7045f52588)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:41.721295 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc50578-496b-4b5f-9f37-1dacbbe793b4 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:41.721554 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf1e92-38fc-4b74-8ad3-9d1f32c6559b None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:41.721845 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf1e92-38fc-4b74-8ad3-9d1f32c6559b None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:41.722127 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf1e92-38fc-4b74-8ad3-9d1f32c6559b None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:41.723512 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 107/217] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:57:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:57:41.723860 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 111/218] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:41 2022] GET /identity/v3/users/941c3a240a6b4eb889fd9d7045f52588 => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:41.729488 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a45ec1-dc3f-4e4d-a3e9-d32bc752da87 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:41.729635 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc50578-496b-4b5f-9f37-1dacbbe793b4 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:41.730167 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a45ec1-dc3f-4e4d-a3e9-d32bc752da87 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:41.730638 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a45ec1-dc3f-4e4d-a3e9-d32bc752da87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:41.758829 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-e8a45ec1-dc3f-4e4d-a3e9-d32bc752da87 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:41.758829 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-e8a45ec1-dc3f-4e4d-a3e9-d32bc752da87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:41.797251 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:41.852189 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 108/219] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:57:41.854557 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc50578-496b-4b5f-9f37-1dacbbe793b4 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:41.877920 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a45ec1-dc3f-4e4d-a3e9-d32bc752da87 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:41.906852 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26fb261-7e84-45fb-91bf-64cd00f571e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:41.907886 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26fb261-7e84-45fb-91bf-64cd00f571e6 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:41.907886 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26fb261-7e84-45fb-91bf-64cd00f571e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:41.908093 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26fb261-7e84-45fb-91bf-64cd00f571e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:41.933608 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:41.989509 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26fb261-7e84-45fb-91bf-64cd00f571e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:41.991053 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26fb261-7e84-45fb-91bf-64cd00f571e6 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:42.018715 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a45ec1-dc3f-4e4d-a3e9-d32bc752da87 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:42.068237 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053dba69-ac18-4fc0-841b-c57f0eeecced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:42.070117 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053dba69-ac18-4fc0-841b-c57f0eeecced None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:42.070627 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053dba69-ac18-4fc0-841b-c57f0eeecced None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:42.071351 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053dba69-ac18-4fc0-841b-c57f0eeecced None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:42.084091 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053dba69-ac18-4fc0-841b-c57f0eeecced None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:42.093617 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-053dba69-ac18-4fc0-841b-c57f0eeecced None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:57:42.093617 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:42.093617 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:42.093617 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:42.093617 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:42.093617 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:42.093617 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:42.093617 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:42.093617 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:42.093617 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:42.093617 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:42.093617 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:42.093617 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:42.093617 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:42.093617 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:42.093617 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:42.094510 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:42.094510 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:42.094510 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:42.094510 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:42.094510 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:42.094510 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:42.094510 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:42.094510 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:42.094510 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:42.094510 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:42.094510 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:42.094510 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:42.094510 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:42.094510 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:42.094510 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:42.094510 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:42.095307 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:42.095307 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:42.095307 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:42.095307 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:42.095307 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:42.095307 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:42.095307 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:42.095307 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:42.095307 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:42.095307 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:42.095307 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:57:42.095307 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:57:42.098617 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 109/220] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jun 20 05:57:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:57:42.104676 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053dba69-ac18-4fc0-841b-c57f0eeecced None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:42.138942 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:42.188409 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 112/221] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 05:57:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:57:42.190073 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fffe08-77f6-4bcd-8359-ea176ad37785 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:42.190504 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fffe08-77f6-4bcd-8359-ea176ad37785 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:42.190921 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fffe08-77f6-4bcd-8359-ea176ad37785 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:42.193029 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 113/222] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:57:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:42.194255 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fffe08-77f6-4bcd-8359-ea176ad37785 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:42.230267 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053dba69-ac18-4fc0-841b-c57f0eeecced None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:42.254500 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:42.278957 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4fb7a9-d315-4103-8ece-d5eaca55ae03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:42.280484 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fb7a9-d315-4103-8ece-d5eaca55ae03 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:42.281018 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fb7a9-d315-4103-8ece-d5eaca55ae03 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:42.281524 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fb7a9-d315-4103-8ece-d5eaca55ae03 None admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:42.282976 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4fb7a9-d315-4103-8ece-d5eaca55ae03 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:42.283495 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4fb7a9-d315-4103-8ece-d5eaca55ae03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:42.285845 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4fb7a9-d315-4103-8ece-d5eaca55ae03 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:42.298082 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 110/223] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:42.300425 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c14979-9fa4-4db4-8a6c-9e6429e0b8eb None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:42.300935 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c14979-9fa4-4db4-8a6c-9e6429e0b8eb None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:42.301657 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c14979-9fa4-4db4-8a6c-9e6429e0b8eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:42.309988 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fffe08-77f6-4bcd-8359-ea176ad37785 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:42.323973 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-f2c14979-9fa4-4db4-8a6c-9e6429e0b8eb None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:42.326325 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-f2c14979-9fa4-4db4-8a6c-9e6429e0b8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:42.353361 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d5c9c-d737-4195-89ca-e8f56f169bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:42.354580 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d5c9c-d737-4195-89ca-e8f56f169bdc None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:42.355060 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d5c9c-d737-4195-89ca-e8f56f169bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:42.355549 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d5c9c-d737-4195-89ca-e8f56f169bdc None admin] PATH_INFO: `/v3/projects/b5e41057319e4800939cb6fcbdcd1024` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:42.357046 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5d5c9c-d737-4195-89ca-e8f56f169bdc None admin] RBAC: Authorizing `identity:get_project(project_id=b5e41057319e4800939cb6fcbdcd1024)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:42.358788 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5d5c9c-d737-4195-89ca-e8f56f169bdc None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:42.360786 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 114/224] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:42 2022] GET /identity/v3/projects/b5e41057319e4800939cb6fcbdcd1024 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:42.361754 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d5c9c-d737-4195-89ca-e8f56f169bdc None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:42.421020 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 111/225] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:42.422349 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c14979-9fa4-4db4-8a6c-9e6429e0b8eb None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:42.460970 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:42.507127 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d5c9c-d737-4195-89ca-e8f56f169bdc None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:42.534616 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:42.555250 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ccc74f-662c-45ec-be6f-4c81b43078f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:42.556565 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccc74f-662c-45ec-be6f-4c81b43078f0 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:42.556903 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccc74f-662c-45ec-be6f-4c81b43078f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:42.557184 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccc74f-662c-45ec-be6f-4c81b43078f0 None admin] PATH_INFO: `/v3/users/c5009dd5fc444faeb4a1974029f0fed9` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:42.558468 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ccc74f-662c-45ec-be6f-4c81b43078f0 None admin] RBAC: Authorizing `identity:get_user(user_id=c5009dd5fc444faeb4a1974029f0fed9)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:42.560278 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ccc74f-662c-45ec-be6f-4c81b43078f0 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:42.564084 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 115/226] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:42 2022] GET /identity/v3/users/c5009dd5fc444faeb4a1974029f0fed9 => generated 283 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:42.565145 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ccc74f-662c-45ec-be6f-4c81b43078f0 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:42.576443 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c14979-9fa4-4db4-8a6c-9e6429e0b8eb None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:42.621681 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba64021-880c-45d6-8960-3d972e232504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:42.623110 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba64021-880c-45d6-8960-3d972e232504 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:42.623827 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba64021-880c-45d6-8960-3d972e232504 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:42.624296 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba64021-880c-45d6-8960-3d972e232504 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:42.625620 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba64021-880c-45d6-8960-3d972e232504 None admin] RBAC: Adding query filter params (role.id=c34cf84397a64ab0ad2a06daa8e13d88, scope.project.id=b5e41057319e4800939cb6fcbdcd1024, user.id=941c3a240a6b4eb889fd9d7045f52588) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:42.626567 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba64021-880c-45d6-8960-3d972e232504 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:42.628767 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba64021-880c-45d6-8960-3d972e232504 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:42.636579 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 112/227] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jun 20 05:57:42 2022] GET /identity/v3/role_assignments?user.id=941c3a240a6b4eb889fd9d7045f52588&scope.project.id=b5e41057319e4800939cb6fcbdcd1024&role.id=c34cf84397a64ab0ad2a06daa8e13d88 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:42.638752 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba64021-880c-45d6-8960-3d972e232504 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:42.695909 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ccc74f-662c-45ec-be6f-4c81b43078f0 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:42.736904 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db84fa96-dd88-4f54-b864-5905a0d988f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:42.737724 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84fa96-dd88-4f54-b864-5905a0d988f9 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:42.738053 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84fa96-dd88-4f54-b864-5905a0d988f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:42.739029 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84fa96-dd88-4f54-b864-5905a0d988f9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:42.752107 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db84fa96-dd88-4f54-b864-5905a0d988f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:42.753480 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:42.761857 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-db84fa96-dd88-4f54-b864-5905a0d988f9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:57:42.761857 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:42.761857 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:42.761857 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:42.761857 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:42.761857 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:42.761857 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:42.761857 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:42.761857 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:42.761857 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:42.761857 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:42.761857 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:42.761857 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:42.761857 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:42.761857 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:42.761857 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:42.762759 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:42.762759 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:42.762759 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:42.762759 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:42.762759 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:42.762759 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:42.762759 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:42.762759 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:42.762759 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:42.762759 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:42.762759 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:42.762759 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:42.762759 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:42.762759 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:42.762759 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:42.762759 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:42.763990 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:42.763990 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:42.763990 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:42.763990 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:42.763990 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:42.763990 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:42.763990 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:42.763990 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:42.763990 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:42.763990 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:42.763990 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:57:42.763990 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:57:42.763990 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 116/228] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jun 20 05:57:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:42.770496 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db84fa96-dd88-4f54-b864-5905a0d988f9 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:42.780821 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba64021-880c-45d6-8960-3d972e232504 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:42.820453 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302eb200-99ce-4e5e-9b04-ef9f27307739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:42.821703 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302eb200-99ce-4e5e-9b04-ef9f27307739 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:42.822182 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302eb200-99ce-4e5e-9b04-ef9f27307739 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:42.822649 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302eb200-99ce-4e5e-9b04-ef9f27307739 None admin] PATH_INFO: `/v3/projects/b5e41057319e4800939cb6fcbdcd1024` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:42.824230 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302eb200-99ce-4e5e-9b04-ef9f27307739 None admin] RBAC: Authorizing `identity:get_project(project_id=b5e41057319e4800939cb6fcbdcd1024)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:42.825982 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302eb200-99ce-4e5e-9b04-ef9f27307739 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:42.826665 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:42.832933 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 113/229] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:42 2022] GET /identity/v3/projects/b5e41057319e4800939cb6fcbdcd1024 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:42.837280 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302eb200-99ce-4e5e-9b04-ef9f27307739 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:42.886991 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db84fa96-dd88-4f54-b864-5905a0d988f9 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:42.923722 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864bc85-1dc8-4b16-aa70-1a7d5a417232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:42.924150 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864bc85-1dc8-4b16-aa70-1a7d5a417232 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:42.924433 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864bc85-1dc8-4b16-aa70-1a7d5a417232 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:42.924726 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864bc85-1dc8-4b16-aa70-1a7d5a417232 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:42.925572 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a864bc85-1dc8-4b16-aa70-1a7d5a417232 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:42.925884 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a864bc85-1dc8-4b16-aa70-1a7d5a417232 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:42.927332 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a864bc85-1dc8-4b16-aa70-1a7d5a417232 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:42.941076 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 117/230] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jun 20 05:57:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:42.945386 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864bc85-1dc8-4b16-aa70-1a7d5a417232 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:42.955660 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302eb200-99ce-4e5e-9b04-ef9f27307739 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:42.997210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d6e7a2-bbc3-41eb-9ed4-09d8e8aa8df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:42.998567 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6e7a2-bbc3-41eb-9ed4-09d8e8aa8df2 None admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:42.999093 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6e7a2-bbc3-41eb-9ed4-09d8e8aa8df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:42.999560 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6e7a2-bbc3-41eb-9ed4-09d8e8aa8df2 None admin] PATH_INFO: `/v3/projects/b5e41057319e4800939cb6fcbdcd1024/users/c5009dd5fc444faeb4a1974029f0fed9/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:43.001920 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d6e7a2-bbc3-41eb-9ed4-09d8e8aa8df2 None admin] RBAC: Authorizing `identity:create_grant(project_id=b5e41057319e4800939cb6fcbdcd1024, user_id=c5009dd5fc444faeb4a1974029f0fed9, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:43.003699 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d6e7a2-bbc3-41eb-9ed4-09d8e8aa8df2 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:43.021081 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 114/231] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jun 20 05:57:42 2022] PUT /identity/v3/projects/b5e41057319e4800939cb6fcbdcd1024/users/c5009dd5fc444faeb4a1974029f0fed9/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 05:57:43.088287 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864bc85-1dc8-4b16-aa70-1a7d5a417232 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:43.103198 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:43.130872 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff259329-4651-49c3-add9-27bf20b59885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:43.132341 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff259329-4651-49c3-add9-27bf20b59885 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:43.132875 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff259329-4651-49c3-add9-27bf20b59885 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:43.133384 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff259329-4651-49c3-add9-27bf20b59885 None admin] PATH_INFO: `/v3/users/c5009dd5fc444faeb4a1974029f0fed9` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:43.134815 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff259329-4651-49c3-add9-27bf20b59885 None admin] RBAC: Authorizing `identity:get_user(user_id=c5009dd5fc444faeb4a1974029f0fed9)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:43.136467 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff259329-4651-49c3-add9-27bf20b59885 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:43.138419 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 118/232] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:42 2022] GET /identity/v3/users/c5009dd5fc444faeb4a1974029f0fed9 => generated 283 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:43.145980 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d6e7a2-bbc3-41eb-9ed4-09d8e8aa8df2 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:43.160936 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:43.263256 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d6e7a2-bbc3-41eb-9ed4-09d8e8aa8df2 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:43.300108 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f90cb-cddc-48f5-9f61-9117d1bde733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:43.301108 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f90cb-cddc-48f5-9f61-9117d1bde733 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:43.301441 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f90cb-cddc-48f5-9f61-9117d1bde733 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:43.301724 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f90cb-cddc-48f5-9f61-9117d1bde733 None admin] PATH_INFO: `/v3/projects/b5e41057319e4800939cb6fcbdcd1024` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:43.303147 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3f90cb-cddc-48f5-9f61-9117d1bde733 None admin] RBAC: Authorizing `identity:get_project(project_id=b5e41057319e4800939cb6fcbdcd1024)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:43.304659 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3f90cb-cddc-48f5-9f61-9117d1bde733 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:43.306967 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 115/233] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:43 2022] GET /identity/v3/projects/b5e41057319e4800939cb6fcbdcd1024 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:43.314585 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff259329-4651-49c3-add9-27bf20b59885 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:43.436139 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff259329-4651-49c3-add9-27bf20b59885 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:43.473247 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a292169b-6c3a-4d32-8a16-37177870b15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:43.474148 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292169b-6c3a-4d32-8a16-37177870b15b None admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:43.474434 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292169b-6c3a-4d32-8a16-37177870b15b None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:43.474716 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292169b-6c3a-4d32-8a16-37177870b15b None admin] PATH_INFO: `/v3/projects/b5e41057319e4800939cb6fcbdcd1024/users/c5009dd5fc444faeb4a1974029f0fed9/roles/844adf3fdfaf458faa6fcbcf641d4182` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:43.478057 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a292169b-6c3a-4d32-8a16-37177870b15b None admin] RBAC: Authorizing `identity:create_grant(project_id=b5e41057319e4800939cb6fcbdcd1024, user_id=c5009dd5fc444faeb4a1974029f0fed9, role_id=844adf3fdfaf458faa6fcbcf641d4182)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:43.479514 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a292169b-6c3a-4d32-8a16-37177870b15b None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:43.502909 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 119/234] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jun 20 05:57:43 2022] PUT /identity/v3/projects/b5e41057319e4800939cb6fcbdcd1024/users/c5009dd5fc444faeb4a1974029f0fed9/roles/844adf3fdfaf458faa6fcbcf641d4182 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:57:44.016958 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad1df3-c355-41f5-9583-c976d2a9a514 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:44.017244 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad1df3-c355-41f5-9583-c976d2a9a514 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:44.017770 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad1df3-c355-41f5-9583-c976d2a9a514 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:44.019594 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 116/235] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:57:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:44.034783 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d79642-8612-4584-8437-682407820e70 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:44.035062 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d79642-8612-4584-8437-682407820e70 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:44.035492 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d79642-8612-4584-8437-682407820e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:44.061656 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-35d79642-8612-4584-8437-682407820e70 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:44.063057 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-35d79642-8612-4584-8437-682407820e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:44.101762 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:44.155465 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 120/236] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:44.189082 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ad1df3-c355-41f5-9583-c976d2a9a514 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:44.293827 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92712e5c-e88f-47b9-af2c-429269e9ecec None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:44.294181 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92712e5c-e88f-47b9-af2c-429269e9ecec None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:44.294284 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92712e5c-e88f-47b9-af2c-429269e9ecec None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:44.295661 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 121/237] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:44.300762 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46326001-649f-4e24-93fc-3fd2ab0e4590 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:44.301056 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46326001-649f-4e24-93fc-3fd2ab0e4590 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:44.301336 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46326001-649f-4e24-93fc-3fd2ab0e4590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:44.312090 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:44.342980 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ad1df3-c355-41f5-9583-c976d2a9a514 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:44.344481 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-46326001-649f-4e24-93fc-3fd2ab0e4590 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:44.345690 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-46326001-649f-4e24-93fc-3fd2ab0e4590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:44.383508 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a327de6f-ec45-471e-a6de-9e3832de3691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:44.385194 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327de6f-ec45-471e-a6de-9e3832de3691 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:44.385952 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327de6f-ec45-471e-a6de-9e3832de3691 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:44.386449 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327de6f-ec45-471e-a6de-9e3832de3691 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:44.401471 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a327de6f-ec45-471e-a6de-9e3832de3691 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:44.410684 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-a327de6f-ec45-471e-a6de-9e3832de3691 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:57:44.410684 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:44.410684 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:44.410684 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:44.410684 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:44.410684 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:44.410684 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:44.410684 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:44.410684 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:44.410684 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:44.410684 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:44.410684 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:44.410684 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:44.410684 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:44.410684 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:44.410684 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:44.411547 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:44.411547 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:44.411547 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:44.411547 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:44.411547 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:44.411547 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:44.411547 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:44.411547 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:44.411547 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:44.411547 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:44.411547 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:44.411547 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:44.411547 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:44.411547 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:44.411547 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:44.411547 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:44.412391 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:44.412391 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:44.412391 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:44.412391 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:44.412391 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:44.412391 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:44.412391 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:44.412391 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:44.412391 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:44.412391 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:44.412391 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:57:44.412391 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:57:44.414745 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 117/238] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:44.420826 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a327de6f-ec45-471e-a6de-9e3832de3691 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:44.526371 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 122/239] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:44.543512 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a327de6f-ec45-471e-a6de-9e3832de3691 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:44.563422 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46326001-649f-4e24-93fc-3fd2ab0e4590 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:44.589248 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc03344-c320-4876-bc46-345e6a018634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:44.590297 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc03344-c320-4876-bc46-345e6a018634 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:44.590805 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc03344-c320-4876-bc46-345e6a018634 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:44.591286 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc03344-c320-4876-bc46-345e6a018634 None admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:44.592298 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc03344-c320-4876-bc46-345e6a018634 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:44.594282 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc03344-c320-4876-bc46-345e6a018634 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:44.595870 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc03344-c320-4876-bc46-345e6a018634 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:44.613822 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:44.622968 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 118/240] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jun 20 05:57:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:44.628561 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc03344-c320-4876-bc46-345e6a018634 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:44.751484 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc03344-c320-4876-bc46-345e6a018634 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:44.791251 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8653512-0095-4a92-b42a-2d874d4960a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:44.793031 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8653512-0095-4a92-b42a-2d874d4960a3 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:44.793516 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8653512-0095-4a92-b42a-2d874d4960a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:44.794124 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8653512-0095-4a92-b42a-2d874d4960a3 None admin] PATH_INFO: `/v3/users/52696e1ed0d44564bbf0373ade3a3c9c` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:44.810358 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:44.812296 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8653512-0095-4a92-b42a-2d874d4960a3 None admin] RBAC: Authorizing `identity:get_user(user_id=52696e1ed0d44564bbf0373ade3a3c9c)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:44.814815 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8653512-0095-4a92-b42a-2d874d4960a3 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:44.817659 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 119/241] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:44 2022] GET /identity/v3/users/52696e1ed0d44564bbf0373ade3a3c9c => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:44.819092 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46326001-649f-4e24-93fc-3fd2ab0e4590 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:44.823685 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8653512-0095-4a92-b42a-2d874d4960a3 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:44.891535 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:44.917416 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f4d06d-956b-4c1d-987c-2101ddbf9e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:44.918237 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4d06d-956b-4c1d-987c-2101ddbf9e6e None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:44.918528 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4d06d-956b-4c1d-987c-2101ddbf9e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:44.918814 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4d06d-956b-4c1d-987c-2101ddbf9e6e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:44.920036 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f4d06d-956b-4c1d-987c-2101ddbf9e6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:44.921528 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f4d06d-956b-4c1d-987c-2101ddbf9e6e None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:44.923486 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 123/242] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:57:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:44.928962 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f4d06d-956b-4c1d-987c-2101ddbf9e6e None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:44.944449 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8653512-0095-4a92-b42a-2d874d4960a3 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:44.988950 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba068d-e27b-4570-9455-0ececdad95da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:44.990005 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba068d-e27b-4570-9455-0ececdad95da None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:44.990882 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba068d-e27b-4570-9455-0ececdad95da None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:44.991584 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba068d-e27b-4570-9455-0ececdad95da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:45.076558 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feba068d-e27b-4570-9455-0ececdad95da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:45.078662 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feba068d-e27b-4570-9455-0ececdad95da None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:45.152362 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:45.207994 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 120/243] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 05:57:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 20 05:57:45.213737 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba068d-e27b-4570-9455-0ececdad95da None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:45.223113 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f4d06d-956b-4c1d-987c-2101ddbf9e6e None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:45.318348 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd90be-8bea-4b6c-98ad-94aa99328b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:45.319357 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd90be-8bea-4b6c-98ad-94aa99328b47 None admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:45.319357 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd90be-8bea-4b6c-98ad-94aa99328b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:45.319653 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd90be-8bea-4b6c-98ad-94aa99328b47 None admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:45.320391 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dd90be-8bea-4b6c-98ad-94aa99328b47 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:45.321882 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dd90be-8bea-4b6c-98ad-94aa99328b47 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:45.341259 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba068d-e27b-4570-9455-0ececdad95da None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:45.349080 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 124/244] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Jun 20 05:57:44 2022] POST /identity/v3/users => generated 293 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 05:57:45.350869 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffac945-0245-41f9-b257-f2f20660c70b None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:45.351616 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffac945-0245-41f9-b257-f2f20660c70b None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:45.351616 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffac945-0245-41f9-b257-f2f20660c70b None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:45.361235 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 125/245] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:57:45 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:45.369072 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc701a2-88c9-49de-a64c-af15c734c7ff None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:45.369405 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc701a2-88c9-49de-a64c-af15c734c7ff None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:45.369685 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc701a2-88c9-49de-a64c-af15c734c7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:45.387070 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476bc41f-35d7-4c2c-a8cb-468988421ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:45.389019 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476bc41f-35d7-4c2c-a8cb-468988421ccd None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:45.389524 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476bc41f-35d7-4c2c-a8cb-468988421ccd None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:45.390003 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476bc41f-35d7-4c2c-a8cb-468988421ccd None admin] PATH_INFO: `/v3/projects/b5e41057319e4800939cb6fcbdcd1024` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:45.391688 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476bc41f-35d7-4c2c-a8cb-468988421ccd None admin] RBAC: Authorizing `identity:get_project(project_id=b5e41057319e4800939cb6fcbdcd1024)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:45.393775 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476bc41f-35d7-4c2c-a8cb-468988421ccd None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:45.396318 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 121/246] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:45 2022] GET /identity/v3/projects/b5e41057319e4800939cb6fcbdcd1024 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:45.400309 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-6fc701a2-88c9-49de-a64c-af15c734c7ff None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:45.401951 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-6fc701a2-88c9-49de-a64c-af15c734c7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:45.404956 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476bc41f-35d7-4c2c-a8cb-468988421ccd None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:45.454913 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:45.462945 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:45.562082 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476bc41f-35d7-4c2c-a8cb-468988421ccd None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:45.592940 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 126/247] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:57:45.624436 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7eed5-881e-4ba1-9807-c931924617f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:45.625245 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7eed5-881e-4ba1-9807-c931924617f0 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:45.625527 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7eed5-881e-4ba1-9807-c931924617f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:45.625912 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7eed5-881e-4ba1-9807-c931924617f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:45.627035 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc701a2-88c9-49de-a64c-af15c734c7ff None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:45.630857 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d7eed5-881e-4ba1-9807-c931924617f0 None admin] RBAC: Adding query filter params (role.id=2c6f4a5c6a944218bdf2bc9684eea581, scope.project.id=b5e41057319e4800939cb6fcbdcd1024, user.id=52696e1ed0d44564bbf0373ade3a3c9c) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:45.632528 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d7eed5-881e-4ba1-9807-c931924617f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:45.634359 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d7eed5-881e-4ba1-9807-c931924617f0 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:45.648847 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 122/248] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jun 20 05:57:45 2022] GET /identity/v3/role_assignments?user.id=52696e1ed0d44564bbf0373ade3a3c9c&scope.project.id=b5e41057319e4800939cb6fcbdcd1024&role.id=2c6f4a5c6a944218bdf2bc9684eea581 => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:45.748356 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41c897-5d85-4fe0-a1c2-6ce2525faf28 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:45.748676 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41c897-5d85-4fe0-a1c2-6ce2525faf28 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:45.748984 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41c897-5d85-4fe0-a1c2-6ce2525faf28 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:45.750694 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 123/249] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:57:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:45.755648 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc701a2-88c9-49de-a64c-af15c734c7ff None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:45.756168 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d53237-224c-4dc5-bf18-daf9ccd0372e None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:45.756481 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d53237-224c-4dc5-bf18-daf9ccd0372e None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:45.756772 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d53237-224c-4dc5-bf18-daf9ccd0372e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:45.778618 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-b4d53237-224c-4dc5-bf18-daf9ccd0372e None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:45.780154 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-b4d53237-224c-4dc5-bf18-daf9ccd0372e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:45.803702 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d17d37-6005-4883-b082-3f3530a1cd84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:45.804657 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d17d37-6005-4883-b082-3f3530a1cd84 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:45.804969 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d17d37-6005-4883-b082-3f3530a1cd84 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:45.805252 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d17d37-6005-4883-b082-3f3530a1cd84 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:45.824738 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d17d37-6005-4883-b082-3f3530a1cd84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:45.833310 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-f6d17d37-6005-4883-b082-3f3530a1cd84 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:57:45.833310 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:45.833310 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:45.833310 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:45.833310 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:45.833310 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:45.833310 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:45.833310 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:45.833310 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:45.833310 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:45.833310 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:45.833310 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:45.833310 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:45.833310 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:45.833310 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:45.833310 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:45.834330 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:45.834330 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:45.834330 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:45.834330 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:45.834330 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:45.834330 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:45.834330 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:45.834330 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:45.834330 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:45.834330 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:45.834330 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:45.834330 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:45.834330 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:45.834330 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:45.834330 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:45.834330 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:45.835125 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:45.835125 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:45.835125 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:45.835125 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:45.835125 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:45.835125 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:45.835125 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:45.835125 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:45.835125 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:45.835125 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:45.835125 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:57:45.835125 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:57:45.835125 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 127/250] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:57:45.841723 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d17d37-6005-4883-b082-3f3530a1cd84 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:45.861874 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:45.889910 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 124/251] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:57:45.915971 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d53237-224c-4dc5-bf18-daf9ccd0372e None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:45.946763 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:45.978111 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d17d37-6005-4883-b082-3f3530a1cd84 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:46.025555 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25a796-05d7-4b3c-91fb-66172dffac90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:46.027670 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25a796-05d7-4b3c-91fb-66172dffac90 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:46.028455 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25a796-05d7-4b3c-91fb-66172dffac90 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:46.029251 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25a796-05d7-4b3c-91fb-66172dffac90 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:46.031096 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb25a796-05d7-4b3c-91fb-66172dffac90 None admin] RBAC: Adding query filter params (name=member) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:46.032248 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb25a796-05d7-4b3c-91fb-66172dffac90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:46.034413 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb25a796-05d7-4b3c-91fb-66172dffac90 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:46.044468 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d53237-224c-4dc5-bf18-daf9ccd0372e None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:46.049916 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 128/252] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jun 20 05:57:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:46.058960 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25a796-05d7-4b3c-91fb-66172dffac90 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:46.098654 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbbc866-bc6b-4f6d-bb3d-f348425de1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:46.100266 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbbc866-bc6b-4f6d-bb3d-f348425de1fd None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:46.100776 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbbc866-bc6b-4f6d-bb3d-f348425de1fd None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:46.101253 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbbc866-bc6b-4f6d-bb3d-f348425de1fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:46.118983 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbbc866-bc6b-4f6d-bb3d-f348425de1fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:46.127829 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-fbbbc866-bc6b-4f6d-bb3d-f348425de1fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:57:46.127829 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:46.127829 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:46.127829 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:46.127829 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:46.127829 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:46.127829 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:46.127829 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:46.127829 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:46.127829 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:46.127829 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:46.127829 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:46.127829 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:46.127829 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:46.127829 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:46.127829 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:46.128731 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:46.128731 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:46.128731 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:46.128731 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:46.128731 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:46.128731 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:46.128731 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:46.128731 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:46.128731 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:46.128731 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:46.128731 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:46.128731 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:46.128731 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:46.128731 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:46.128731 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:46.128731 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:46.129542 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:46.129542 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:46.129542 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:46.129542 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:46.129542 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:46.129542 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:46.129542 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:46.129542 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:46.129542 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:46.129542 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:46.129542 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:57:46.129542 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:57:46.135822 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 125/253] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jun 20 05:57:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:46.148271 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:46.150191 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbbc866-bc6b-4f6d-bb3d-f348425de1fd None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:46.176220 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25a796-05d7-4b3c-91fb-66172dffac90 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:46.213131 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f323b-f996-445a-8f74-d15bdb7039e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:46.214073 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f323b-f996-445a-8f74-d15bdb7039e2 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:46.214391 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f323b-f996-445a-8f74-d15bdb7039e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:46.214641 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f323b-f996-445a-8f74-d15bdb7039e2 None admin] PATH_INFO: `/v3/users/941c3a240a6b4eb889fd9d7045f52588` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:46.215877 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f323b-f996-445a-8f74-d15bdb7039e2 None admin] RBAC: Authorizing `identity:get_user(user_id=941c3a240a6b4eb889fd9d7045f52588)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:46.218033 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f323b-f996-445a-8f74-d15bdb7039e2 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:46.220812 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 129/254] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:46 2022] GET /identity/v3/users/941c3a240a6b4eb889fd9d7045f52588 => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:46.220812 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7e577-5a02-4776-b4f3-7d7cd7a6bc1e None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:46.220812 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7e577-5a02-4776-b4f3-7d7cd7a6bc1e None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:46.221041 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7e577-5a02-4776-b4f3-7d7cd7a6bc1e None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:46.222433 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 130/255] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:57:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:46.232769 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89573e49-6740-4e02-a8c1-27229823bdd6 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:46.232769 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89573e49-6740-4e02-a8c1-27229823bdd6 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:46.232769 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89573e49-6740-4e02-a8c1-27229823bdd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:46.258772 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-89573e49-6740-4e02-a8c1-27229823bdd6 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:46.259986 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-89573e49-6740-4e02-a8c1-27229823bdd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:46.317496 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:46.331397 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbbc866-bc6b-4f6d-bb3d-f348425de1fd None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:46.368970 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d385b-883b-4c15-8a16-6db277b642b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:46.369716 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d385b-883b-4c15-8a16-6db277b642b6 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:46.369946 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d385b-883b-4c15-8a16-6db277b642b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:46.370227 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d385b-883b-4c15-8a16-6db277b642b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:46.370994 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335d385b-883b-4c15-8a16-6db277b642b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:46.371302 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335d385b-883b-4c15-8a16-6db277b642b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:46.372729 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335d385b-883b-4c15-8a16-6db277b642b6 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:46.383622 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 126/256] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:46.384468 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d385b-883b-4c15-8a16-6db277b642b6 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:46.438878 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 131/257] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:57:46.439556 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89573e49-6740-4e02-a8c1-27229823bdd6 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:46.540666 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:46.568727 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d385b-883b-4c15-8a16-6db277b642b6 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:46.573614 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89573e49-6740-4e02-a8c1-27229823bdd6 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:46.610916 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a301019-8c2f-4cbd-917a-58fb05518557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:46.611872 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a301019-8c2f-4cbd-917a-58fb05518557 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:46.612157 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a301019-8c2f-4cbd-917a-58fb05518557 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:46.612432 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a301019-8c2f-4cbd-917a-58fb05518557 None admin] PATH_INFO: `/v3/users/c5009dd5fc444faeb4a1974029f0fed9` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:46.613730 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a301019-8c2f-4cbd-917a-58fb05518557 None admin] RBAC: Authorizing `identity:get_user(user_id=c5009dd5fc444faeb4a1974029f0fed9)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:46.615190 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a301019-8c2f-4cbd-917a-58fb05518557 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:46.617964 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 132/258] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:46 2022] GET /identity/v3/users/c5009dd5fc444faeb4a1974029f0fed9 => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:46.618078 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167bae03-70a0-4041-a8f9-aacbd6988c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:46.618789 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a301019-8c2f-4cbd-917a-58fb05518557 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:46.618965 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167bae03-70a0-4041-a8f9-aacbd6988c1e None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:46.619113 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167bae03-70a0-4041-a8f9-aacbd6988c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:46.619362 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167bae03-70a0-4041-a8f9-aacbd6988c1e None admin] PATH_INFO: `/v3/projects/b5e41057319e4800939cb6fcbdcd1024` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:46.624429 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167bae03-70a0-4041-a8f9-aacbd6988c1e None admin] RBAC: Authorizing `identity:get_project(project_id=b5e41057319e4800939cb6fcbdcd1024)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:46.625865 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167bae03-70a0-4041-a8f9-aacbd6988c1e None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:46.627608 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 127/259] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:46 2022] GET /identity/v3/projects/b5e41057319e4800939cb6fcbdcd1024 => generated 302 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:46.628369 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167bae03-70a0-4041-a8f9-aacbd6988c1e None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:46.653465 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:46.730885 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a301019-8c2f-4cbd-917a-58fb05518557 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:46.767596 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302d193-763a-48e4-934a-a83bc13bbccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:46.768415 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302d193-763a-48e4-934a-a83bc13bbccd None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:46.768712 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302d193-763a-48e4-934a-a83bc13bbccd None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:46.769007 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302d193-763a-48e4-934a-a83bc13bbccd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:46.777930 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:46.781675 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e302d193-763a-48e4-934a-a83bc13bbccd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:46.790864 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-e302d193-763a-48e4-934a-a83bc13bbccd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:57:46.790864 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:46.790864 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:46.790864 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:46.790864 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:46.790864 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:46.790864 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:46.790864 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:46.790864 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:46.790864 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:46.790864 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:46.790864 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:46.790864 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:46.790864 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:46.790864 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:46.790864 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:46.793267 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:46.793267 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:46.793267 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:46.793267 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:46.793267 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:46.793267 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:46.793267 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:46.793267 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:46.793267 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:46.793267 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:46.793267 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:46.793267 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:46.793267 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:46.793267 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:46.793267 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:46.793267 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:46.795258 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:46.795258 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:46.795258 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:46.795258 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:46.795258 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:46.795258 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:46.795258 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:46.795258 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:46.795258 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:46.795258 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:46.795258 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:57:46.795258 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:57:46.795258 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 133/260] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jun 20 05:57:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:46.801007 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302d193-763a-48e4-934a-a83bc13bbccd None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:46.822385 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167bae03-70a0-4041-a8f9-aacbd6988c1e None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:46.913507 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c80e40-d7d1-42e5-a5c4-af235ddb0000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:46.914494 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c80e40-d7d1-42e5-a5c4-af235ddb0000 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:46.914979 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c80e40-d7d1-42e5-a5c4-af235ddb0000 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:46.915474 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c80e40-d7d1-42e5-a5c4-af235ddb0000 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:46.926100 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302d193-763a-48e4-934a-a83bc13bbccd None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:46.963431 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac3f27-74c4-4a35-808a-8605128637f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:46.964369 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac3f27-74c4-4a35-808a-8605128637f8 None admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:46.964656 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac3f27-74c4-4a35-808a-8605128637f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:46.964955 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac3f27-74c4-4a35-808a-8605128637f8 None admin] PATH_INFO: `/v3/projects/b5e41057319e4800939cb6fcbdcd1024/users/941c3a240a6b4eb889fd9d7045f52588/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:46.966952 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ac3f27-74c4-4a35-808a-8605128637f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=b5e41057319e4800939cb6fcbdcd1024, user_id=941c3a240a6b4eb889fd9d7045f52588, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:46.968469 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ac3f27-74c4-4a35-808a-8605128637f8 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:46.992908 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 134/261] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jun 20 05:57:46 2022] PUT /identity/v3/projects/b5e41057319e4800939cb6fcbdcd1024/users/941c3a240a6b4eb889fd9d7045f52588/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:57:46.993740 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac3f27-74c4-4a35-808a-8605128637f8 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:47.087722 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c80e40-d7d1-42e5-a5c4-af235ddb0000 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:47.089265 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c80e40-d7d1-42e5-a5c4-af235ddb0000 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:47.112022 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:47.113446 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:47.168827 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac3f27-74c4-4a35-808a-8605128637f8 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:47.214775 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb6564-8cbe-4082-a201-ed0b2c5eddd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:47.215979 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb6564-8cbe-4082-a201-ed0b2c5eddd5 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:47.216440 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb6564-8cbe-4082-a201-ed0b2c5eddd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:47.216886 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb6564-8cbe-4082-a201-ed0b2c5eddd5 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:47.217860 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eb6564-8cbe-4082-a201-ed0b2c5eddd5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:47.218838 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eb6564-8cbe-4082-a201-ed0b2c5eddd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:47.220446 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eb6564-8cbe-4082-a201-ed0b2c5eddd5 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:47.231793 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 135/262] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jun 20 05:57:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:47.238223 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb6564-8cbe-4082-a201-ed0b2c5eddd5 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:47.347305 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 128/263] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 05:57:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 719 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:57:47.359640 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c80e40-d7d1-42e5-a5c4-af235ddb0000 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:47.376382 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb6564-8cbe-4082-a201-ed0b2c5eddd5 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:47.410054 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:47.426168 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc79f6-edca-4607-bd67-71facc408493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:47.427784 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc79f6-edca-4607-bd67-71facc408493 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:47.429032 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc79f6-edca-4607-bd67-71facc408493 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:47.429458 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc79f6-edca-4607-bd67-71facc408493 None admin] PATH_INFO: `/v3/users/c5009dd5fc444faeb4a1974029f0fed9` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:47.431371 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bc79f6-edca-4607-bd67-71facc408493 None admin] RBAC: Authorizing `identity:get_user(user_id=c5009dd5fc444faeb4a1974029f0fed9)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:47.433439 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bc79f6-edca-4607-bd67-71facc408493 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:47.436146 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 136/264] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:47 2022] GET /identity/v3/users/c5009dd5fc444faeb4a1974029f0fed9 => generated 283 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:47.441613 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc79f6-edca-4607-bd67-71facc408493 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:47.490943 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c80e40-d7d1-42e5-a5c4-af235ddb0000 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:47.505213 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:47.537913 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63045254-cf06-496f-a3c0-df772abe630e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:47.539488 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63045254-cf06-496f-a3c0-df772abe630e None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:47.539878 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63045254-cf06-496f-a3c0-df772abe630e None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:47.540261 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63045254-cf06-496f-a3c0-df772abe630e None admin] PATH_INFO: `/v3/projects/b5e41057319e4800939cb6fcbdcd1024` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:47.542173 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63045254-cf06-496f-a3c0-df772abe630e None admin] RBAC: Authorizing `identity:get_project(project_id=b5e41057319e4800939cb6fcbdcd1024)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:47.543990 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63045254-cf06-496f-a3c0-df772abe630e None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:47.548742 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 129/265] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:47 2022] GET /identity/v3/projects/b5e41057319e4800939cb6fcbdcd1024 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:47.557928 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63045254-cf06-496f-a3c0-df772abe630e None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:47.570376 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc79f6-edca-4607-bd67-71facc408493 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:47.610194 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1cdcb2-d85d-47d2-af15-92241888a9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:47.610850 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1cdcb2-d85d-47d2-af15-92241888a9eb None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:47.611128 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1cdcb2-d85d-47d2-af15-92241888a9eb None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:47.611399 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1cdcb2-d85d-47d2-af15-92241888a9eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:47.708262 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:47.721971 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1cdcb2-d85d-47d2-af15-92241888a9eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:47.723833 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1cdcb2-d85d-47d2-af15-92241888a9eb None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:47.767514 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63045254-cf06-496f-a3c0-df772abe630e None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:47.833295 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 137/266] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 05:57:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:57:47.840425 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1cdcb2-d85d-47d2-af15-92241888a9eb None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:47.856132 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af71e11-90dc-4fe2-b59a-cb4ce4a33688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:47.857158 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af71e11-90dc-4fe2-b59a-cb4ce4a33688 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:47.857654 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af71e11-90dc-4fe2-b59a-cb4ce4a33688 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:47.858201 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af71e11-90dc-4fe2-b59a-cb4ce4a33688 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:47.859239 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af71e11-90dc-4fe2-b59a-cb4ce4a33688 None admin] RBAC: Adding query filter params (role.id=5a64bd8372704de98e75436ff69e46b3, scope.project.id=b5e41057319e4800939cb6fcbdcd1024, user.id=c5009dd5fc444faeb4a1974029f0fed9) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:47.859754 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af71e11-90dc-4fe2-b59a-cb4ce4a33688 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:47.861499 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af71e11-90dc-4fe2-b59a-cb4ce4a33688 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:47.875267 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 130/267] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jun 20 05:57:47 2022] GET /identity/v3/role_assignments?user.id=c5009dd5fc444faeb4a1974029f0fed9&scope.project.id=b5e41057319e4800939cb6fcbdcd1024&role.id=5a64bd8372704de98e75436ff69e46b3 => generated 608 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:47.972002 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:47.984801 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1cdcb2-d85d-47d2-af15-92241888a9eb None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:48.028491 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f81e77-9282-4d9f-b613-723a8ca44f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:48.029810 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f81e77-9282-4d9f-b613-723a8ca44f1a None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:48.030289 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f81e77-9282-4d9f-b613-723a8ca44f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:48.030773 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f81e77-9282-4d9f-b613-723a8ca44f1a None admin] PATH_INFO: `/v3/projects/b5e41057319e4800939cb6fcbdcd1024` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:48.032276 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f81e77-9282-4d9f-b613-723a8ca44f1a None admin] RBAC: Authorizing `identity:get_project(project_id=b5e41057319e4800939cb6fcbdcd1024)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:48.034030 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f81e77-9282-4d9f-b613-723a8ca44f1a None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:48.036082 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 138/268] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:47 2022] GET /identity/v3/projects/b5e41057319e4800939cb6fcbdcd1024 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:48.043046 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af71e11-90dc-4fe2-b59a-cb4ce4a33688 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:48.099632 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:48.182233 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af71e11-90dc-4fe2-b59a-cb4ce4a33688 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:48.230130 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f0fff-842a-465a-8901-39d80b53ec7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:48.230714 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f0fff-842a-465a-8901-39d80b53ec7c None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:48.230996 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f0fff-842a-465a-8901-39d80b53ec7c None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:48.231279 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f0fff-842a-465a-8901-39d80b53ec7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:48.232117 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0f0fff-842a-465a-8901-39d80b53ec7c None admin] RBAC: Adding query filter params (role.id=844adf3fdfaf458faa6fcbcf641d4182, scope.project.id=b5e41057319e4800939cb6fcbdcd1024, user.id=c5009dd5fc444faeb4a1974029f0fed9) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:48.232433 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0f0fff-842a-465a-8901-39d80b53ec7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:48.233908 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0f0fff-842a-465a-8901-39d80b53ec7c None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:48.241878 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 131/269] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jun 20 05:57:48 2022] GET /identity/v3/role_assignments?user.id=c5009dd5fc444faeb4a1974029f0fed9&scope.project.id=b5e41057319e4800939cb6fcbdcd1024&role.id=844adf3fdfaf458faa6fcbcf641d4182 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:48.497382 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4888f8c2-18c9-4bc3-acb8-eb7ebeca8b53 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:48.498325 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4888f8c2-18c9-4bc3-acb8-eb7ebeca8b53 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:48.498834 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4888f8c2-18c9-4bc3-acb8-eb7ebeca8b53 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:48.500451 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 139/270] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:57:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:48.513495 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fae237-b900-4e32-8d14-dca8484d4f62 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:48.514011 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fae237-b900-4e32-8d14-dca8484d4f62 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:48.514086 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fae237-b900-4e32-8d14-dca8484d4f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:48.536325 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-47fae237-b900-4e32-8d14-dca8484d4f62 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:48.537645 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-47fae237-b900-4e32-8d14-dca8484d4f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:48.628756 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 132/271] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:48.641308 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bdef79-de28-48db-a47b-da7b9b02074b None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:48.641914 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bdef79-de28-48db-a47b-da7b9b02074b None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:48.642399 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bdef79-de28-48db-a47b-da7b9b02074b None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:48.643985 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 140/272] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:57:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:48.649903 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab58fd6-2451-425c-8833-407473708074 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:48.650197 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab58fd6-2451-425c-8833-407473708074 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:48.650478 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab58fd6-2451-425c-8833-407473708074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:48.656273 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bdef79-de28-48db-a47b-da7b9b02074b None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:48.670078 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-eab58fd6-2451-425c-8833-407473708074 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:48.671268 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-eab58fd6-2451-425c-8833-407473708074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:48.706840 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:48.749764 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 133/273] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:48.751025 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f63ce-9637-4a4a-9c1a-5e44068deb3b None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:48.751314 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f63ce-9637-4a4a-9c1a-5e44068deb3b None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:48.751589 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f63ce-9637-4a4a-9c1a-5e44068deb3b None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:48.752895 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 134/274] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:48.759029 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab2e76-1475-4d36-8b10-9846a59f49f0 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:48.759312 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab2e76-1475-4d36-8b10-9846a59f49f0 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:48.759586 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab2e76-1475-4d36-8b10-9846a59f49f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:48.777420 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-51ab2e76-1475-4d36-8b10-9846a59f49f0 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:48.778635 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-51ab2e76-1475-4d36-8b10-9846a59f49f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:48.798109 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bdef79-de28-48db-a47b-da7b9b02074b None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:48.836172 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03bc65e-4d6f-44ab-8177-6fae8d224590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:48.837031 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03bc65e-4d6f-44ab-8177-6fae8d224590 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:48.837334 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03bc65e-4d6f-44ab-8177-6fae8d224590 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:48.837587 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03bc65e-4d6f-44ab-8177-6fae8d224590 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:48.848450 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03bc65e-4d6f-44ab-8177-6fae8d224590 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:48.854625 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 135/275] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:57:48.856491 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-f03bc65e-4d6f-44ab-8177-6fae8d224590 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:57:48.856491 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:48.856491 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:48.856491 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:48.856491 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:48.856491 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:48.856491 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:48.856491 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:48.856491 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:48.856491 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:48.856491 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:48.856491 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:48.856491 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:48.856491 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:48.856491 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:48.856491 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:48.857410 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:48.857410 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:48.857410 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:48.857410 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:48.857410 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:48.857410 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:48.857410 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:48.857410 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:48.857410 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:48.857410 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:48.857410 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:48.857410 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:48.857410 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:48.857410 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:48.857410 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:48.857410 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:48.858185 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:48.858185 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:48.858185 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:48.858185 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:48.858185 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:48.858185 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:48.858185 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:48.858185 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:48.858185 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:48.858185 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:48.858185 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:57:48.858185 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:57:48.861673 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab2e76-1475-4d36-8b10-9846a59f49f0 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:48.862605 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 141/276] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:57:48.863312 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03bc65e-4d6f-44ab-8177-6fae8d224590 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:48.886141 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:48.973165 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:48.977680 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03bc65e-4d6f-44ab-8177-6fae8d224590 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:48.984067 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab2e76-1475-4d36-8b10-9846a59f49f0 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:49.015607 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94343e-6d05-4625-8ec8-cb31f0a7c969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:49.016359 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94343e-6d05-4625-8ec8-cb31f0a7c969 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:49.016687 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94343e-6d05-4625-8ec8-cb31f0a7c969 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:49.016997 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94343e-6d05-4625-8ec8-cb31f0a7c969 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:49.017742 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a94343e-6d05-4625-8ec8-cb31f0a7c969 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:49.018055 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a94343e-6d05-4625-8ec8-cb31f0a7c969 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:49.019447 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a94343e-6d05-4625-8ec8-cb31f0a7c969 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:49.022727 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025af8d8-9fe8-4da7-a0b8-f9202c58e250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:49.023722 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025af8d8-9fe8-4da7-a0b8-f9202c58e250 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:49.024187 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025af8d8-9fe8-4da7-a0b8-f9202c58e250 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:49.024651 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025af8d8-9fe8-4da7-a0b8-f9202c58e250 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:49.025855 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025af8d8-9fe8-4da7-a0b8-f9202c58e250 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:49.027309 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025af8d8-9fe8-4da7-a0b8-f9202c58e250 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:49.033067 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 142/277] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jun 20 05:57:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:49.033067 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94343e-6d05-4625-8ec8-cb31f0a7c969 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:49.033250 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 136/278] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:57:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:49.033657 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025af8d8-9fe8-4da7-a0b8-f9202c58e250 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:49.122630 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:49.141324 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025af8d8-9fe8-4da7-a0b8-f9202c58e250 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:49.143751 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94343e-6d05-4625-8ec8-cb31f0a7c969 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:49.179088 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c8b82-1ba5-46f3-8866-c3552be69b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:49.179950 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c8b82-1ba5-46f3-8866-c3552be69b3e None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:49.180231 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c8b82-1ba5-46f3-8866-c3552be69b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:49.180502 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c8b82-1ba5-46f3-8866-c3552be69b3e None admin] PATH_INFO: `/v3/users/52696e1ed0d44564bbf0373ade3a3c9c` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:49.180846 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bbeaf6-4b9c-4ddd-a0d7-2f67cf5f388c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:49.181649 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbeaf6-4b9c-4ddd-a0d7-2f67cf5f388c None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:49.181747 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6c8b82-1ba5-46f3-8866-c3552be69b3e None admin] RBAC: Authorizing `identity:get_user(user_id=52696e1ed0d44564bbf0373ade3a3c9c)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:49.181936 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbeaf6-4b9c-4ddd-a0d7-2f67cf5f388c None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:49.182216 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbeaf6-4b9c-4ddd-a0d7-2f67cf5f388c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:49.183137 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6c8b82-1ba5-46f3-8866-c3552be69b3e None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:49.184959 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 137/279] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:49 2022] GET /identity/v3/users/52696e1ed0d44564bbf0373ade3a3c9c => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:49.185584 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c8b82-1ba5-46f3-8866-c3552be69b3e None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:49.197824 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bbeaf6-4b9c-4ddd-a0d7-2f67cf5f388c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:49.205893 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-80bbeaf6-4b9c-4ddd-a0d7-2f67cf5f388c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:57:49.205893 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:49.205893 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:49.205893 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:49.205893 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:49.205893 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:49.205893 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:49.205893 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:49.205893 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:49.205893 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:49.205893 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:49.205893 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:49.205893 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:49.205893 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:49.205893 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:49.205893 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:49.206769 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:49.206769 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:49.206769 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:49.206769 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:49.206769 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:49.206769 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:49.206769 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:49.206769 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:49.206769 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:49.206769 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:49.206769 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:49.206769 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:49.206769 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:49.206769 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:49.206769 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:49.206769 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:49.207559 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:49.207559 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:49.207559 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:49.207559 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:49.207559 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:49.207559 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:49.207559 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:49.207559 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:49.207559 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:49.207559 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:49.207559 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:57:49.207559 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:57:49.207559 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 143/280] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:49.208195 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bbeaf6-4b9c-4ddd-a0d7-2f67cf5f388c None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:49.222463 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:49.314206 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bbeaf6-4b9c-4ddd-a0d7-2f67cf5f388c None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:49.314786 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c8b82-1ba5-46f3-8866-c3552be69b3e None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:49.347704 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79133973-fb38-4a07-93d6-57a1961e3149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:49.348560 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79133973-fb38-4a07-93d6-57a1961e3149 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:49.348876 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79133973-fb38-4a07-93d6-57a1961e3149 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:49.349173 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79133973-fb38-4a07-93d6-57a1961e3149 None admin] PATH_INFO: `/v3/projects/b5e41057319e4800939cb6fcbdcd1024` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:49.350912 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79133973-fb38-4a07-93d6-57a1961e3149 None admin] RBAC: Authorizing `identity:get_project(project_id=b5e41057319e4800939cb6fcbdcd1024)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:49.352354 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79133973-fb38-4a07-93d6-57a1961e3149 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:49.354086 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 144/281] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:49 2022] GET /identity/v3/projects/b5e41057319e4800939cb6fcbdcd1024 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:49.354419 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed777bf-1cc5-4aca-bf9b-2a1b3bbf9497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:49.354845 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79133973-fb38-4a07-93d6-57a1961e3149 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:49.355585 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed777bf-1cc5-4aca-bf9b-2a1b3bbf9497 None admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:49.355868 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed777bf-1cc5-4aca-bf9b-2a1b3bbf9497 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:49.356144 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed777bf-1cc5-4aca-bf9b-2a1b3bbf9497 None admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:49.356878 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed777bf-1cc5-4aca-bf9b-2a1b3bbf9497 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:49.358311 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed777bf-1cc5-4aca-bf9b-2a1b3bbf9497 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:49.369138 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:49.381463 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 138/282] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Jun 20 05:57:49 2022] POST /identity/v3/users => generated 293 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:57:49.393771 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed777bf-1cc5-4aca-bf9b-2a1b3bbf9497 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:49.479868 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79133973-fb38-4a07-93d6-57a1961e3149 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:49.513257 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:49.521141 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bef11d-1042-49c9-a6fb-953821bc1591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:49.522430 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bef11d-1042-49c9-a6fb-953821bc1591 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:49.522738 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bef11d-1042-49c9-a6fb-953821bc1591 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:49.522866 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bef11d-1042-49c9-a6fb-953821bc1591 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:49.523591 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bef11d-1042-49c9-a6fb-953821bc1591 None admin] RBAC: Adding query filter params (name=member) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:49.523902 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bef11d-1042-49c9-a6fb-953821bc1591 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:49.525636 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bef11d-1042-49c9-a6fb-953821bc1591 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:49.532378 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed777bf-1cc5-4aca-bf9b-2a1b3bbf9497 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:49.536332 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 145/283] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jun 20 05:57:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:49.541849 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bef11d-1042-49c9-a6fb-953821bc1591 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:49.570972 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93e8ee-76b2-4a4b-8864-59b4d2eed3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:49.572098 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93e8ee-76b2-4a4b-8864-59b4d2eed3af None admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:49.572540 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93e8ee-76b2-4a4b-8864-59b4d2eed3af None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:49.572859 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93e8ee-76b2-4a4b-8864-59b4d2eed3af None admin] PATH_INFO: `/v3/projects/b5e41057319e4800939cb6fcbdcd1024/users/52696e1ed0d44564bbf0373ade3a3c9c/roles/2c6f4a5c6a944218bdf2bc9684eea581` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:49.575599 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c93e8ee-76b2-4a4b-8864-59b4d2eed3af None admin] RBAC: Authorizing `identity:create_grant(project_id=b5e41057319e4800939cb6fcbdcd1024, user_id=52696e1ed0d44564bbf0373ade3a3c9c, role_id=2c6f4a5c6a944218bdf2bc9684eea581)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:49.577799 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c93e8ee-76b2-4a4b-8864-59b4d2eed3af None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:49.599296 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 139/284] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jun 20 05:57:49 2022] PUT /identity/v3/projects/b5e41057319e4800939cb6fcbdcd1024/users/52696e1ed0d44564bbf0373ade3a3c9c/roles/2c6f4a5c6a944218bdf2bc9684eea581 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:57:49.640923 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:49.672284 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bef11d-1042-49c9-a6fb-953821bc1591 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:49.712310 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6697861-489c-4c7f-a661-dfc5adbb1121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:49.713292 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6697861-489c-4c7f-a661-dfc5adbb1121 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:49.713570 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6697861-489c-4c7f-a661-dfc5adbb1121 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:49.713842 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6697861-489c-4c7f-a661-dfc5adbb1121 None admin] PATH_INFO: `/v3/users/b4f72b1f81c845a79f809302e236f95a` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:49.730544 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6697861-489c-4c7f-a661-dfc5adbb1121 None admin] RBAC: Authorizing `identity:get_user(user_id=b4f72b1f81c845a79f809302e236f95a)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:49.732038 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6697861-489c-4c7f-a661-dfc5adbb1121 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:49.733900 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 146/285] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:49 2022] GET /identity/v3/users/b4f72b1f81c845a79f809302e236f95a => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:49.739941 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93e8ee-76b2-4a4b-8864-59b4d2eed3af None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:49.748446 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785a164-7b6b-41fb-bc49-bca923bee5c1 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:49.748803 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785a164-7b6b-41fb-bc49-bca923bee5c1 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:49.749037 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785a164-7b6b-41fb-bc49-bca923bee5c1 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:49.750738 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 147/286] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:57:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:49.756567 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fcb25e-0311-4e02-9a17-d0a0101afc77 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:49.756916 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fcb25e-0311-4e02-9a17-d0a0101afc77 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:49.757161 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fcb25e-0311-4e02-9a17-d0a0101afc77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:49.775429 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-62fcb25e-0311-4e02-9a17-d0a0101afc77 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:49.776773 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-62fcb25e-0311-4e02-9a17-d0a0101afc77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:49.868097 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 148/287] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:57:49.878917 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93e8ee-76b2-4a4b-8864-59b4d2eed3af None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:49.891584 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fcb25e-0311-4e02-9a17-d0a0101afc77 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:49.926549 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b5de48-a95f-44d7-a6ac-29649846f996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:49.927261 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5de48-a95f-44d7-a6ac-29649846f996 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:49.928101 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5de48-a95f-44d7-a6ac-29649846f996 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:49.929025 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5de48-a95f-44d7-a6ac-29649846f996 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:49.929881 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b5de48-a95f-44d7-a6ac-29649846f996 None admin] RBAC: Adding query filter params (role.id=c34cf84397a64ab0ad2a06daa8e13d88, user.id=b4f72b1f81c845a79f809302e236f95a, scope.system=all) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:49.930196 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b5de48-a95f-44d7-a6ac-29649846f996 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:49.932474 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b5de48-a95f-44d7-a6ac-29649846f996 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:49.947228 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 140/288] 10.222.0.39 () {56 vars in 1308 bytes} [Mon Jun 20 05:57:49 2022] GET /identity/v3/role_assignments?user.id=b4f72b1f81c845a79f809302e236f95a&scope.system=all&role.id=c34cf84397a64ab0ad2a06daa8e13d88 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:49.973168 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:50.027762 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fcb25e-0311-4e02-9a17-d0a0101afc77 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:50.086406 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adf910b-952d-4310-b2e9-9e198718f131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:50.087221 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf910b-952d-4310-b2e9-9e198718f131 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:50.087507 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf910b-952d-4310-b2e9-9e198718f131 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:50.087782 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf910b-952d-4310-b2e9-9e198718f131 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:50.114134 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adf910b-952d-4310-b2e9-9e198718f131 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:50.123096 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-2adf910b-952d-4310-b2e9-9e198718f131 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:57:50.123096 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:50.123096 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:50.123096 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:50.123096 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:50.123096 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:50.123096 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:50.123096 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:50.123096 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:50.123096 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:50.123096 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:50.123096 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:50.123096 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:50.123096 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:50.123096 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:50.123096 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:50.124001 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:50.124001 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:50.124001 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:50.124001 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:50.124001 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:50.124001 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:50.124001 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:50.124001 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:50.124001 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:50.124001 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:50.124001 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:50.124001 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:50.124001 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:50.124001 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:50.124001 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:50.124001 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:50.124815 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:50.124815 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:50.124815 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:50.124815 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:50.124815 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:50.124815 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:50.124815 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:50.124815 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:50.124815 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:50.124815 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:50.124815 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:57:50.124815 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:57:50.129213 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 149/289] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:57:50.135440 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b5de48-a95f-44d7-a6ac-29649846f996 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:50.161088 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:50.263221 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b5de48-a95f-44d7-a6ac-29649846f996 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:50.298476 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e27fc1-ec27-4420-a9f8-db1972edf268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:50.299142 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e27fc1-ec27-4420-a9f8-db1972edf268 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:50.299422 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e27fc1-ec27-4420-a9f8-db1972edf268 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:50.299696 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e27fc1-ec27-4420-a9f8-db1972edf268 None admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:50.300432 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e27fc1-ec27-4420-a9f8-db1972edf268 None admin] RBAC: Adding query filter params (name=member) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:50.300755 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e27fc1-ec27-4420-a9f8-db1972edf268 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:50.302188 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e27fc1-ec27-4420-a9f8-db1972edf268 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:50.311437 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 141/290] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jun 20 05:57:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:50.316729 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adf910b-952d-4310-b2e9-9e198718f131 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:50.420524 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adf910b-952d-4310-b2e9-9e198718f131 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:50.437807 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:50.456938 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5df6f70-c642-4669-8fe6-d215e34fbb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:50.458343 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df6f70-c642-4669-8fe6-d215e34fbb4d None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:50.458343 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df6f70-c642-4669-8fe6-d215e34fbb4d None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:50.458343 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df6f70-c642-4669-8fe6-d215e34fbb4d None admin] PATH_INFO: `/v3/users/941c3a240a6b4eb889fd9d7045f52588` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:50.465530 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5df6f70-c642-4669-8fe6-d215e34fbb4d None admin] RBAC: Authorizing `identity:get_user(user_id=941c3a240a6b4eb889fd9d7045f52588)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:50.466987 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5df6f70-c642-4669-8fe6-d215e34fbb4d None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:50.468649 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 150/291] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:50 2022] GET /identity/v3/users/941c3a240a6b4eb889fd9d7045f52588 => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:50.474069 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e27fc1-ec27-4420-a9f8-db1972edf268 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:50.576772 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:50.608331 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e27fc1-ec27-4420-a9f8-db1972edf268 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:50.644511 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad4d1c1-980d-4c09-bbc9-772c97d89bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:50.645192 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4d1c1-980d-4c09-bbc9-772c97d89bda None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:50.645471 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4d1c1-980d-4c09-bbc9-772c97d89bda None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:50.645742 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4d1c1-980d-4c09-bbc9-772c97d89bda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:50.714957 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad4d1c1-980d-4c09-bbc9-772c97d89bda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:50.716438 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad4d1c1-980d-4c09-bbc9-772c97d89bda None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:50.797095 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:50.818339 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 142/292] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 05:57:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:57:50.823419 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5df6f70-c642-4669-8fe6-d215e34fbb4d None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:51.031127 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5df6f70-c642-4669-8fe6-d215e34fbb4d None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:51.099539 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d7111b-1203-48ee-a5d1-1278d9a08ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:51.100861 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7111b-1203-48ee-a5d1-1278d9a08ea3 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:51.101147 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7111b-1203-48ee-a5d1-1278d9a08ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:51.101424 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7111b-1203-48ee-a5d1-1278d9a08ea3 None admin] PATH_INFO: `/v3/projects/b5e41057319e4800939cb6fcbdcd1024` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:51.102640 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d7111b-1203-48ee-a5d1-1278d9a08ea3 None admin] RBAC: Authorizing `identity:get_project(project_id=b5e41057319e4800939cb6fcbdcd1024)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:51.104098 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d7111b-1203-48ee-a5d1-1278d9a08ea3 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:51.105855 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 151/293] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:50 2022] GET /identity/v3/projects/b5e41057319e4800939cb6fcbdcd1024 => generated 302 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:51.113761 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad4d1c1-980d-4c09-bbc9-772c97d89bda None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:51.285417 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad4d1c1-980d-4c09-bbc9-772c97d89bda None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:51.347362 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29120ae7-7a94-4c6e-97cd-cb01fdf00af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:51.348094 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29120ae7-7a94-4c6e-97cd-cb01fdf00af2 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:51.348381 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29120ae7-7a94-4c6e-97cd-cb01fdf00af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:51.348658 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29120ae7-7a94-4c6e-97cd-cb01fdf00af2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:51.350658 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29120ae7-7a94-4c6e-97cd-cb01fdf00af2 None admin] RBAC: Adding query filter params (role.id=c34cf84397a64ab0ad2a06daa8e13d88, scope.project.id=b5e41057319e4800939cb6fcbdcd1024, user.id=941c3a240a6b4eb889fd9d7045f52588) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:51.350985 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29120ae7-7a94-4c6e-97cd-cb01fdf00af2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:51.352529 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29120ae7-7a94-4c6e-97cd-cb01fdf00af2 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:51.359576 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 143/294] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jun 20 05:57:51 2022] GET /identity/v3/role_assignments?user.id=941c3a240a6b4eb889fd9d7045f52588&scope.project.id=b5e41057319e4800939cb6fcbdcd1024&role.id=c34cf84397a64ab0ad2a06daa8e13d88 => generated 608 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:52.057646 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0510c9c-4f8d-4107-8bd1-0dadeb74b01f None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:52.058162 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0510c9c-4f8d-4107-8bd1-0dadeb74b01f None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:52.058240 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0510c9c-4f8d-4107-8bd1-0dadeb74b01f None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:52.059901 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 152/295] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:57:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:52.065371 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc39b2-d36e-49f6-a6b1-81a9873135dd None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:52.065769 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc39b2-d36e-49f6-a6b1-81a9873135dd None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:52.065960 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc39b2-d36e-49f6-a6b1-81a9873135dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:52.086799 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-4acc39b2-d36e-49f6-a6b1-81a9873135dd None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:52.088065 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-4acc39b2-d36e-49f6-a6b1-81a9873135dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:52.121473 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:52.160849 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532d5bb-1bf4-4bd8-93c6-a82d691a4a45 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:52.161227 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532d5bb-1bf4-4bd8-93c6-a82d691a4a45 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:52.161593 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532d5bb-1bf4-4bd8-93c6-a82d691a4a45 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:52.163853 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 153/296] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:57:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:52.168962 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798d366-caae-4735-8744-e4aaec2126ae None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:52.169255 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798d366-caae-4735-8744-e4aaec2126ae None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:52.169538 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798d366-caae-4735-8744-e4aaec2126ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:52.174829 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 144/297] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:57:52.187676 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-f798d366-caae-4735-8744-e4aaec2126ae None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:52.188911 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-f798d366-caae-4735-8744-e4aaec2126ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:52.197303 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc39b2-d36e-49f6-a6b1-81a9873135dd None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:52.250363 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:52.277759 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 154/298] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:52.301618 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f798d366-caae-4735-8744-e4aaec2126ae None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:52.318520 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc39b2-d36e-49f6-a6b1-81a9873135dd None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:52.356515 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10b0b1-6514-46c3-a748-9293ad57d9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:52.357347 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10b0b1-6514-46c3-a748-9293ad57d9b8 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:52.357628 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10b0b1-6514-46c3-a748-9293ad57d9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:52.357900 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10b0b1-6514-46c3-a748-9293ad57d9b8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:52.359073 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c10b0b1-6514-46c3-a748-9293ad57d9b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:52.360516 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c10b0b1-6514-46c3-a748-9293ad57d9b8 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:52.367327 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 145/299] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:57:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:52.368749 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10b0b1-6514-46c3-a748-9293ad57d9b8 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:52.406407 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:52.418226 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f798d366-caae-4735-8744-e4aaec2126ae None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:52.459466 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdb9237-ef97-4333-8374-247d2b4b3c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:52.460338 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb9237-ef97-4333-8374-247d2b4b3c0f None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:52.460617 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb9237-ef97-4333-8374-247d2b4b3c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:52.460939 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb9237-ef97-4333-8374-247d2b4b3c0f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:52.471301 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdb9237-ef97-4333-8374-247d2b4b3c0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:52.480084 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-fcdb9237-ef97-4333-8374-247d2b4b3c0f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:57:52.480084 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:52.480084 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:52.480084 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:52.480084 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:52.480084 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:52.480084 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:52.480084 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:52.480084 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:52.480084 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:52.480084 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:52.480084 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:52.480084 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:52.480084 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:52.480084 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:52.480084 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:52.481201 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:52.481201 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:52.481201 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:52.481201 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:52.481201 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:52.481201 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:52.481201 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:52.481201 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:52.481201 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:52.481201 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:52.481201 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:52.481201 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:52.481201 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:52.481201 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:52.481201 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:52.481201 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:52.486888 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:52.486888 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:52.486888 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:52.486888 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:52.486888 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:52.486888 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:52.486888 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:52.486888 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:52.486888 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:52.486888 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:52.486888 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:57:52.486888 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:57:52.487600 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10b0b1-6514-46c3-a748-9293ad57d9b8 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:52.487675 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 155/300] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:57:52.487675 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90710c2f-d3f5-4d89-a2ff-6eccba05a820 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:52.487675 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90710c2f-d3f5-4d89-a2ff-6eccba05a820 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:52.487675 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90710c2f-d3f5-4d89-a2ff-6eccba05a820 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:52.487675 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 156/301] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:57:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:52.491285 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90710c2f-d3f5-4d89-a2ff-6eccba05a820 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:52.523172 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba57c77-7742-400a-b986-47311714c142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:52.523839 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba57c77-7742-400a-b986-47311714c142 None admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:52.524122 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba57c77-7742-400a-b986-47311714c142 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:52.524401 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba57c77-7742-400a-b986-47311714c142 None admin] PATH_INFO: `/v3/groups` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:52.525123 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba57c77-7742-400a-b986-47311714c142 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:52.526552 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba57c77-7742-400a-b986-47311714c142 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:52.541406 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 146/302] 10.222.0.39 () {60 vars in 1134 bytes} [Mon Jun 20 05:57:52 2022] POST /identity/v3/groups => generated 229 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 05:57:52.541406 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299cc2e-93af-4895-9bfa-c60dd950ee93 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:52.541406 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299cc2e-93af-4895-9bfa-c60dd950ee93 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:52.541406 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299cc2e-93af-4895-9bfa-c60dd950ee93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:52.551703 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:52.563373 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-3299cc2e-93af-4895-9bfa-c60dd950ee93 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:52.564758 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-3299cc2e-93af-4895-9bfa-c60dd950ee93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:52.620468 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90710c2f-d3f5-4d89-a2ff-6eccba05a820 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:52.659528 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d09c5e-66c0-4ffe-8988-4166b7585eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:52.660213 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d09c5e-66c0-4ffe-8988-4166b7585eec None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:52.660684 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 147/303] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:52.660808 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d09c5e-66c0-4ffe-8988-4166b7585eec None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:52.661413 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d09c5e-66c0-4ffe-8988-4166b7585eec None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:52.662892 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d09c5e-66c0-4ffe-8988-4166b7585eec None admin] RBAC: Adding query filter params (name=reader) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:52.663399 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d09c5e-66c0-4ffe-8988-4166b7585eec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:52.664876 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d09c5e-66c0-4ffe-8988-4166b7585eec None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:52.680211 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 157/304] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jun 20 05:57:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:52.681524 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299cc2e-93af-4895-9bfa-c60dd950ee93 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:52.689950 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d09c5e-66c0-4ffe-8988-4166b7585eec None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:52.730368 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:52.814090 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299cc2e-93af-4895-9bfa-c60dd950ee93 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:52.814494 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d09c5e-66c0-4ffe-8988-4166b7585eec None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:52.822174 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:52.852042 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ad2f03-c9a1-4680-8bd4-39c688c51f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:52.852931 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad2f03-c9a1-4680-8bd4-39c688c51f85 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:52.853126 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33763078-6e2c-4266-94af-3b42065aa44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:52.853238 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad2f03-c9a1-4680-8bd4-39c688c51f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:52.853469 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad2f03-c9a1-4680-8bd4-39c688c51f85 None admin] PATH_INFO: `/v3/users/c5dccb2093794b89bfdca8f6412afb81` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:52.853881 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33763078-6e2c-4266-94af-3b42065aa44a None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:52.854163 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33763078-6e2c-4266-94af-3b42065aa44a None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:52.854443 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33763078-6e2c-4266-94af-3b42065aa44a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:52.865963 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33763078-6e2c-4266-94af-3b42065aa44a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:52.867779 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ad2f03-c9a1-4680-8bd4-39c688c51f85 None admin] RBAC: Authorizing `identity:get_user(user_id=c5dccb2093794b89bfdca8f6412afb81)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:52.869293 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ad2f03-c9a1-4680-8bd4-39c688c51f85 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:52.875815 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 148/305] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:52 2022] GET /identity/v3/users/c5dccb2093794b89bfdca8f6412afb81 => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:52.875815 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a0aef-a9b7-4923-bdcf-9cdd87470dc5 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:52.875815 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a0aef-a9b7-4923-bdcf-9cdd87470dc5 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:52.875815 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a0aef-a9b7-4923-bdcf-9cdd87470dc5 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:52.876188 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-33763078-6e2c-4266-94af-3b42065aa44a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:57:52.876188 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:52.876188 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:52.876188 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:52.876188 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:52.876188 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:52.876188 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:52.876188 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:52.876188 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:52.876188 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:52.876188 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:52.876188 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:52.876188 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:52.876188 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:52.876188 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:52.876188 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:52.877044 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:52.877044 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:52.877044 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:52.877044 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:52.877044 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:52.877044 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:52.877044 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:52.877044 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:52.877044 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:52.877044 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:52.877044 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:52.877044 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:52.877044 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:52.877044 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:52.877044 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:52.877044 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:52.877827 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:52.877827 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:52.877827 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:52.877827 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:52.877827 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:52.877827 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:52.877827 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:52.877827 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:52.877827 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:52.877827 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:52.877827 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:57:52.877827 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:57:52.878435 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 149/306] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:57:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:52.878502 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 158/307] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:52.879208 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a0aef-a9b7-4923-bdcf-9cdd87470dc5 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:52.881303 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33763078-6e2c-4266-94af-3b42065aa44a None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:52.976112 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:52.988472 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33763078-6e2c-4266-94af-3b42065aa44a None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:52.994087 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a0aef-a9b7-4923-bdcf-9cdd87470dc5 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:53.030200 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ddd7f-e07e-43b2-9da7-097fc507d859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:53.030454 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ddd7f-e07e-43b2-9da7-097fc507d859 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:53.030668 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ddd7f-e07e-43b2-9da7-097fc507d859 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:53.030910 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ddd7f-e07e-43b2-9da7-097fc507d859 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:53.032155 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b097804-ed50-4b08-93c2-56c459e8cb0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:53.032279 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13ddd7f-e07e-43b2-9da7-097fc507d859 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:53.032279 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13ddd7f-e07e-43b2-9da7-097fc507d859 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:53.032424 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b097804-ed50-4b08-93c2-56c459e8cb0f None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:53.032424 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b097804-ed50-4b08-93c2-56c459e8cb0f None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:53.032719 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b097804-ed50-4b08-93c2-56c459e8cb0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:53.033561 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b097804-ed50-4b08-93c2-56c459e8cb0f None admin] RBAC: Adding query filter params (role.id=2c6f4a5c6a944218bdf2bc9684eea581, user.id=c5dccb2093794b89bfdca8f6412afb81, scope.system=all) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:53.033870 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b097804-ed50-4b08-93c2-56c459e8cb0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:53.034101 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13ddd7f-e07e-43b2-9da7-097fc507d859 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:53.035294 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b097804-ed50-4b08-93c2-56c459e8cb0f None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:53.044285 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 150/308] 10.222.0.39 () {56 vars in 1308 bytes} [Mon Jun 20 05:57:52 2022] GET /identity/v3/role_assignments?user.id=c5dccb2093794b89bfdca8f6412afb81&scope.system=all&role.id=2c6f4a5c6a944218bdf2bc9684eea581 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:53.048323 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 159/309] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jun 20 05:57:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:53.050297 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb366f-0a41-4a9c-be11-34770587a464 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:53.050872 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb366f-0a41-4a9c-be11-34770587a464 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:53.051356 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb366f-0a41-4a9c-be11-34770587a464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:53.054479 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ddd7f-e07e-43b2-9da7-097fc507d859 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:53.075375 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-b6eb366f-0a41-4a9c-be11-34770587a464 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:53.076615 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-b6eb366f-0a41-4a9c-be11-34770587a464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:53.105284 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:53.172806 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 151/310] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:53.190515 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ddd7f-e07e-43b2-9da7-097fc507d859 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:53.193476 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb366f-0a41-4a9c-be11-34770587a464 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:53.240936 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f9c5c-efbe-4aed-b1cf-417a0a2ba1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:53.242100 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f9c5c-efbe-4aed-b1cf-417a0a2ba1b2 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:53.242385 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f9c5c-efbe-4aed-b1cf-417a0a2ba1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:53.242658 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f9c5c-efbe-4aed-b1cf-417a0a2ba1b2 None admin] PATH_INFO: `/v3/users/52696e1ed0d44564bbf0373ade3a3c9c` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:53.244800 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f9c5c-efbe-4aed-b1cf-417a0a2ba1b2 None admin] RBAC: Authorizing `identity:get_user(user_id=52696e1ed0d44564bbf0373ade3a3c9c)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:53.246264 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f9c5c-efbe-4aed-b1cf-417a0a2ba1b2 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:53.248742 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 160/311] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:53 2022] GET /identity/v3/users/52696e1ed0d44564bbf0373ade3a3c9c => generated 297 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:53.253516 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f9c5c-efbe-4aed-b1cf-417a0a2ba1b2 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:53.298190 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:53.324943 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb366f-0a41-4a9c-be11-34770587a464 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:53.372166 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a744edf-fe11-4bd9-9226-3156ccfd28e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:53.373392 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a744edf-fe11-4bd9-9226-3156ccfd28e4 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:53.374378 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a744edf-fe11-4bd9-9226-3156ccfd28e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:53.374892 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a744edf-fe11-4bd9-9226-3156ccfd28e4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:53.381452 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:53.387926 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f9c5c-efbe-4aed-b1cf-417a0a2ba1b2 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:53.392345 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a744edf-fe11-4bd9-9226-3156ccfd28e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:53.402097 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-1a744edf-fe11-4bd9-9226-3156ccfd28e4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:57:53.402097 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:53.402097 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:53.402097 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:53.402097 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:53.402097 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:53.402097 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:53.402097 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:53.402097 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:53.402097 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:53.402097 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:53.402097 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:53.402097 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:53.402097 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:53.402097 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:53.402097 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:53.403155 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:53.403155 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:53.403155 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:53.403155 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:53.403155 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:53.403155 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:53.403155 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:53.403155 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:53.403155 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:53.403155 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:53.403155 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:53.403155 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:53.403155 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:53.403155 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:53.403155 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:53.403155 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:53.404122 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:53.404122 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:53.404122 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:53.404122 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:53.404122 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:53.404122 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:53.404122 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:53.404122 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:53.404122 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:53.404122 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:53.404122 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:57:53.404122 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:57:53.407207 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 152/312] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:57:53.413314 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a744edf-fe11-4bd9-9226-3156ccfd28e4 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:53.430836 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca2263-f48d-4150-88e0-1bea6d0c1b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:53.431632 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca2263-f48d-4150-88e0-1bea6d0c1b29 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:53.431983 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca2263-f48d-4150-88e0-1bea6d0c1b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:53.432351 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca2263-f48d-4150-88e0-1bea6d0c1b29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:53.517887 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca2263-f48d-4150-88e0-1bea6d0c1b29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:53.519562 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca2263-f48d-4150-88e0-1bea6d0c1b29 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:53.541894 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a744edf-fe11-4bd9-9226-3156ccfd28e4 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:53.580266 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522ac07b-3215-4b8f-9b05-7e58e742b173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:53.581668 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ac07b-3215-4b8f-9b05-7e58e742b173 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:53.582385 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ac07b-3215-4b8f-9b05-7e58e742b173 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:53.582837 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ac07b-3215-4b8f-9b05-7e58e742b173 None admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:53.584607 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522ac07b-3215-4b8f-9b05-7e58e742b173 None admin] RBAC: Adding query filter params (name=member) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:53.585123 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522ac07b-3215-4b8f-9b05-7e58e742b173 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:53.586655 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522ac07b-3215-4b8f-9b05-7e58e742b173 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:53.592353 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:53.597118 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 153/313] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jun 20 05:57:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:53.603782 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522ac07b-3215-4b8f-9b05-7e58e742b173 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:53.627047 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:53.637137 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 161/314] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 05:57:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:57:53.643164 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca2263-f48d-4150-88e0-1bea6d0c1b29 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:53.722296 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522ac07b-3215-4b8f-9b05-7e58e742b173 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:53.755190 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca2263-f48d-4150-88e0-1bea6d0c1b29 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:53.761765 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f41734a-da04-4ec8-969b-1e6b75356e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:53.763184 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f41734a-da04-4ec8-969b-1e6b75356e44 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:53.763667 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f41734a-da04-4ec8-969b-1e6b75356e44 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:53.764130 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f41734a-da04-4ec8-969b-1e6b75356e44 None admin] PATH_INFO: `/v3/users/b4f72b1f81c845a79f809302e236f95a` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:53.765688 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f41734a-da04-4ec8-969b-1e6b75356e44 None admin] RBAC: Authorizing `identity:get_user(user_id=b4f72b1f81c845a79f809302e236f95a)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:53.767522 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f41734a-da04-4ec8-969b-1e6b75356e44 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:53.774693 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 154/315] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:53 2022] GET /identity/v3/users/b4f72b1f81c845a79f809302e236f95a => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:53.776109 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f41734a-da04-4ec8-969b-1e6b75356e44 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:53.793155 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f34e1-005c-40a5-8f3c-69ae0abcf202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:53.794058 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f34e1-005c-40a5-8f3c-69ae0abcf202 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:53.794308 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f34e1-005c-40a5-8f3c-69ae0abcf202 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:53.794592 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f34e1-005c-40a5-8f3c-69ae0abcf202 None admin] PATH_INFO: `/v3/projects/b5e41057319e4800939cb6fcbdcd1024` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:53.795797 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653f34e1-005c-40a5-8f3c-69ae0abcf202 None admin] RBAC: Authorizing `identity:get_project(project_id=b5e41057319e4800939cb6fcbdcd1024)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:53.797599 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653f34e1-005c-40a5-8f3c-69ae0abcf202 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:53.804748 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 162/316] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:53 2022] GET /identity/v3/projects/b5e41057319e4800939cb6fcbdcd1024 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:53.805768 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f34e1-005c-40a5-8f3c-69ae0abcf202 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:53.849664 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:53.876964 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:53.888535 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f41734a-da04-4ec8-969b-1e6b75356e44 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:53.918339 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f34e1-005c-40a5-8f3c-69ae0abcf202 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:53.925032 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19faa3b-dc8a-415d-9728-8f2e0ffeb33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:53.926217 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19faa3b-dc8a-415d-9728-8f2e0ffeb33c None admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:53.926695 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19faa3b-dc8a-415d-9728-8f2e0ffeb33c None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:53.927699 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19faa3b-dc8a-415d-9728-8f2e0ffeb33c None admin] PATH_INFO: `/v3/system/users/b4f72b1f81c845a79f809302e236f95a/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:53.929510 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19faa3b-dc8a-415d-9728-8f2e0ffeb33c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b4f72b1f81c845a79f809302e236f95a, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:53.931204 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19faa3b-dc8a-415d-9728-8f2e0ffeb33c None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:53.944903 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 155/317] 10.222.0.39 () {58 vars in 1334 bytes} [Mon Jun 20 05:57:53 2022] PUT /identity/v3/system/users/b4f72b1f81c845a79f809302e236f95a/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 05:57:53.965626 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106276da-dfe8-4ba8-b0fe-a270132e4c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:53.966335 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106276da-dfe8-4ba8-b0fe-a270132e4c4d None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:53.966617 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106276da-dfe8-4ba8-b0fe-a270132e4c4d None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:53.966894 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106276da-dfe8-4ba8-b0fe-a270132e4c4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:53.967799 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106276da-dfe8-4ba8-b0fe-a270132e4c4d None admin] RBAC: Adding query filter params (role.id=2c6f4a5c6a944218bdf2bc9684eea581, scope.project.id=b5e41057319e4800939cb6fcbdcd1024, user.id=52696e1ed0d44564bbf0373ade3a3c9c) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:53.968117 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106276da-dfe8-4ba8-b0fe-a270132e4c4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:53.969646 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106276da-dfe8-4ba8-b0fe-a270132e4c4d None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:53.978332 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 163/318] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jun 20 05:57:53 2022] GET /identity/v3/role_assignments?user.id=52696e1ed0d44564bbf0373ade3a3c9c&scope.project.id=b5e41057319e4800939cb6fcbdcd1024&role.id=2c6f4a5c6a944218bdf2bc9684eea581 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:54.681208 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd1ba9-2b16-4d40-b696-bfbb6033abda None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:54.681715 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd1ba9-2b16-4d40-b696-bfbb6033abda None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:54.681986 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd1ba9-2b16-4d40-b696-bfbb6033abda None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:54.683247 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 156/319] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:57:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:54.688295 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5a12a-6029-460e-9676-ad8b44114f81 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:54.688676 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5a12a-6029-460e-9676-ad8b44114f81 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:54.688892 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5a12a-6029-460e-9676-ad8b44114f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:54.706957 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-4ff5a12a-6029-460e-9676-ad8b44114f81 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:54.708071 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-4ff5a12a-6029-460e-9676-ad8b44114f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:54.778540 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 164/320] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:54.801629 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd1ba9-2b16-4d40-b696-bfbb6033abda None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:54.908880 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd1ba9-2b16-4d40-b696-bfbb6033abda None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:54.938404 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:54.944602 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62784aa-41af-46d3-8838-2b49ea5cd1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:54.945442 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62784aa-41af-46d3-8838-2b49ea5cd1b6 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:54.945713 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62784aa-41af-46d3-8838-2b49ea5cd1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:54.945990 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62784aa-41af-46d3-8838-2b49ea5cd1b6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:54.947712 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62784aa-41af-46d3-8838-2b49ea5cd1b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:54.949540 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62784aa-41af-46d3-8838-2b49ea5cd1b6 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:54.955911 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 157/321] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:57:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:54.957616 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff5a12a-6029-460e-9676-ad8b44114f81 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:55.018940 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:55.063347 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff5a12a-6029-460e-9676-ad8b44114f81 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:55.100067 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7758c76d-ea24-49c1-afd9-3680d56c3db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:55.100769 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758c76d-ea24-49c1-afd9-3680d56c3db1 None admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:55.101055 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758c76d-ea24-49c1-afd9-3680d56c3db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:55.101328 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758c76d-ea24-49c1-afd9-3680d56c3db1 None admin] PATH_INFO: `/v3/groups` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:55.102023 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7758c76d-ea24-49c1-afd9-3680d56c3db1 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:55.103479 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7758c76d-ea24-49c1-afd9-3680d56c3db1 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:55.119463 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 165/322] 10.222.0.39 () {60 vars in 1134 bytes} [Mon Jun 20 05:57:54 2022] POST /identity/v3/groups => generated 226 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:57:55.150402 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20564b57-1c8d-49ed-8b6a-162361685bf8 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:55.150706 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20564b57-1c8d-49ed-8b6a-162361685bf8 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:55.150960 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20564b57-1c8d-49ed-8b6a-162361685bf8 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:55.152565 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 158/323] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:57:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:55.158161 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5058e-c875-4b4d-9abb-6d9d922a96a2 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:55.158452 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5058e-c875-4b4d-9abb-6d9d922a96a2 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:55.158735 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5058e-c875-4b4d-9abb-6d9d922a96a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:55.179518 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-f9c5058e-c875-4b4d-9abb-6d9d922a96a2 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:55.180963 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-f9c5058e-c875-4b4d-9abb-6d9d922a96a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:55.253448 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 166/324] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:55.276271 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20564b57-1c8d-49ed-8b6a-162361685bf8 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:55.383223 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20564b57-1c8d-49ed-8b6a-162361685bf8 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:55.422637 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97fe001-938b-42ce-904a-74698f661fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:55.423675 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97fe001-938b-42ce-904a-74698f661fb0 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:55.424129 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97fe001-938b-42ce-904a-74698f661fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:55.424549 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97fe001-938b-42ce-904a-74698f661fb0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:55.436397 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97fe001-938b-42ce-904a-74698f661fb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:55.444630 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-f97fe001-938b-42ce-904a-74698f661fb0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:57:55.444630 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:55.444630 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:55.444630 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:55.444630 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:55.444630 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:55.444630 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:55.444630 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:55.444630 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:55.444630 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:55.444630 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:55.444630 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:55.444630 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:55.444630 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:55.444630 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:55.444630 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:55.445598 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:55.445598 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:55.445598 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:55.445598 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:55.445598 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:55.445598 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:55.445598 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:55.445598 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:55.445598 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:55.445598 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:55.445598 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:55.445598 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:55.445598 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:55.445598 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:55.445598 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:55.445598 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:55.446366 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:55.446366 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:55.446366 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:55.446366 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:55.446366 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:55.446366 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:55.446366 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:55.446366 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:55.446366 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:55.446366 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:55.446366 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:57:55.446366 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:57:55.446366 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 159/325] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:55.453251 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c5058e-c875-4b4d-9abb-6d9d922a96a2 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:55.511132 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:55.576528 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c5058e-c875-4b4d-9abb-6d9d922a96a2 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:55.618646 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1daf62-f15f-40b0-aa69-672f215c0159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:55.619364 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1daf62-f15f-40b0-aa69-672f215c0159 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:55.619649 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1daf62-f15f-40b0-aa69-672f215c0159 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:55.619928 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1daf62-f15f-40b0-aa69-672f215c0159 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:55.620683 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1daf62-f15f-40b0-aa69-672f215c0159 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:55.621018 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1daf62-f15f-40b0-aa69-672f215c0159 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:55.622391 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1daf62-f15f-40b0-aa69-672f215c0159 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:55.632353 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 167/326] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jun 20 05:57:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:55.637496 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97fe001-938b-42ce-904a-74698f661fb0 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:55.711007 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:55.760430 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97fe001-938b-42ce-904a-74698f661fb0 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:55.796899 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae3f6c3-0a63-4b5e-83f2-b0d35212b1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:55.797697 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3f6c3-0a63-4b5e-83f2-b0d35212b1b0 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:55.797976 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3f6c3-0a63-4b5e-83f2-b0d35212b1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:55.798250 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3f6c3-0a63-4b5e-83f2-b0d35212b1b0 None admin] PATH_INFO: `/v3/users/c5dccb2093794b89bfdca8f6412afb81` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:55.799449 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae3f6c3-0a63-4b5e-83f2-b0d35212b1b0 None admin] RBAC: Authorizing `identity:get_user(user_id=c5dccb2093794b89bfdca8f6412afb81)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:55.800925 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae3f6c3-0a63-4b5e-83f2-b0d35212b1b0 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:55.802721 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 160/327] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:55 2022] GET /identity/v3/users/c5dccb2093794b89bfdca8f6412afb81 => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:55.808447 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1daf62-f15f-40b0-aa69-672f215c0159 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:55.932520 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1daf62-f15f-40b0-aa69-672f215c0159 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:55.948152 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:55.981231 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51319df1-2730-4041-997a-b6b7775f7061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:55.982176 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51319df1-2730-4041-997a-b6b7775f7061 None admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:55.982460 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51319df1-2730-4041-997a-b6b7775f7061 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:55.982739 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51319df1-2730-4041-997a-b6b7775f7061 None admin] PATH_INFO: `/v3/system/users/c5dccb2093794b89bfdca8f6412afb81/roles/2c6f4a5c6a944218bdf2bc9684eea581` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:55.984297 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51319df1-2730-4041-997a-b6b7775f7061 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c5dccb2093794b89bfdca8f6412afb81, role_id=2c6f4a5c6a944218bdf2bc9684eea581)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:55.985724 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51319df1-2730-4041-997a-b6b7775f7061 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:55.998301 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 168/328] 10.222.0.39 () {58 vars in 1334 bytes} [Mon Jun 20 05:57:55 2022] PUT /identity/v3/system/users/c5dccb2093794b89bfdca8f6412afb81/roles/2c6f4a5c6a944218bdf2bc9684eea581 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 05:57:56.013804 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf55c01-8233-4cfb-976a-2aec1e90192d None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:56.014089 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf55c01-8233-4cfb-976a-2aec1e90192d None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:56.014368 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf55c01-8233-4cfb-976a-2aec1e90192d None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:56.017586 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 161/329] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:57:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:56.024646 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ef779-6453-4fe0-9db6-5be85747d4f7 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:56.025246 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ef779-6453-4fe0-9db6-5be85747d4f7 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:56.025703 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ef779-6453-4fe0-9db6-5be85747d4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:56.045582 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-a53ef779-6453-4fe0-9db6-5be85747d4f7 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:56.047127 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-a53ef779-6453-4fe0-9db6-5be85747d4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:56.134925 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 169/330] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:56.158652 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf55c01-8233-4cfb-976a-2aec1e90192d None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:56.275710 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf55c01-8233-4cfb-976a-2aec1e90192d None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:56.303645 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:56.311532 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c422b25-cea2-41bb-b0fc-11693c16132e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:56.312733 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c422b25-cea2-41bb-b0fc-11693c16132e None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:56.313136 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c422b25-cea2-41bb-b0fc-11693c16132e None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:56.313585 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c422b25-cea2-41bb-b0fc-11693c16132e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:56.325445 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c422b25-cea2-41bb-b0fc-11693c16132e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:56.333634 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-9c422b25-cea2-41bb-b0fc-11693c16132e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:57:56.333634 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:56.333634 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:56.333634 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:56.333634 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:56.333634 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:56.333634 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:56.333634 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:56.333634 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:56.333634 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:56.333634 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:56.333634 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:56.333634 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:56.333634 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:56.333634 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:56.333634 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:56.334494 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:56.334494 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:56.334494 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:56.334494 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:56.334494 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:56.334494 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:56.334494 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:56.334494 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:56.334494 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:56.334494 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:56.334494 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:56.334494 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:56.334494 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:56.334494 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:56.334494 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:56.334494 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:56.335290 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:56.335290 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:56.335290 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:56.335290 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:56.335290 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:56.335290 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:56.335290 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:56.335290 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:56.335290 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:56.335290 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:56.335290 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:57:56.335290 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:57:56.337619 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 162/331] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:56.343459 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ef779-6453-4fe0-9db6-5be85747d4f7 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:56.488461 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ef779-6453-4fe0-9db6-5be85747d4f7 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:56.491358 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:56.532318 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6d914-f5b1-4362-b36a-4d2cc4deb11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:56.533261 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6d914-f5b1-4362-b36a-4d2cc4deb11d None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:56.533686 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6d914-f5b1-4362-b36a-4d2cc4deb11d None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:56.534095 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6d914-f5b1-4362-b36a-4d2cc4deb11d None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:56.534981 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae6d914-f5b1-4362-b36a-4d2cc4deb11d None admin] RBAC: Adding query filter params (name=member) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:56.535448 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae6d914-f5b1-4362-b36a-4d2cc4deb11d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:56.537652 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae6d914-f5b1-4362-b36a-4d2cc4deb11d None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:56.546825 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 170/332] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jun 20 05:57:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:56.552609 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c422b25-cea2-41bb-b0fc-11693c16132e None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:56.673758 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c422b25-cea2-41bb-b0fc-11693c16132e None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:56.714634 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f8c98-4b45-4d11-88d9-426407f331af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:56.716199 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f8c98-4b45-4d11-88d9-426407f331af None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:56.716642 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f8c98-4b45-4d11-88d9-426407f331af None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:56.717074 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f8c98-4b45-4d11-88d9-426407f331af None admin] PATH_INFO: `/v3/users/b4f72b1f81c845a79f809302e236f95a` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:56.718421 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1f8c98-4b45-4d11-88d9-426407f331af None admin] RBAC: Authorizing `identity:get_user(user_id=b4f72b1f81c845a79f809302e236f95a)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:56.720014 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1f8c98-4b45-4d11-88d9-426407f331af None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:56.721850 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 163/333] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jun 20 05:57:56 2022] GET /identity/v3/users/b4f72b1f81c845a79f809302e236f95a => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:56.727781 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6d914-f5b1-4362-b36a-4d2cc4deb11d None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:56.854787 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6d914-f5b1-4362-b36a-4d2cc4deb11d None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:56.895769 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058790f8-cbaf-4a80-9404-4adffdcbe507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:56.896492 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058790f8-cbaf-4a80-9404-4adffdcbe507 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:56.896799 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058790f8-cbaf-4a80-9404-4adffdcbe507 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:56.897068 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058790f8-cbaf-4a80-9404-4adffdcbe507 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:56.897964 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058790f8-cbaf-4a80-9404-4adffdcbe507 None admin] RBAC: Adding query filter params (role.id=c34cf84397a64ab0ad2a06daa8e13d88, user.id=b4f72b1f81c845a79f809302e236f95a, scope.system=all) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:56.898279 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058790f8-cbaf-4a80-9404-4adffdcbe507 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:56.899713 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058790f8-cbaf-4a80-9404-4adffdcbe507 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:56.917308 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 171/334] 10.222.0.39 () {56 vars in 1308 bytes} [Mon Jun 20 05:57:56 2022] GET /identity/v3/role_assignments?user.id=b4f72b1f81c845a79f809302e236f95a&scope.system=all&role.id=c34cf84397a64ab0ad2a06daa8e13d88 => generated 510 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:57.772305 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf8852c-bb7a-43a3-a688-db13c508ff8b None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:57.773488 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf8852c-bb7a-43a3-a688-db13c508ff8b None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:57.773982 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf8852c-bb7a-43a3-a688-db13c508ff8b None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:57.775602 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 164/335] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:57:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:57.781524 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4814b-2f1b-4c48-bde0-93ef6d30a5e0 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:57.781826 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4814b-2f1b-4c48-bde0-93ef6d30a5e0 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:57.782086 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4814b-2f1b-4c48-bde0-93ef6d30a5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:57.810459 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-9fc4814b-2f1b-4c48-bde0-93ef6d30a5e0 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:57.811671 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-9fc4814b-2f1b-4c48-bde0-93ef6d30a5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:57.832710 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:57.901068 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 172/336] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:57.936682 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf8852c-bb7a-43a3-a688-db13c508ff8b None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:58.004379 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:58.057563 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf8852c-bb7a-43a3-a688-db13c508ff8b None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:58.108019 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ec006-5f58-4f42-9047-d97c932c337a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:58.108939 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ec006-5f58-4f42-9047-d97c932c337a None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:58.109223 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ec006-5f58-4f42-9047-d97c932c337a None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:58.109494 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ec006-5f58-4f42-9047-d97c932c337a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:58.123594 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33ec006-5f58-4f42-9047-d97c932c337a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:58.131909 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-f33ec006-5f58-4f42-9047-d97c932c337a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:57:58.131909 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:58.131909 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:58.131909 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:58.131909 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:58.131909 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:58.131909 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:58.131909 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:58.131909 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:58.131909 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:58.131909 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:58.131909 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:58.131909 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:58.131909 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:58.131909 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:58.131909 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:58.132799 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:58.132799 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:58.132799 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:58.132799 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:58.132799 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:58.132799 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:58.132799 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:58.132799 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:58.132799 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:58.132799 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:58.132799 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:58.132799 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:58.132799 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:58.132799 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:58.132799 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:58.132799 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:58.133583 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:58.133583 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:58.133583 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:58.133583 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:58.133583 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:58.133583 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:58.133583 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:58.133583 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:58.133583 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:58.133583 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:58.133583 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:57:58.133583 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:57:58.133583 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 165/337] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jun 20 05:57:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:58.139126 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4814b-2f1b-4c48-bde0-93ef6d30a5e0 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:58.198183 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553d0d0-19a9-45c1-b321-3031cc38461b None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:58.198482 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553d0d0-19a9-45c1-b321-3031cc38461b None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:58.198737 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553d0d0-19a9-45c1-b321-3031cc38461b None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:58.200205 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 166/338] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:57:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:58.218295 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ae46f-bf62-4f8d-8e3b-bcc67528d67d None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:58.218611 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ae46f-bf62-4f8d-8e3b-bcc67528d67d None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:58.218846 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ae46f-bf62-4f8d-8e3b-bcc67528d67d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:58.246856 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-816ae46f-bf62-4f8d-8e3b-bcc67528d67d None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:58.248048 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-816ae46f-bf62-4f8d-8e3b-bcc67528d67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:58.288275 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4814b-2f1b-4c48-bde0-93ef6d30a5e0 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:58.334255 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb2dd3-f29a-4ccd-b350-927c0b9654b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:58.335382 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb2dd3-f29a-4ccd-b350-927c0b9654b6 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:58.335876 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb2dd3-f29a-4ccd-b350-927c0b9654b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:58.336340 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb2dd3-f29a-4ccd-b350-927c0b9654b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:58.337321 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cb2dd3-f29a-4ccd-b350-927c0b9654b6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:58.337842 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cb2dd3-f29a-4ccd-b350-927c0b9654b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:58.339516 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cb2dd3-f29a-4ccd-b350-927c0b9654b6 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:58.355239 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 173/339] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jun 20 05:57:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:58.363454 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb2dd3-f29a-4ccd-b350-927c0b9654b6 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:58.396317 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:58.418420 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 167/340] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:57:58.519993 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ae46f-bf62-4f8d-8e3b-bcc67528d67d None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:58.524131 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb2dd3-f29a-4ccd-b350-927c0b9654b6 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:58.573473 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad4a52d-8ce2-438d-95bf-1753d0cccacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:58.574382 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4a52d-8ce2-438d-95bf-1753d0cccacf None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:58.574834 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4a52d-8ce2-438d-95bf-1753d0cccacf None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:58.575251 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4a52d-8ce2-438d-95bf-1753d0cccacf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:58.617168 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:58.671749 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad4a52d-8ce2-438d-95bf-1753d0cccacf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:58.677831 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad4a52d-8ce2-438d-95bf-1753d0cccacf None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:58.700275 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ae46f-bf62-4f8d-8e3b-bcc67528d67d None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:58.700466 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:58.773446 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ec8fc-b332-4c6b-9927-d0ac32ec321a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:58.775566 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ec8fc-b332-4c6b-9927-d0ac32ec321a None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:58.776201 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ec8fc-b332-4c6b-9927-d0ac32ec321a None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:58.776847 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ec8fc-b332-4c6b-9927-d0ac32ec321a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:58.796792 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ec8fc-b332-4c6b-9927-d0ac32ec321a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:58.808970 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-a69ec8fc-b332-4c6b-9927-d0ac32ec321a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:57:58.808970 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:58.808970 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:58.808970 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:58.808970 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:58.808970 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:58.808970 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:58.808970 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:58.808970 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:58.808970 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:58.808970 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:58.808970 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:58.808970 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:58.808970 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:58.808970 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:58.808970 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:58.810071 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:58.810071 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:58.810071 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:58.810071 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:58.810071 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:58.810071 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:58.810071 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:58.810071 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:58.810071 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:58.810071 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:58.810071 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:58.810071 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:58.810071 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:58.810071 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:58.810071 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:58.810071 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:58.811008 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:58.811008 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:58.811008 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:58.811008 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:58.811008 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:58.811008 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:58.811008 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:58.811008 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:58.811008 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:58.811008 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:58.811008 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:57:58.811008 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:57:58.811620 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 174/341] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 05:57:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 20 05:57:58.813448 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 168/342] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:58.818695 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad4a52d-8ce2-438d-95bf-1753d0cccacf None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:58.831851 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ec8fc-b332-4c6b-9927-d0ac32ec321a None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:58.975557 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ec8fc-b332-4c6b-9927-d0ac32ec321a None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:58.982125 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad4a52d-8ce2-438d-95bf-1753d0cccacf None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:58.984189 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:59.014606 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:59.031660 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a32f7-c78e-418f-b32a-454ec358f8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:59.032448 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4730b596-7dc4-43ad-807c-a14e81621989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:59.033500 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4730b596-7dc4-43ad-807c-a14e81621989 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:59.034302 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a32f7-c78e-418f-b32a-454ec358f8a1 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:59.034750 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a32f7-c78e-418f-b32a-454ec358f8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:59.035163 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4730b596-7dc4-43ad-807c-a14e81621989 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:59.035573 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a32f7-c78e-418f-b32a-454ec358f8a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:59.035979 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4730b596-7dc4-43ad-807c-a14e81621989 None admin] PATH_INFO: `/v3/projects/852ede50488445d795524cf072c12f7e` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:59.037557 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731a32f7-c78e-418f-b32a-454ec358f8a1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:59.038355 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4730b596-7dc4-43ad-807c-a14e81621989 None admin] RBAC: Authorizing `identity:get_project(project_id=852ede50488445d795524cf072c12f7e)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:59.038808 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731a32f7-c78e-418f-b32a-454ec358f8a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:59.040351 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731a32f7-c78e-418f-b32a-454ec358f8a1 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:59.041966 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4730b596-7dc4-43ad-807c-a14e81621989 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:59.045999 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 175/343] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:58 2022] GET /identity/v3/projects/852ede50488445d795524cf072c12f7e => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:59.052407 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4730b596-7dc4-43ad-807c-a14e81621989 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:59.065491 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 169/344] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jun 20 05:57:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:59.090170 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a32f7-c78e-418f-b32a-454ec358f8a1 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:59.230356 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4730b596-7dc4-43ad-807c-a14e81621989 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:59.276121 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d0932e-f93b-4fe5-993b-f13d0ce49deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:59.277286 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0932e-f93b-4fe5-993b-f13d0ce49deb None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:59.277712 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0932e-f93b-4fe5-993b-f13d0ce49deb None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:59.278131 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0932e-f93b-4fe5-993b-f13d0ce49deb None admin] PATH_INFO: `/v3/groups/1dd23e27a6e74ff9a16348eee36cd9d1` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:59.284594 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d0932e-f93b-4fe5-993b-f13d0ce49deb None admin] RBAC: Authorizing `identity:get_group(group_id=1dd23e27a6e74ff9a16348eee36cd9d1)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:59.286799 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d0932e-f93b-4fe5-993b-f13d0ce49deb None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:59.289045 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 176/345] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Jun 20 05:57:59 2022] GET /identity/v3/groups/1dd23e27a6e74ff9a16348eee36cd9d1 => generated 226 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:59.290459 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818db0c9-50a0-4d2f-9df7-e18eedb27d5d None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:59.290887 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818db0c9-50a0-4d2f-9df7-e18eedb27d5d None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:59.291304 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818db0c9-50a0-4d2f-9df7-e18eedb27d5d None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:59.292954 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 177/346] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:57:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:59.299018 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a2e756-2cb6-42cc-a39e-12443d49a2ee None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:59.299344 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a2e756-2cb6-42cc-a39e-12443d49a2ee None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:59.301715 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a2e756-2cb6-42cc-a39e-12443d49a2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:59.315319 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a32f7-c78e-418f-b32a-454ec358f8a1 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:59.339121 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-13a2e756-2cb6-42cc-a39e-12443d49a2ee None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:59.340330 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-13a2e756-2cb6-42cc-a39e-12443d49a2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:59.370073 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2147f04a-e40e-48f2-9ee6-d610fcf5a185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:59.370733 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147f04a-e40e-48f2-9ee6-d610fcf5a185 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:59.371015 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147f04a-e40e-48f2-9ee6-d610fcf5a185 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:59.371286 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147f04a-e40e-48f2-9ee6-d610fcf5a185 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:59.422263 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:59.429351 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:59.473596 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2147f04a-e40e-48f2-9ee6-d610fcf5a185 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:59.475284 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 178/347] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:59.476358 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a2e756-2cb6-42cc-a39e-12443d49a2ee None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:59.479258 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2147f04a-e40e-48f2-9ee6-d610fcf5a185 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:59.600945 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 170/348] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 05:57:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 20 05:57:59.602470 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306cbc3-49c6-4cf9-860c-b55ddad2863c None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:59.602764 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306cbc3-49c6-4cf9-860c-b55ddad2863c None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:59.603046 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306cbc3-49c6-4cf9-860c-b55ddad2863c None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:59.604565 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 171/349] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:57:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:59.604922 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a2e756-2cb6-42cc-a39e-12443d49a2ee None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:59.605212 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3306cbc3-49c6-4cf9-860c-b55ddad2863c None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:59.642119 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2813f270-8100-4114-97ad-aa1c8ba65eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:59.643040 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813f270-8100-4114-97ad-aa1c8ba65eda None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:59.643469 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813f270-8100-4114-97ad-aa1c8ba65eda None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:59.643897 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813f270-8100-4114-97ad-aa1c8ba65eda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:59.644899 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2813f270-8100-4114-97ad-aa1c8ba65eda None admin] RBAC: Adding query filter params (group.id=1dd23e27a6e74ff9a16348eee36cd9d1, role.id=844adf3fdfaf458faa6fcbcf641d4182, scope.project.id=852ede50488445d795524cf072c12f7e) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:59.645385 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2813f270-8100-4114-97ad-aa1c8ba65eda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:59.646957 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2813f270-8100-4114-97ad-aa1c8ba65eda None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:59.653253 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 179/350] 10.222.0.39 () {56 vars in 1376 bytes} [Mon Jun 20 05:57:59 2022] GET /identity/v3/role_assignments?group.id=1dd23e27a6e74ff9a16348eee36cd9d1&scope.project.id=852ede50488445d795524cf072c12f7e&role.id=844adf3fdfaf458faa6fcbcf641d4182 => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:59.654698 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78cc2f-9da5-4343-80c7-85dc47a6f73a None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:59.655134 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78cc2f-9da5-4343-80c7-85dc47a6f73a None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:59.655557 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78cc2f-9da5-4343-80c7-85dc47a6f73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:59.672725 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-3a78cc2f-9da5-4343-80c7-85dc47a6f73a None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:59.674237 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-3a78cc2f-9da5-4343-80c7-85dc47a6f73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:59.722939 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:59.748928 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:59.755757 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 180/351] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:57:59.756576 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78cc2f-9da5-4343-80c7-85dc47a6f73a None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:59.853641 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3306cbc3-49c6-4cf9-860c-b55ddad2863c None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:59.871831 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78cc2f-9da5-4343-80c7-85dc47a6f73a None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:59.914098 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66397e2a-9d2a-4edd-bebb-f097fc1654a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:59.914901 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66397e2a-9d2a-4edd-bebb-f097fc1654a1 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:59.915179 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66397e2a-9d2a-4edd-bebb-f097fc1654a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:59.915450 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66397e2a-9d2a-4edd-bebb-f097fc1654a1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:59.923192 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f33db-4cf0-4d89-ac44-b1e9749570c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:59.924047 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f33db-4cf0-4d89-ac44-b1e9749570c1 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:59.924326 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f33db-4cf0-4d89-ac44-b1e9749570c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:59.924596 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f33db-4cf0-4d89-ac44-b1e9749570c1 None admin] PATH_INFO: `/v3/projects/852ede50488445d795524cf072c12f7e` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:59.928415 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84f33db-4cf0-4d89-ac44-b1e9749570c1 None admin] RBAC: Authorizing `identity:get_project(project_id=852ede50488445d795524cf072c12f7e)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:59.929994 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84f33db-4cf0-4d89-ac44-b1e9749570c1 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:59.931965 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 181/352] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jun 20 05:57:59 2022] GET /identity/v3/projects/852ede50488445d795524cf072c12f7e => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:59.932854 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f33db-4cf0-4d89-ac44-b1e9749570c1 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:59.937248 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66397e2a-9d2a-4edd-bebb-f097fc1654a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:59.947843 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-66397e2a-9d2a-4edd-bebb-f097fc1654a1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:57:59.947843 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:59.947843 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:59.947843 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:59.947843 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:59.947843 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:59.947843 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:59.947843 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:59.947843 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:59.947843 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:59.947843 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:59.947843 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:59.947843 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:59.947843 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:59.947843 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:59.947843 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:59.948883 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:59.948883 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:59.948883 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:59.948883 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:59.948883 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:59.948883 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:59.948883 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:59.948883 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:59.948883 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:59.948883 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:59.948883 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:59.948883 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:59.948883 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:59.948883 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:59.948883 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:59.948883 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:59.951119 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:59.951119 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:59.951119 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:59.951119 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:59.951119 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:59.951119 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:59.951119 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:59.951119 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:59.951119 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:59.951119 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:59.951119 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:57:59.951119 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:57:59.951119 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 172/353] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:59.957672 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe7f9b4-150b-4caa-8148-e101cb53a49c None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:59.957989 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe7f9b4-150b-4caa-8148-e101cb53a49c None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:59.958270 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe7f9b4-150b-4caa-8148-e101cb53a49c None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:59.959726 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 173/354] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:57:59 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:59.960519 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe7f9b4-150b-4caa-8148-e101cb53a49c None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:00.001168 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:00.066420 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f33db-4cf0-4d89-ac44-b1e9749570c1 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:00.116654 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe7f9b4-150b-4caa-8148-e101cb53a49c None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:00.117581 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b85d5e3-60df-4907-8e82-faac6920afc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:00.118507 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85d5e3-60df-4907-8e82-faac6920afc1 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:00.119182 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85d5e3-60df-4907-8e82-faac6920afc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:00.119554 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85d5e3-60df-4907-8e82-faac6920afc1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:00.139643 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b85d5e3-60df-4907-8e82-faac6920afc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:00.147967 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-1b85d5e3-60df-4907-8e82-faac6920afc1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:58:00.147967 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:00.147967 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:00.147967 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:00.147967 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:00.147967 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:00.147967 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:00.147967 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:00.147967 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:00.147967 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:00.147967 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:00.147967 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:00.147967 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:00.147967 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:00.147967 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:00.147967 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:00.148936 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:00.148936 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:00.148936 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:00.148936 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:00.148936 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:00.148936 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:00.148936 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:00.148936 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:00.148936 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:00.148936 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:00.148936 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:00.148936 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:00.148936 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:00.148936 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:00.148936 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:00.148936 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:00.149982 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:00.149982 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:00.149982 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:00.149982 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:00.149982 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:00.149982 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:00.149982 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:00.149982 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:00.149982 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:00.149982 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:00.149982 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:58:00.149982 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:00.151078 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 182/355] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:00.155889 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b85d5e3-60df-4907-8e82-faac6920afc1 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:00.161214 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:00.173219 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3332aa-ac68-42ee-8b2b-f7c6fd657146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:00.174656 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3332aa-ac68-42ee-8b2b-f7c6fd657146 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:00.175133 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3332aa-ac68-42ee-8b2b-f7c6fd657146 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:00.175588 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3332aa-ac68-42ee-8b2b-f7c6fd657146 None admin] PATH_INFO: `/v3/groups/1dd23e27a6e74ff9a16348eee36cd9d1` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:00.178610 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3332aa-ac68-42ee-8b2b-f7c6fd657146 None admin] RBAC: Authorizing `identity:get_group(group_id=1dd23e27a6e74ff9a16348eee36cd9d1)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:00.180520 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3332aa-ac68-42ee-8b2b-f7c6fd657146 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:00.184083 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 174/356] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Jun 20 05:57:59 2022] GET /identity/v3/groups/1dd23e27a6e74ff9a16348eee36cd9d1 => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:00.186548 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f6ff6-8299-4cdb-8cb2-42777e227c28 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:00.187147 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f6ff6-8299-4cdb-8cb2-42777e227c28 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:00.187626 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f6ff6-8299-4cdb-8cb2-42777e227c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:00.212914 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-184f6ff6-8299-4cdb-8cb2-42777e227c28 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:00.214640 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-184f6ff6-8299-4cdb-8cb2-42777e227c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:00.283674 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:00.287481 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b85d5e3-60df-4907-8e82-faac6920afc1 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:00.323316 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 175/357] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:58:00.323950 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f6ff6-8299-4cdb-8cb2-42777e227c28 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:00.324458 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d36ad4-2720-4391-8697-1d564d8a2a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:00.325256 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d36ad4-2720-4391-8697-1d564d8a2a8e None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:00.325632 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d36ad4-2720-4391-8697-1d564d8a2a8e None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:00.326000 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d36ad4-2720-4391-8697-1d564d8a2a8e None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:00.326851 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d36ad4-2720-4391-8697-1d564d8a2a8e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:00.327583 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d36ad4-2720-4391-8697-1d564d8a2a8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:00.329076 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d36ad4-2720-4391-8697-1d564d8a2a8e None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:00.339838 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 183/358] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jun 20 05:58:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:00.340817 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d36ad4-2720-4391-8697-1d564d8a2a8e None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:00.436135 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f6ff6-8299-4cdb-8cb2-42777e227c28 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:00.465313 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:00.465585 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d36ad4-2720-4391-8697-1d564d8a2a8e None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:00.476523 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4492df1-4c66-4378-8be8-aa50f740995a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:00.477171 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4492df1-4c66-4378-8be8-aa50f740995a None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:00.477500 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4492df1-4c66-4378-8be8-aa50f740995a None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:00.477777 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4492df1-4c66-4378-8be8-aa50f740995a None admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:00.478757 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4492df1-4c66-4378-8be8-aa50f740995a None admin] RBAC: Adding query filter params (name=member) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:00.478925 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4492df1-4c66-4378-8be8-aa50f740995a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:00.480318 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4492df1-4c66-4378-8be8-aa50f740995a None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:00.491389 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 176/359] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jun 20 05:58:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:00.492053 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4492df1-4c66-4378-8be8-aa50f740995a None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:00.507060 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676d6181-54b3-4596-a8bb-6a9e524058ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:00.507961 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d6181-54b3-4596-a8bb-6a9e524058ce None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:00.508410 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d6181-54b3-4596-a8bb-6a9e524058ce None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:00.508852 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d6181-54b3-4596-a8bb-6a9e524058ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:00.509840 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676d6181-54b3-4596-a8bb-6a9e524058ce None admin] RBAC: Adding query filter params (group.id=1dd23e27a6e74ff9a16348eee36cd9d1, role.id=c34cf84397a64ab0ad2a06daa8e13d88, scope.project.id=852ede50488445d795524cf072c12f7e) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:00.510295 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676d6181-54b3-4596-a8bb-6a9e524058ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:00.512786 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676d6181-54b3-4596-a8bb-6a9e524058ce None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:00.518913 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 184/360] 10.222.0.39 () {56 vars in 1376 bytes} [Mon Jun 20 05:58:00 2022] GET /identity/v3/role_assignments?group.id=1dd23e27a6e74ff9a16348eee36cd9d1&scope.project.id=852ede50488445d795524cf072c12f7e&role.id=c34cf84397a64ab0ad2a06daa8e13d88 => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:00.519882 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676d6181-54b3-4596-a8bb-6a9e524058ce None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:00.556573 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:00.623030 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4492df1-4c66-4378-8be8-aa50f740995a None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:00.666828 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676d6181-54b3-4596-a8bb-6a9e524058ce None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:00.677213 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e6a91-2611-408a-ae91-b7866e14d85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:00.678576 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e6a91-2611-408a-ae91-b7866e14d85e None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:00.679067 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e6a91-2611-408a-ae91-b7866e14d85e None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:00.679534 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e6a91-2611-408a-ae91-b7866e14d85e None admin] PATH_INFO: `/v3/users/c5dccb2093794b89bfdca8f6412afb81` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:00.681025 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e6a91-2611-408a-ae91-b7866e14d85e None admin] RBAC: Authorizing `identity:get_user(user_id=c5dccb2093794b89bfdca8f6412afb81)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:00.682769 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e6a91-2611-408a-ae91-b7866e14d85e None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:00.690326 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 177/361] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jun 20 05:58:00 2022] GET /identity/v3/users/c5dccb2093794b89bfdca8f6412afb81 => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:00.691582 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e6a91-2611-408a-ae91-b7866e14d85e None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:00.734482 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b5316-43de-45b5-a21a-ea31e9684f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:00.735691 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b5316-43de-45b5-a21a-ea31e9684f41 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:00.736192 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b5316-43de-45b5-a21a-ea31e9684f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:00.736662 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b5316-43de-45b5-a21a-ea31e9684f41 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:00.748977 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8b5316-43de-45b5-a21a-ea31e9684f41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:00.757905 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-be8b5316-43de-45b5-a21a-ea31e9684f41 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:58:00.757905 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:00.757905 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:00.757905 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:00.757905 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:00.757905 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:00.757905 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:00.757905 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:00.757905 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:00.757905 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:00.757905 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:00.757905 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:00.757905 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:00.757905 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:00.757905 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:00.757905 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:00.758805 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:00.758805 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:00.758805 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:00.758805 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:00.758805 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:00.758805 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:00.758805 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:00.758805 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:00.758805 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:00.758805 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:00.758805 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:00.758805 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:00.758805 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:00.758805 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:00.758805 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:00.758805 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:00.759596 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:00.759596 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:00.759596 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:00.759596 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:00.759596 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:00.759596 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:00.759596 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:00.759596 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:00.759596 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:00.759596 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:00.759596 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:58:00.759596 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:00.761978 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 185/362] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jun 20 05:58:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:00.768215 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab73911-c0a4-4cb9-ae72-0bb28a1a276f None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:00.768215 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab73911-c0a4-4cb9-ae72-0bb28a1a276f None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:00.768215 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab73911-c0a4-4cb9-ae72-0bb28a1a276f None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:00.768489 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:00.768566 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 186/363] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:58:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:00.769741 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab73911-c0a4-4cb9-ae72-0bb28a1a276f None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:00.838329 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e6a91-2611-408a-ae91-b7866e14d85e None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:00.886281 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd7edb-b768-40b5-919f-6957b5ce7c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:00.887398 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd7edb-b768-40b5-919f-6957b5ce7c7b None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:00.887684 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd7edb-b768-40b5-919f-6957b5ce7c7b None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:00.888018 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd7edb-b768-40b5-919f-6957b5ce7c7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:00.898408 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:00.921537 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab73911-c0a4-4cb9-ae72-0bb28a1a276f None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:00.964015 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4747faa-a0c9-4c21-864c-b491989fb9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:00.964736 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4747faa-a0c9-4c21-864c-b491989fb9f2 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:00.965128 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4747faa-a0c9-4c21-864c-b491989fb9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:00.965409 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4747faa-a0c9-4c21-864c-b491989fb9f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:00.966252 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4747faa-a0c9-4c21-864c-b491989fb9f2 None admin] RBAC: Adding query filter params (role.id=2c6f4a5c6a944218bdf2bc9684eea581, user.id=c5dccb2093794b89bfdca8f6412afb81, scope.system=all) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:00.966565 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4747faa-a0c9-4c21-864c-b491989fb9f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:00.968185 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4747faa-a0c9-4c21-864c-b491989fb9f2 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:00.983604 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 187/364] 10.222.0.39 () {56 vars in 1308 bytes} [Mon Jun 20 05:58:00 2022] GET /identity/v3/role_assignments?user.id=c5dccb2093794b89bfdca8f6412afb81&scope.system=all&role.id=2c6f4a5c6a944218bdf2bc9684eea581 => generated 510 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:00.984457 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4747faa-a0c9-4c21-864c-b491989fb9f2 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:00.984814 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dd7edb-b768-40b5-919f-6957b5ce7c7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:00.986400 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dd7edb-b768-40b5-919f-6957b5ce7c7b None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:01.056563 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:01.109705 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4747faa-a0c9-4c21-864c-b491989fb9f2 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:01.121730 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 178/365] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 05:58:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:58:01.121730 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1cf09-da8a-45b2-8197-863665af5629 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:01.121730 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1cf09-da8a-45b2-8197-863665af5629 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:01.121730 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1cf09-da8a-45b2-8197-863665af5629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:01.146811 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-3fd1cf09-da8a-45b2-8197-863665af5629 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:01.150293 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-3fd1cf09-da8a-45b2-8197-863665af5629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:01.191015 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40e4333-96b1-40bc-914b-4012d4dee82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:01.192898 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e4333-96b1-40bc-914b-4012d4dee82d None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:01.194459 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e4333-96b1-40bc-914b-4012d4dee82d None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:01.196637 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e4333-96b1-40bc-914b-4012d4dee82d None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:01.197714 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40e4333-96b1-40bc-914b-4012d4dee82d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:01.199505 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40e4333-96b1-40bc-914b-4012d4dee82d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:01.201161 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40e4333-96b1-40bc-914b-4012d4dee82d None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:01.224804 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 188/366] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:01.224804 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40e4333-96b1-40bc-914b-4012d4dee82d None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:01.242485 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:01.281828 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 179/367] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:58:01.282494 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1cf09-da8a-45b2-8197-863665af5629 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:01.400834 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:01.423155 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1cf09-da8a-45b2-8197-863665af5629 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:01.424079 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40e4333-96b1-40bc-914b-4012d4dee82d None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:01.467346 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c4bfe-e7f6-4ffe-ac9e-cbf51eb51bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:01.468483 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c4bfe-e7f6-4ffe-ac9e-cbf51eb51bc0 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:01.469132 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c4bfe-e7f6-4ffe-ac9e-cbf51eb51bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:01.469621 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c4bfe-e7f6-4ffe-ac9e-cbf51eb51bc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:01.484472 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d77bc-c04a-4e14-83a0-0ca9ed88ef20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:01.485306 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d77bc-c04a-4e14-83a0-0ca9ed88ef20 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:01.485589 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d77bc-c04a-4e14-83a0-0ca9ed88ef20 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:01.485865 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d77bc-c04a-4e14-83a0-0ca9ed88ef20 None admin] PATH_INFO: `/v3/projects/b5e41057319e4800939cb6fcbdcd1024` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:01.487161 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227d77bc-c04a-4e14-83a0-0ca9ed88ef20 None admin] RBAC: Authorizing `identity:get_project(project_id=b5e41057319e4800939cb6fcbdcd1024)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:01.488721 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227d77bc-c04a-4e14-83a0-0ca9ed88ef20 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:01.491957 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 189/368] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jun 20 05:58:01 2022] GET /identity/v3/projects/b5e41057319e4800939cb6fcbdcd1024 => generated 302 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:01.492987 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d77bc-c04a-4e14-83a0-0ca9ed88ef20 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:01.560740 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862c4bfe-e7f6-4ffe-ac9e-cbf51eb51bc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:01.563211 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862c4bfe-e7f6-4ffe-ac9e-cbf51eb51bc0 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:01.583136 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:01.614886 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d77bc-c04a-4e14-83a0-0ca9ed88ef20 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:01.653363 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab827968-9c1d-47e4-99d7-72beebf41674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:01.654234 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab827968-9c1d-47e4-99d7-72beebf41674 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:01.655642 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab827968-9c1d-47e4-99d7-72beebf41674 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:01.655935 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab827968-9c1d-47e4-99d7-72beebf41674 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:01.669428 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab827968-9c1d-47e4-99d7-72beebf41674 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:01.678477 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-ab827968-9c1d-47e4-99d7-72beebf41674 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:58:01.678477 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:01.678477 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:01.678477 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:01.678477 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:01.678477 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:01.678477 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:01.678477 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:01.678477 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:01.678477 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:01.678477 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:01.678477 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:01.678477 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:01.678477 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:01.678477 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:01.678477 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:01.679402 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:01.679402 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:01.679402 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:01.679402 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:01.679402 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:01.679402 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:01.679402 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:01.679402 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:01.679402 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:01.679402 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:01.679402 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:01.679402 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:01.679402 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:01.679402 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:01.679402 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:01.679402 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:01.680181 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:01.680181 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:01.680181 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:01.680181 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:01.680181 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:01.680181 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:01.680181 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:01.680181 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:01.680181 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:01.680181 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:01.680181 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:58:01.680181 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:01.680181 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 190/369] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jun 20 05:58:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:01.683140 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab827968-9c1d-47e4-99d7-72beebf41674 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:01.683600 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:01.704837 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 180/370] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 05:58:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:58:01.705701 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c4bfe-e7f6-4ffe-ac9e-cbf51eb51bc0 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:01.820212 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab827968-9c1d-47e4-99d7-72beebf41674 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:01.837566 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c4bfe-e7f6-4ffe-ac9e-cbf51eb51bc0 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:01.860186 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7efc373-9b96-43b3-ac3e-85735cb715a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:01.861140 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7efc373-9b96-43b3-ac3e-85735cb715a1 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:01.861429 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7efc373-9b96-43b3-ac3e-85735cb715a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:01.861710 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7efc373-9b96-43b3-ac3e-85735cb715a1 None admin] PATH_INFO: `/v3/groups/1dd23e27a6e74ff9a16348eee36cd9d1` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:01.863041 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7efc373-9b96-43b3-ac3e-85735cb715a1 None admin] RBAC: Authorizing `identity:get_group(group_id=1dd23e27a6e74ff9a16348eee36cd9d1)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:01.864755 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7efc373-9b96-43b3-ac3e-85735cb715a1 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:01.866912 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 191/371] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Jun 20 05:58:01 2022] GET /identity/v3/groups/1dd23e27a6e74ff9a16348eee36cd9d1 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:01.867871 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7efc373-9b96-43b3-ac3e-85735cb715a1 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:01.870880 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:01.884024 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd8921-d9cc-417e-9250-8ed23f1dc615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:01.885173 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd8921-d9cc-417e-9250-8ed23f1dc615 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:01.885741 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd8921-d9cc-417e-9250-8ed23f1dc615 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:01.886219 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd8921-d9cc-417e-9250-8ed23f1dc615 None admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:01.887168 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd8921-d9cc-417e-9250-8ed23f1dc615 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:01.888287 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd8921-d9cc-417e-9250-8ed23f1dc615 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:01.889981 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd8921-d9cc-417e-9250-8ed23f1dc615 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:01.904736 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 181/372] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 05:58:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:01.904736 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd8921-d9cc-417e-9250-8ed23f1dc615 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:01.968908 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:02.007089 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7efc373-9b96-43b3-ac3e-85735cb715a1 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:02.033636 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd8921-d9cc-417e-9250-8ed23f1dc615 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:02.045993 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d4490-b630-444a-b100-f94e101acfc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:02.047043 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d4490-b630-444a-b100-f94e101acfc8 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:02.047423 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d4490-b630-444a-b100-f94e101acfc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:02.048052 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d4490-b630-444a-b100-f94e101acfc8 None admin] PATH_INFO: `/v3/projects/b5e41057319e4800939cb6fcbdcd1024` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:02.049190 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0d4490-b630-444a-b100-f94e101acfc8 None admin] RBAC: Authorizing `identity:get_project(project_id=b5e41057319e4800939cb6fcbdcd1024)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:02.050675 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0d4490-b630-444a-b100-f94e101acfc8 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:02.056071 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 192/373] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jun 20 05:58:01 2022] GET /identity/v3/projects/b5e41057319e4800939cb6fcbdcd1024 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:02.059681 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d4490-b630-444a-b100-f94e101acfc8 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:02.086950 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7477598-653b-4b28-b3e5-791713d01f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:02.087644 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7477598-653b-4b28-b3e5-791713d01f17 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:02.088003 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7477598-653b-4b28-b3e5-791713d01f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:02.088405 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7477598-653b-4b28-b3e5-791713d01f17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:02.091278 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7477598-653b-4b28-b3e5-791713d01f17 None admin] RBAC: Adding query filter params (group.id=1dd23e27a6e74ff9a16348eee36cd9d1, role.id=c34cf84397a64ab0ad2a06daa8e13d88, scope.project.id=b5e41057319e4800939cb6fcbdcd1024) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:02.091680 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7477598-653b-4b28-b3e5-791713d01f17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:02.093426 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7477598-653b-4b28-b3e5-791713d01f17 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:02.101415 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 182/374] 10.222.0.39 () {56 vars in 1376 bytes} [Mon Jun 20 05:58:01 2022] GET /identity/v3/role_assignments?group.id=1dd23e27a6e74ff9a16348eee36cd9d1&scope.project.id=b5e41057319e4800939cb6fcbdcd1024&role.id=c34cf84397a64ab0ad2a06daa8e13d88 => generated 260 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:02.102856 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7477598-653b-4b28-b3e5-791713d01f17 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:02.149173 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:02.204174 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d4490-b630-444a-b100-f94e101acfc8 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:02.241778 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7477598-653b-4b28-b3e5-791713d01f17 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:02.247558 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4107342c-ab39-41a6-949e-a39c44ffa9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:02.248237 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107342c-ab39-41a6-949e-a39c44ffa9a6 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:02.248525 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107342c-ab39-41a6-949e-a39c44ffa9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:02.248879 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107342c-ab39-41a6-949e-a39c44ffa9a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:02.258906 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:02.285605 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ecc64-e80c-4d9f-9c13-63dfa110075d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:02.287374 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ecc64-e80c-4d9f-9c13-63dfa110075d None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:02.287863 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ecc64-e80c-4d9f-9c13-63dfa110075d None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:02.288402 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ecc64-e80c-4d9f-9c13-63dfa110075d None admin] PATH_INFO: `/v3/groups/1dd23e27a6e74ff9a16348eee36cd9d1` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:02.290032 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ecc64-e80c-4d9f-9c13-63dfa110075d None admin] RBAC: Authorizing `identity:get_group(group_id=1dd23e27a6e74ff9a16348eee36cd9d1)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:02.291717 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ecc64-e80c-4d9f-9c13-63dfa110075d None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:02.293851 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 183/375] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Jun 20 05:58:02 2022] GET /identity/v3/groups/1dd23e27a6e74ff9a16348eee36cd9d1 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:02.295383 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6d146-b92a-4cca-980a-95e61b87bc6b None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:02.295888 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6d146-b92a-4cca-980a-95e61b87bc6b None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:02.296355 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6d146-b92a-4cca-980a-95e61b87bc6b None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:02.299223 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 184/376] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:58:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:02.300170 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e6d146-b92a-4cca-980a-95e61b87bc6b None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:02.332521 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4107342c-ab39-41a6-949e-a39c44ffa9a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:02.334121 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4107342c-ab39-41a6-949e-a39c44ffa9a6 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:02.409922 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:02.420309 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e6d146-b92a-4cca-980a-95e61b87bc6b None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:02.451089 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 193/377] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 05:58:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:58:02.456762 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675afc61-958f-46b2-bc90-c2df3f33a08f None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:02.456762 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675afc61-958f-46b2-bc90-c2df3f33a08f None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:02.456762 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675afc61-958f-46b2-bc90-c2df3f33a08f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:02.468424 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fbb34f-f5d9-406a-bf89-79207d2ce829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:02.469541 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbb34f-f5d9-406a-bf89-79207d2ce829 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:02.470019 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbb34f-f5d9-406a-bf89-79207d2ce829 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:02.470521 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbb34f-f5d9-406a-bf89-79207d2ce829 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:02.471553 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fbb34f-f5d9-406a-bf89-79207d2ce829 None admin] RBAC: Adding query filter params (group.id=1dd23e27a6e74ff9a16348eee36cd9d1, role.id=844adf3fdfaf458faa6fcbcf641d4182, scope.project.id=b5e41057319e4800939cb6fcbdcd1024) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:02.472068 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fbb34f-f5d9-406a-bf89-79207d2ce829 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:02.473783 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fbb34f-f5d9-406a-bf89-79207d2ce829 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:02.475557 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-675afc61-958f-46b2-bc90-c2df3f33a08f None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:02.476824 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-675afc61-958f-46b2-bc90-c2df3f33a08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:02.481008 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 185/378] 10.222.0.39 () {56 vars in 1376 bytes} [Mon Jun 20 05:58:02 2022] GET /identity/v3/role_assignments?group.id=1dd23e27a6e74ff9a16348eee36cd9d1&scope.project.id=b5e41057319e4800939cb6fcbdcd1024&role.id=844adf3fdfaf458faa6fcbcf641d4182 => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:02.482067 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fbb34f-f5d9-406a-bf89-79207d2ce829 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:02.535606 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:02.559257 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 194/379] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:58:02.587688 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675afc61-958f-46b2-bc90-c2df3f33a08f None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:02.599411 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fbb34f-f5d9-406a-bf89-79207d2ce829 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:02.638936 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5213f640-e05c-4e5f-b261-15fa5d716c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:02.640196 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213f640-e05c-4e5f-b261-15fa5d716c0c None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:02.640689 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213f640-e05c-4e5f-b261-15fa5d716c0c None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:02.641201 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213f640-e05c-4e5f-b261-15fa5d716c0c None admin] PATH_INFO: `/v3/projects/9e16e10aec7d4a579d849fde0e5b0904` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:02.642669 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5213f640-e05c-4e5f-b261-15fa5d716c0c None admin] RBAC: Authorizing `identity:get_project(project_id=9e16e10aec7d4a579d849fde0e5b0904)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:02.644420 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5213f640-e05c-4e5f-b261-15fa5d716c0c None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:02.647554 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 186/380] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jun 20 05:58:02 2022] GET /identity/v3/projects/9e16e10aec7d4a579d849fde0e5b0904 => generated 344 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:02.653429 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5213f640-e05c-4e5f-b261-15fa5d716c0c None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:02.708593 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:02.712449 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675afc61-958f-46b2-bc90-c2df3f33a08f None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:02.755672 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e092a-6de2-4e87-951e-1263c206de5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:02.755672 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e092a-6de2-4e87-951e-1263c206de5e None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:02.755672 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e092a-6de2-4e87-951e-1263c206de5e None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:02.755672 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e092a-6de2-4e87-951e-1263c206de5e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:02.768437 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e092a-6de2-4e87-951e-1263c206de5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:02.774714 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5213f640-e05c-4e5f-b261-15fa5d716c0c None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:02.778890 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-6c5e092a-6de2-4e87-951e-1263c206de5e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:58:02.778890 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:02.778890 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:02.778890 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:02.778890 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:02.778890 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:02.778890 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:02.778890 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:02.778890 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:02.778890 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:02.778890 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:02.778890 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:02.778890 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:02.778890 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:02.778890 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:02.778890 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:02.779800 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:02.779800 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:02.779800 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:02.779800 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:02.779800 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:02.779800 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:02.779800 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:02.779800 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:02.779800 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:02.779800 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:02.779800 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:02.779800 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:02.779800 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:02.779800 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:02.779800 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:02.779800 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:02.780572 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:02.780572 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:02.780572 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:02.780572 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:02.780572 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:02.780572 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:02.780572 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:02.780572 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:02.780572 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:02.780572 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:02.780572 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:58:02.780572 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:02.784813 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 195/381] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jun 20 05:58:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:02.786606 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e092a-6de2-4e87-951e-1263c206de5e None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:02.797428 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:02.874006 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71887080-fef0-4ac5-aeda-42352716f416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:02.874895 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71887080-fef0-4ac5-aeda-42352716f416 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:02.875180 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71887080-fef0-4ac5-aeda-42352716f416 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:02.875456 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71887080-fef0-4ac5-aeda-42352716f416 None admin] PATH_INFO: `/v3/groups/0b7f1fdaa3094dc385e54c0193140a34` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:02.894187 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71887080-fef0-4ac5-aeda-42352716f416 None admin] RBAC: Authorizing `identity:get_group(group_id=0b7f1fdaa3094dc385e54c0193140a34)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:02.895751 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71887080-fef0-4ac5-aeda-42352716f416 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:02.897835 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 187/382] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Jun 20 05:58:02 2022] GET /identity/v3/groups/0b7f1fdaa3094dc385e54c0193140a34 => generated 229 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:58:02.902626 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e092a-6de2-4e87-951e-1263c206de5e None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:02.905628 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71887080-fef0-4ac5-aeda-42352716f416 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:02.940552 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391d2ac-e143-4863-8986-94572185e56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:02.941282 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391d2ac-e143-4863-8986-94572185e56f None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:02.941571 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391d2ac-e143-4863-8986-94572185e56f None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:02.941848 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391d2ac-e143-4863-8986-94572185e56f None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:02.943183 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3391d2ac-e143-4863-8986-94572185e56f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:02.943553 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3391d2ac-e143-4863-8986-94572185e56f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:02.945072 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3391d2ac-e143-4863-8986-94572185e56f None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:02.956819 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 196/383] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:02.960766 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391d2ac-e143-4863-8986-94572185e56f None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:02.992411 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:03.074455 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391d2ac-e143-4863-8986-94572185e56f None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:03.096768 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71887080-fef0-4ac5-aeda-42352716f416 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:03.115822 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f427ae03-6d57-452f-9515-7ab7fd373c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:03.116720 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427ae03-6d57-452f-9515-7ab7fd373c27 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:03.117006 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427ae03-6d57-452f-9515-7ab7fd373c27 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:03.117284 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427ae03-6d57-452f-9515-7ab7fd373c27 None admin] PATH_INFO: `/v3/groups/1dd23e27a6e74ff9a16348eee36cd9d1` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:03.118496 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f427ae03-6d57-452f-9515-7ab7fd373c27 None admin] RBAC: Authorizing `identity:get_group(group_id=1dd23e27a6e74ff9a16348eee36cd9d1)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:03.119945 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f427ae03-6d57-452f-9515-7ab7fd373c27 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:03.121912 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 197/384] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Jun 20 05:58:02 2022] GET /identity/v3/groups/1dd23e27a6e74ff9a16348eee36cd9d1 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:03.127376 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0c3d8-64ea-4d07-b067-e839bbe79d0d None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:03.127670 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0c3d8-64ea-4d07-b067-e839bbe79d0d None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:03.127954 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0c3d8-64ea-4d07-b067-e839bbe79d0d None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:03.130026 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 198/385] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:58:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:03.131054 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b0c3d8-64ea-4d07-b067-e839bbe79d0d None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:03.149265 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db6425f-3658-437d-95c6-43da32f839a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:03.151034 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6425f-3658-437d-95c6-43da32f839a8 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:03.151520 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6425f-3658-437d-95c6-43da32f839a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:03.152230 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6425f-3658-437d-95c6-43da32f839a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:03.153547 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db6425f-3658-437d-95c6-43da32f839a8 None admin] RBAC: Adding query filter params (group.id=0b7f1fdaa3094dc385e54c0193140a34, role.id=5a64bd8372704de98e75436ff69e46b3, scope.project.id=9e16e10aec7d4a579d849fde0e5b0904) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:03.154451 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db6425f-3658-437d-95c6-43da32f839a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:03.156084 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db6425f-3658-437d-95c6-43da32f839a8 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:03.165357 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 188/386] 10.222.0.39 () {56 vars in 1376 bytes} [Mon Jun 20 05:58:02 2022] GET /identity/v3/role_assignments?group.id=0b7f1fdaa3094dc385e54c0193140a34&scope.project.id=9e16e10aec7d4a579d849fde0e5b0904&role.id=5a64bd8372704de98e75436ff69e46b3 => generated 260 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:03.166690 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1fefa7-ac61-4f7d-be37-3001824af403 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:03.166979 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1fefa7-ac61-4f7d-be37-3001824af403 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:03.167256 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1fefa7-ac61-4f7d-be37-3001824af403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:03.186007 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-6c1fefa7-ac61-4f7d-be37-3001824af403 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:03.187410 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-6c1fefa7-ac61-4f7d-be37-3001824af403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:03.231598 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:03.274009 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 189/387] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:58:03.290816 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:03.304722 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1fefa7-ac61-4f7d-be37-3001824af403 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:03.309950 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b0c3d8-64ea-4d07-b067-e839bbe79d0d None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:03.379239 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ae5bc-8b50-47af-b5a7-3947b0cad50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:03.380834 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ae5bc-8b50-47af-b5a7-3947b0cad50f None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:03.381319 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ae5bc-8b50-47af-b5a7-3947b0cad50f None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:03.381882 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ae5bc-8b50-47af-b5a7-3947b0cad50f None admin] PATH_INFO: `/v3/projects/852ede50488445d795524cf072c12f7e` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:03.383845 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574ae5bc-8b50-47af-b5a7-3947b0cad50f None admin] RBAC: Authorizing `identity:get_project(project_id=852ede50488445d795524cf072c12f7e)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:03.385619 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574ae5bc-8b50-47af-b5a7-3947b0cad50f None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:03.387951 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 199/388] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jun 20 05:58:03 2022] GET /identity/v3/projects/852ede50488445d795524cf072c12f7e => generated 298 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:58:03.394204 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ae5bc-8b50-47af-b5a7-3947b0cad50f None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:03.473991 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1fefa7-ac61-4f7d-be37-3001824af403 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:03.538851 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5fa28d-27eb-4439-afd3-64a0d56bab49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:03.539580 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fa28d-27eb-4439-afd3-64a0d56bab49 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:03.539864 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fa28d-27eb-4439-afd3-64a0d56bab49 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:03.540138 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fa28d-27eb-4439-afd3-64a0d56bab49 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:03.558719 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5fa28d-27eb-4439-afd3-64a0d56bab49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:03.574587 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-1f5fa28d-27eb-4439-afd3-64a0d56bab49 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:58:03.574587 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:03.574587 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:03.574587 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:03.574587 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:03.574587 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:03.574587 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:03.574587 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:03.574587 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:03.574587 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:03.574587 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:03.574587 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:03.574587 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:03.574587 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:03.574587 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:03.574587 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:03.575525 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:03.575525 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:03.575525 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:03.575525 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:03.575525 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:03.575525 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:03.575525 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:03.575525 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:03.575525 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:03.575525 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:03.575525 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:03.575525 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:03.575525 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:03.575525 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:03.575525 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:03.575525 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:03.576290 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:03.576290 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:03.576290 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:03.576290 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:03.576290 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:03.576290 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:03.576290 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:03.576290 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:03.576290 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:03.576290 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:03.576290 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:58:03.576290 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:03.582029 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 190/389] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 05:58:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:03.589954 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5fa28d-27eb-4439-afd3-64a0d56bab49 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:03.600633 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ae5bc-8b50-47af-b5a7-3947b0cad50f None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:03.647674 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:03.666904 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7731783-0c05-4de8-8306-b6a4f1e227ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:03.667785 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7731783-0c05-4de8-8306-b6a4f1e227ed None admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:03.668064 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7731783-0c05-4de8-8306-b6a4f1e227ed None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:03.668335 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7731783-0c05-4de8-8306-b6a4f1e227ed None admin] PATH_INFO: `/v3/projects/852ede50488445d795524cf072c12f7e/groups/1dd23e27a6e74ff9a16348eee36cd9d1/roles/844adf3fdfaf458faa6fcbcf641d4182` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:03.672552 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7731783-0c05-4de8-8306-b6a4f1e227ed None admin] RBAC: Authorizing `identity:create_grant(project_id=852ede50488445d795524cf072c12f7e, group_id=1dd23e27a6e74ff9a16348eee36cd9d1, role_id=844adf3fdfaf458faa6fcbcf641d4182)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:03.674075 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7731783-0c05-4de8-8306-b6a4f1e227ed None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:03.697996 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 200/390] 10.222.0.39 () {58 vars in 1442 bytes} [Mon Jun 20 05:58:03 2022] PUT /identity/v3/projects/852ede50488445d795524cf072c12f7e/groups/1dd23e27a6e74ff9a16348eee36cd9d1/roles/844adf3fdfaf458faa6fcbcf641d4182 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 05:58:03.751844 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5fa28d-27eb-4439-afd3-64a0d56bab49 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:03.794623 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91948cc-5e1f-474e-bf9e-29a647305894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:03.795275 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91948cc-5e1f-474e-bf9e-29a647305894 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:03.795562 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91948cc-5e1f-474e-bf9e-29a647305894 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:03.795833 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91948cc-5e1f-474e-bf9e-29a647305894 None admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:03.796644 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91948cc-5e1f-474e-bf9e-29a647305894 None admin] RBAC: Adding query filter params (name=member) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:03.797013 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91948cc-5e1f-474e-bf9e-29a647305894 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:03.798446 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91948cc-5e1f-474e-bf9e-29a647305894 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:03.809075 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 191/391] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jun 20 05:58:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:03.817974 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7731783-0c05-4de8-8306-b6a4f1e227ed None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:03.852349 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:03.949537 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7731783-0c05-4de8-8306-b6a4f1e227ed None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:03.985536 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7762c48-138c-40b5-8d92-9c304545d6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:03.986401 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7762c48-138c-40b5-8d92-9c304545d6a6 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:03.986678 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7762c48-138c-40b5-8d92-9c304545d6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:03.986951 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7762c48-138c-40b5-8d92-9c304545d6a6 None admin] PATH_INFO: `/v3/groups/1dd23e27a6e74ff9a16348eee36cd9d1` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:03.988146 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7762c48-138c-40b5-8d92-9c304545d6a6 None admin] RBAC: Authorizing `identity:get_group(group_id=1dd23e27a6e74ff9a16348eee36cd9d1)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:03.990328 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7762c48-138c-40b5-8d92-9c304545d6a6 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:03.992276 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 201/392] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Jun 20 05:58:03 2022] GET /identity/v3/groups/1dd23e27a6e74ff9a16348eee36cd9d1 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:03.997664 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91948cc-5e1f-474e-bf9e-29a647305894 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:04.125421 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:04.144572 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91948cc-5e1f-474e-bf9e-29a647305894 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:04.191768 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bddd910-cc51-4475-b6dd-99345dc7be1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:04.193455 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bddd910-cc51-4475-b6dd-99345dc7be1a None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:04.193654 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bddd910-cc51-4475-b6dd-99345dc7be1a None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:04.193926 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bddd910-cc51-4475-b6dd-99345dc7be1a None admin] PATH_INFO: `/v3/projects/852ede50488445d795524cf072c12f7e` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:04.201628 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bddd910-cc51-4475-b6dd-99345dc7be1a None admin] RBAC: Authorizing `identity:get_project(project_id=852ede50488445d795524cf072c12f7e)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:04.203768 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bddd910-cc51-4475-b6dd-99345dc7be1a None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:04.205837 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 192/393] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jun 20 05:58:03 2022] GET /identity/v3/projects/852ede50488445d795524cf072c12f7e => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:04.212472 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7762c48-138c-40b5-8d92-9c304545d6a6 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:04.330958 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:04.349072 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7762c48-138c-40b5-8d92-9c304545d6a6 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:04.390411 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cafc47a-2ee8-4b0a-9508-e011d077ed79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:04.391238 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafc47a-2ee8-4b0a-9508-e011d077ed79 None admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:04.391519 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafc47a-2ee8-4b0a-9508-e011d077ed79 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:04.391793 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafc47a-2ee8-4b0a-9508-e011d077ed79 None admin] PATH_INFO: `/v3/projects/852ede50488445d795524cf072c12f7e/groups/1dd23e27a6e74ff9a16348eee36cd9d1/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:04.393832 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cafc47a-2ee8-4b0a-9508-e011d077ed79 None admin] RBAC: Authorizing `identity:create_grant(project_id=852ede50488445d795524cf072c12f7e, group_id=1dd23e27a6e74ff9a16348eee36cd9d1, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:04.395988 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cafc47a-2ee8-4b0a-9508-e011d077ed79 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:04.422545 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 202/394] 10.222.0.39 () {58 vars in 1442 bytes} [Mon Jun 20 05:58:04 2022] PUT /identity/v3/projects/852ede50488445d795524cf072c12f7e/groups/1dd23e27a6e74ff9a16348eee36cd9d1/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:58:04.671218 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e86325-e105-4a35-9e2a-43c8f5c7c44e None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:04.671559 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e86325-e105-4a35-9e2a-43c8f5c7c44e None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:04.671737 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e86325-e105-4a35-9e2a-43c8f5c7c44e None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:04.673245 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 193/395] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:58:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:04.680275 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8c067-c9bd-4adc-a062-dff2bd3b4200 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:04.680870 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8c067-c9bd-4adc-a062-dff2bd3b4200 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:04.681353 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8c067-c9bd-4adc-a062-dff2bd3b4200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:04.702858 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-0ee8c067-c9bd-4adc-a062-dff2bd3b4200 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:04.704483 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-0ee8c067-c9bd-4adc-a062-dff2bd3b4200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:04.788726 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 203/396] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:58:04.825003 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e86325-e105-4a35-9e2a-43c8f5c7c44e None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:04.969394 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e86325-e105-4a35-9e2a-43c8f5c7c44e None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:05.011730 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a1c94-a645-416e-b97b-665e0804c65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:05.012540 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a1c94-a645-416e-b97b-665e0804c65c None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:05.012853 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a1c94-a645-416e-b97b-665e0804c65c None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:05.013132 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a1c94-a645-416e-b97b-665e0804c65c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:05.024670 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961a1c94-a645-416e-b97b-665e0804c65c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:05.032574 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-961a1c94-a645-416e-b97b-665e0804c65c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:58:05.032574 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:05.032574 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:05.032574 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:05.032574 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:05.032574 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:05.032574 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:05.032574 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:05.032574 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:05.032574 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:05.032574 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:05.032574 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:05.032574 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:05.032574 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:05.032574 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:05.032574 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:05.033488 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:05.033488 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:05.033488 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:05.033488 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:05.033488 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:05.033488 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:05.033488 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:05.033488 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:05.033488 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:05.033488 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:05.033488 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:05.033488 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:05.033488 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:05.033488 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:05.033488 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:05.033488 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:05.034357 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:05.034357 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:05.034357 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:05.034357 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:05.034357 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:05.034357 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:05.034357 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:05.034357 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:05.034357 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:05.034357 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:05.034357 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:58:05.034357 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:05.036437 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 194/397] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 05:58:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:05.041800 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee8c067-c9bd-4adc-a062-dff2bd3b4200 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:05.169050 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:05.194967 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee8c067-c9bd-4adc-a062-dff2bd3b4200 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:05.241381 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fce59c-267a-4050-8012-e68be122a3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:05.241972 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fce59c-267a-4050-8012-e68be122a3f7 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:05.242256 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fce59c-267a-4050-8012-e68be122a3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:05.242526 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fce59c-267a-4050-8012-e68be122a3f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:05.243271 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fce59c-267a-4050-8012-e68be122a3f7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:05.243574 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fce59c-267a-4050-8012-e68be122a3f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:05.244960 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fce59c-267a-4050-8012-e68be122a3f7 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:05.256591 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 204/398] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jun 20 05:58:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:58:05.262150 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a1c94-a645-416e-b97b-665e0804c65c None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:05.306214 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:05.404135 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2faeaa-5f3c-4708-a757-e520465329ba None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:05.404648 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2faeaa-5f3c-4708-a757-e520465329ba None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:05.404648 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2faeaa-5f3c-4708-a757-e520465329ba None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:05.406353 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 205/399] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:58:05.419760 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978c2a4-daab-40fb-9a46-bfcc815333ed None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:05.420043 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978c2a4-daab-40fb-9a46-bfcc815333ed None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:05.420321 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978c2a4-daab-40fb-9a46-bfcc815333ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:05.430707 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a1c94-a645-416e-b97b-665e0804c65c None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:05.464732 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-2978c2a4-daab-40fb-9a46-bfcc815333ed None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:05.464732 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-2978c2a4-daab-40fb-9a46-bfcc815333ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:05.497523 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0d4ea-533f-45c1-9f9d-b2e5c5558aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:05.498427 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0d4ea-533f-45c1-9f9d-b2e5c5558aac None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:05.498718 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0d4ea-533f-45c1-9f9d-b2e5c5558aac None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:05.499003 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0d4ea-533f-45c1-9f9d-b2e5c5558aac None admin] PATH_INFO: `/v3/groups/1dd23e27a6e74ff9a16348eee36cd9d1` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:05.500341 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d0d4ea-533f-45c1-9f9d-b2e5c5558aac None admin] RBAC: Authorizing `identity:get_group(group_id=1dd23e27a6e74ff9a16348eee36cd9d1)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:05.502048 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d0d4ea-533f-45c1-9f9d-b2e5c5558aac None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:05.504132 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 195/400] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Jun 20 05:58:05 2022] GET /identity/v3/groups/1dd23e27a6e74ff9a16348eee36cd9d1 => generated 226 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:05.518029 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0d4ea-533f-45c1-9f9d-b2e5c5558aac None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:05.570605 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 206/401] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:58:05.604860 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2978c2a4-daab-40fb-9a46-bfcc815333ed None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:05.646026 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:05.669581 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0d4ea-533f-45c1-9f9d-b2e5c5558aac None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:05.716397 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b38f2-7b32-4e8a-bb70-2387f6945ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:05.717310 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b38f2-7b32-4e8a-bb70-2387f6945ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:05.717594 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b38f2-7b32-4e8a-bb70-2387f6945ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:05.717873 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b38f2-7b32-4e8a-bb70-2387f6945ab7 None admin] PATH_INFO: `/v3/projects/b5e41057319e4800939cb6fcbdcd1024` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:05.719302 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:05.719685 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308b38f2-7b32-4e8a-bb70-2387f6945ab7 None admin] RBAC: Authorizing `identity:get_project(project_id=b5e41057319e4800939cb6fcbdcd1024)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:05.721683 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308b38f2-7b32-4e8a-bb70-2387f6945ab7 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:05.733114 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 196/402] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jun 20 05:58:05 2022] GET /identity/v3/projects/b5e41057319e4800939cb6fcbdcd1024 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:05.734029 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b38f2-7b32-4e8a-bb70-2387f6945ab7 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:05.756816 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2978c2a4-daab-40fb-9a46-bfcc815333ed None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:05.817650 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2551a-84a1-4588-9346-aad78aa24c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:05.818857 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2551a-84a1-4588-9346-aad78aa24c09 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:05.819334 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2551a-84a1-4588-9346-aad78aa24c09 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:05.819822 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2551a-84a1-4588-9346-aad78aa24c09 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:05.857618 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d2551a-84a1-4588-9346-aad78aa24c09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:05.866112 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-17d2551a-84a1-4588-9346-aad78aa24c09 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:58:05.866112 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:05.866112 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:05.866112 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:05.866112 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:05.866112 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:05.866112 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:05.866112 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:05.866112 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:05.866112 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:05.866112 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:05.866112 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:05.866112 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:05.866112 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:05.866112 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:05.866112 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:05.867159 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:05.867159 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:05.867159 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:05.867159 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:05.867159 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:05.867159 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:05.867159 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:05.867159 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:05.867159 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:05.867159 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:05.867159 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:05.867159 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:05.867159 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:05.867159 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:05.867159 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:05.867159 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:05.868166 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:05.868166 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:05.868166 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:05.868166 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:05.868166 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:05.868166 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:05.868166 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:05.868166 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:05.868166 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:05.868166 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:05.868166 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:58:05.868166 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:05.870485 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 207/403] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jun 20 05:58:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:58:05.876401 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2551a-84a1-4588-9346-aad78aa24c09 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:05.893092 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b38f2-7b32-4e8a-bb70-2387f6945ab7 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:05.958662 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff46cbf-95d8-46ae-8a84-f35eb8ffb5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:05.959562 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff46cbf-95d8-46ae-8a84-f35eb8ffb5b4 None admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:05.959846 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff46cbf-95d8-46ae-8a84-f35eb8ffb5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:05.960124 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff46cbf-95d8-46ae-8a84-f35eb8ffb5b4 None admin] PATH_INFO: `/v3/projects/b5e41057319e4800939cb6fcbdcd1024/groups/1dd23e27a6e74ff9a16348eee36cd9d1/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:05.962147 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff46cbf-95d8-46ae-8a84-f35eb8ffb5b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=b5e41057319e4800939cb6fcbdcd1024, group_id=1dd23e27a6e74ff9a16348eee36cd9d1, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:05.963585 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff46cbf-95d8-46ae-8a84-f35eb8ffb5b4 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:05.980210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 197/404] 10.222.0.39 () {58 vars in 1442 bytes} [Mon Jun 20 05:58:05 2022] PUT /identity/v3/projects/b5e41057319e4800939cb6fcbdcd1024/groups/1dd23e27a6e74ff9a16348eee36cd9d1/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:58:05.982977 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e4c13-c217-4201-a455-5c22e9db904b None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:05.982977 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e4c13-c217-4201-a455-5c22e9db904b None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:05.982977 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e4c13-c217-4201-a455-5c22e9db904b None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:05.984795 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 198/405] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:05.990218 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960a05d-6011-46da-9a05-46f84a75d139 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:05.990528 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960a05d-6011-46da-9a05-46f84a75d139 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:05.990785 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960a05d-6011-46da-9a05-46f84a75d139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:06.011398 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-4960a05d-6011-46da-9a05-46f84a75d139 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:06.013155 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-4960a05d-6011-46da-9a05-46f84a75d139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:06.027455 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2551a-84a1-4588-9346-aad78aa24c09 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:06.028061 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:06.057353 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:06.084383 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb232c4-00e0-4ed9-bc37-d323f61e92f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:06.085506 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb232c4-00e0-4ed9-bc37-d323f61e92f4 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:06.087573 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb232c4-00e0-4ed9-bc37-d323f61e92f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:06.088299 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb232c4-00e0-4ed9-bc37-d323f61e92f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:06.091122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb232c4-00e0-4ed9-bc37-d323f61e92f4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:06.091737 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb232c4-00e0-4ed9-bc37-d323f61e92f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:06.093465 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb232c4-00e0-4ed9-bc37-d323f61e92f4 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:06.115186 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 208/406] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:06.120447 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb232c4-00e0-4ed9-bc37-d323f61e92f4 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:06.168869 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 199/407] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:58:06.218437 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4960a05d-6011-46da-9a05-46f84a75d139 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:06.267556 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb232c4-00e0-4ed9-bc37-d323f61e92f4 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:06.311005 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8601df7-3398-46b9-9665-ce5c28617a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:06.313560 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8601df7-3398-46b9-9665-ce5c28617a73 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:06.314086 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8601df7-3398-46b9-9665-ce5c28617a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:06.314567 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8601df7-3398-46b9-9665-ce5c28617a73 None admin] PATH_INFO: `/v3/groups/1dd23e27a6e74ff9a16348eee36cd9d1` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:06.315976 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8601df7-3398-46b9-9665-ce5c28617a73 None admin] RBAC: Authorizing `identity:get_group(group_id=1dd23e27a6e74ff9a16348eee36cd9d1)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:06.318355 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8601df7-3398-46b9-9665-ce5c28617a73 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:06.321551 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 209/408] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Jun 20 05:58:06 2022] GET /identity/v3/groups/1dd23e27a6e74ff9a16348eee36cd9d1 => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:58:06.329931 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8601df7-3398-46b9-9665-ce5c28617a73 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:06.357395 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4960a05d-6011-46da-9a05-46f84a75d139 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:06.433311 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d4bb1b-e2cf-438d-b2c5-47382597a743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:06.434519 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d4bb1b-e2cf-438d-b2c5-47382597a743 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:06.435012 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d4bb1b-e2cf-438d-b2c5-47382597a743 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:06.435645 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d4bb1b-e2cf-438d-b2c5-47382597a743 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:06.437637 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:06.453889 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d4bb1b-e2cf-438d-b2c5-47382597a743 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:06.474618 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-40d4bb1b-e2cf-438d-b2c5-47382597a743 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:58:06.474618 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:06.474618 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:06.474618 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:06.474618 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:06.474618 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:06.474618 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:06.474618 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:06.474618 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:06.474618 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:06.474618 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:06.474618 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:06.474618 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:06.474618 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:06.474618 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:06.474618 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:06.475537 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:06.475537 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:06.475537 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:06.475537 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:06.475537 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:06.475537 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:06.475537 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:06.475537 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:06.475537 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:06.475537 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:06.475537 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:06.475537 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:06.475537 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:06.475537 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:06.475537 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:06.475537 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:06.476324 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:06.476324 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:06.476324 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:06.476324 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:06.476324 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:06.476324 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:06.476324 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:06.476324 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:06.476324 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:06.476324 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:06.476324 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:58:06.476324 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:06.476324 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 200/409] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jun 20 05:58:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:58:06.488941 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d4bb1b-e2cf-438d-b2c5-47382597a743 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:06.513513 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8601df7-3398-46b9-9665-ce5c28617a73 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:06.519376 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:06.577206 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a452bb43-4a48-4fe6-a4e7-ef51022d95c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:06.578086 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452bb43-4a48-4fe6-a4e7-ef51022d95c3 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:06.578370 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452bb43-4a48-4fe6-a4e7-ef51022d95c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:06.578648 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452bb43-4a48-4fe6-a4e7-ef51022d95c3 None admin] PATH_INFO: `/v3/projects/b5e41057319e4800939cb6fcbdcd1024` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:06.583489 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a452bb43-4a48-4fe6-a4e7-ef51022d95c3 None admin] RBAC: Authorizing `identity:get_project(project_id=b5e41057319e4800939cb6fcbdcd1024)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:06.585104 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a452bb43-4a48-4fe6-a4e7-ef51022d95c3 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:06.587240 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 210/410] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jun 20 05:58:06 2022] GET /identity/v3/projects/b5e41057319e4800939cb6fcbdcd1024 => generated 302 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:06.592528 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a452bb43-4a48-4fe6-a4e7-ef51022d95c3 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:06.715774 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d4bb1b-e2cf-438d-b2c5-47382597a743 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:06.729124 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a452bb43-4a48-4fe6-a4e7-ef51022d95c3 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:06.755745 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88933608-a5eb-4067-975c-56543251432b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:06.756495 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:06.757639 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88933608-a5eb-4067-975c-56543251432b None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:06.758273 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88933608-a5eb-4067-975c-56543251432b None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:06.758767 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88933608-a5eb-4067-975c-56543251432b None admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:06.759692 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88933608-a5eb-4067-975c-56543251432b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:06.760166 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88933608-a5eb-4067-975c-56543251432b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:06.762075 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88933608-a5eb-4067-975c-56543251432b None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:06.776968 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 201/411] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 05:58:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:06.779361 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88933608-a5eb-4067-975c-56543251432b None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:06.785979 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449026fb-fe9c-403d-a32d-d009136e161d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:06.786886 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449026fb-fe9c-403d-a32d-d009136e161d None admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:06.787167 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449026fb-fe9c-403d-a32d-d009136e161d None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:06.787440 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449026fb-fe9c-403d-a32d-d009136e161d None admin] PATH_INFO: `/v3/projects/b5e41057319e4800939cb6fcbdcd1024/groups/1dd23e27a6e74ff9a16348eee36cd9d1/roles/844adf3fdfaf458faa6fcbcf641d4182` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:06.793548 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449026fb-fe9c-403d-a32d-d009136e161d None admin] RBAC: Authorizing `identity:create_grant(project_id=b5e41057319e4800939cb6fcbdcd1024, group_id=1dd23e27a6e74ff9a16348eee36cd9d1, role_id=844adf3fdfaf458faa6fcbcf641d4182)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:06.794963 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449026fb-fe9c-403d-a32d-d009136e161d None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:06.819549 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 211/412] 10.222.0.39 () {58 vars in 1442 bytes} [Mon Jun 20 05:58:06 2022] PUT /identity/v3/projects/b5e41057319e4800939cb6fcbdcd1024/groups/1dd23e27a6e74ff9a16348eee36cd9d1/roles/844adf3fdfaf458faa6fcbcf641d4182 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:58:06.820932 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9a8b8-38b6-415a-84aa-742914cde31e None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:06.821213 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9a8b8-38b6-415a-84aa-742914cde31e None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:06.821489 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9a8b8-38b6-415a-84aa-742914cde31e None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:06.823087 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 212/413] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:58:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:06.828958 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690f76a-2739-4c55-ba7b-58a9fc912a79 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:06.829264 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690f76a-2739-4c55-ba7b-58a9fc912a79 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:06.829519 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690f76a-2739-4c55-ba7b-58a9fc912a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:06.867506 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:06.878076 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-5690f76a-2739-4c55-ba7b-58a9fc912a79 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:06.880343 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-5690f76a-2739-4c55-ba7b-58a9fc912a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:06.910869 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88933608-a5eb-4067-975c-56543251432b None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:06.949817 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ddf4c-dc3c-448c-9715-dff0ffbc212c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:06.951367 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ddf4c-dc3c-448c-9715-dff0ffbc212c None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:06.952107 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ddf4c-dc3c-448c-9715-dff0ffbc212c None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:06.952584 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ddf4c-dc3c-448c-9715-dff0ffbc212c None admin] PATH_INFO: `/v3/groups/0b7f1fdaa3094dc385e54c0193140a34` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:06.954203 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4ddf4c-dc3c-448c-9715-dff0ffbc212c None admin] RBAC: Authorizing `identity:get_group(group_id=0b7f1fdaa3094dc385e54c0193140a34)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:06.955891 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4ddf4c-dc3c-448c-9715-dff0ffbc212c None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:06.963494 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 202/414] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Jun 20 05:58:06 2022] GET /identity/v3/groups/0b7f1fdaa3094dc385e54c0193140a34 => generated 229 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:06.965317 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ddf4c-dc3c-448c-9715-dff0ffbc212c None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:07.023347 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 213/415] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:58:07.045757 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5690f76a-2739-4c55-ba7b-58a9fc912a79 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:07.078277 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ddf4c-dc3c-448c-9715-dff0ffbc212c None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:07.118275 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c85873-667b-4975-9fd6-57c416fa4056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:07.119602 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c85873-667b-4975-9fd6-57c416fa4056 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:07.120091 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c85873-667b-4975-9fd6-57c416fa4056 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:07.120593 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c85873-667b-4975-9fd6-57c416fa4056 None admin] PATH_INFO: `/v3/projects/9e16e10aec7d4a579d849fde0e5b0904` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:07.122038 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c85873-667b-4975-9fd6-57c416fa4056 None admin] RBAC: Authorizing `identity:get_project(project_id=9e16e10aec7d4a579d849fde0e5b0904)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:07.123857 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c85873-667b-4975-9fd6-57c416fa4056 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:07.130494 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 203/416] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jun 20 05:58:06 2022] GET /identity/v3/projects/9e16e10aec7d4a579d849fde0e5b0904 => generated 344 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:07.132499 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c85873-667b-4975-9fd6-57c416fa4056 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:07.136863 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:07.158165 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5690f76a-2739-4c55-ba7b-58a9fc912a79 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:07.182573 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:07.206484 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d9a10f-79d8-470a-962f-874011bdd8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:07.208870 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9a10f-79d8-470a-962f-874011bdd8ba None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:07.209486 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9a10f-79d8-470a-962f-874011bdd8ba None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:07.210053 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9a10f-79d8-470a-962f-874011bdd8ba None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:07.225351 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d9a10f-79d8-470a-962f-874011bdd8ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:07.235844 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-32d9a10f-79d8-470a-962f-874011bdd8ba None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:58:07.235844 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:07.235844 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:07.235844 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:07.235844 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:07.235844 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:07.235844 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:07.235844 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:07.235844 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:07.235844 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:07.235844 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:07.235844 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:07.235844 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:07.235844 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:07.235844 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:07.235844 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:07.236793 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:07.236793 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:07.236793 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:07.236793 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:07.236793 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:07.236793 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:07.236793 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:07.236793 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:07.236793 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:07.236793 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:07.236793 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:07.236793 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:07.236793 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:07.236793 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:07.236793 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:07.236793 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:07.237601 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:07.237601 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:07.237601 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:07.237601 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:07.237601 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:07.237601 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:07.237601 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:07.237601 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:07.237601 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:07.237601 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:07.237601 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:58:07.237601 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:07.239672 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 214/417] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jun 20 05:58:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:58:07.241305 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4861b76-ae3e-4569-b38a-5881948d7e79 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:07.241790 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4861b76-ae3e-4569-b38a-5881948d7e79 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:07.242521 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4861b76-ae3e-4569-b38a-5881948d7e79 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:07.244718 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 215/418] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:58:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:07.245626 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4861b76-ae3e-4569-b38a-5881948d7e79 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:07.259752 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c85873-667b-4975-9fd6-57c416fa4056 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:07.296253 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c478715d-bae8-47ac-8779-64ffe3203c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:07.297104 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478715d-bae8-47ac-8779-64ffe3203c01 None admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:07.297392 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478715d-bae8-47ac-8779-64ffe3203c01 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:07.297673 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478715d-bae8-47ac-8779-64ffe3203c01 None admin] PATH_INFO: `/v3/projects/9e16e10aec7d4a579d849fde0e5b0904/groups/0b7f1fdaa3094dc385e54c0193140a34/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:07.299659 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c478715d-bae8-47ac-8779-64ffe3203c01 None admin] RBAC: Authorizing `identity:create_grant(project_id=9e16e10aec7d4a579d849fde0e5b0904, group_id=0b7f1fdaa3094dc385e54c0193140a34, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:07.301374 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c478715d-bae8-47ac-8779-64ffe3203c01 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:07.324802 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 204/419] 10.222.0.39 () {58 vars in 1442 bytes} [Mon Jun 20 05:58:07 2022] PUT /identity/v3/projects/9e16e10aec7d4a579d849fde0e5b0904/groups/0b7f1fdaa3094dc385e54c0193140a34/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 05:58:07.328212 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e123c4-2f9c-4d35-91b9-ccde27920206 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:07.328985 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e123c4-2f9c-4d35-91b9-ccde27920206 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:07.330846 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e123c4-2f9c-4d35-91b9-ccde27920206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:07.368299 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-e5e123c4-2f9c-4d35-91b9-ccde27920206 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:07.372810 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-e5e123c4-2f9c-4d35-91b9-ccde27920206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:07.432400 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4861b76-ae3e-4569-b38a-5881948d7e79 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:07.486967 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c428d9-d09e-4c5f-9257-fa0bb33d68fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:07.487743 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c428d9-d09e-4c5f-9257-fa0bb33d68fa None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:07.487931 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c428d9-d09e-4c5f-9257-fa0bb33d68fa None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:07.488212 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c428d9-d09e-4c5f-9257-fa0bb33d68fa None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:07.489178 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c428d9-d09e-4c5f-9257-fa0bb33d68fa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:07.489541 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c428d9-d09e-4c5f-9257-fa0bb33d68fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:07.491746 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c428d9-d09e-4c5f-9257-fa0bb33d68fa None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:07.502329 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 216/420] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:07.514254 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c428d9-d09e-4c5f-9257-fa0bb33d68fa None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:07.527813 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:07.544545 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 205/421] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:58:07.572489 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:07.584278 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e123c4-2f9c-4d35-91b9-ccde27920206 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:07.660042 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c428d9-d09e-4c5f-9257-fa0bb33d68fa None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:07.702178 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e4f3b-5200-4b00-af7a-69f3c471e3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:07.703295 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e4f3b-5200-4b00-af7a-69f3c471e3ab None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:07.703585 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e4f3b-5200-4b00-af7a-69f3c471e3ab None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:07.703866 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e4f3b-5200-4b00-af7a-69f3c471e3ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:07.753816 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e123c4-2f9c-4d35-91b9-ccde27920206 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:07.807287 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2ea336-e658-4faf-a6a0-47865500deb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:07.808714 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ea336-e658-4faf-a6a0-47865500deb6 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:07.809014 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ea336-e658-4faf-a6a0-47865500deb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:07.809295 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ea336-e658-4faf-a6a0-47865500deb6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:07.823183 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2ea336-e658-4faf-a6a0-47865500deb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:07.824984 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849e4f3b-5200-4b00-af7a-69f3c471e3ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:07.827022 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849e4f3b-5200-4b00-af7a-69f3c471e3ab None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:07.836738 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-cd2ea336-e658-4faf-a6a0-47865500deb6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:58:07.836738 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:07.836738 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:07.836738 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:07.836738 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:07.836738 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:07.836738 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:07.836738 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:07.836738 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:07.836738 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:07.836738 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:07.836738 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:07.836738 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:07.836738 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:07.836738 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:07.836738 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:07.837654 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:07.837654 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:07.837654 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:07.837654 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:07.837654 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:07.837654 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:07.837654 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:07.837654 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:07.837654 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:07.837654 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:07.837654 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:07.837654 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:07.837654 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:07.837654 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:07.837654 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:07.837654 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:07.838424 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:07.838424 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:07.838424 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:07.838424 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:07.838424 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:07.838424 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:07.838424 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:07.838424 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:07.838424 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:07.838424 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:07.838424 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:58:07.838424 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:07.838424 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 206/422] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 05:58:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:58:07.839420 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2ea336-e658-4faf-a6a0-47865500deb6 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:07.905967 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:07.909285 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:07.960857 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2ea336-e658-4faf-a6a0-47865500deb6 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:07.999624 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f37b9f-4442-48fd-9195-662544d7f6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:08.000294 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f37b9f-4442-48fd-9195-662544d7f6a8 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:08.000573 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f37b9f-4442-48fd-9195-662544d7f6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:08.000887 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f37b9f-4442-48fd-9195-662544d7f6a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:08.001692 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f37b9f-4442-48fd-9195-662544d7f6a8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:08.001996 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f37b9f-4442-48fd-9195-662544d7f6a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:08.003421 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f37b9f-4442-48fd-9195-662544d7f6a8 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:08.012488 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 207/423] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jun 20 05:58:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:08.017721 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f37b9f-4442-48fd-9195-662544d7f6a8 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:08.043967 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 217/424] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 05:58:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:58:08.050252 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e4f3b-5200-4b00-af7a-69f3c471e3ab None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:08.230541 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f37b9f-4442-48fd-9195-662544d7f6a8 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:08.259298 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e4f3b-5200-4b00-af7a-69f3c471e3ab None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:08.267964 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:08.301635 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05a89a6-d41b-4ea2-90a0-0867968303c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:08.302298 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a89a6-d41b-4ea2-90a0-0867968303c5 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:08.302577 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a89a6-d41b-4ea2-90a0-0867968303c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:08.302852 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a89a6-d41b-4ea2-90a0-0867968303c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:08.334263 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ee04f-1f9d-458a-8ff6-408309597d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:08.335131 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ee04f-1f9d-458a-8ff6-408309597d05 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:08.335406 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ee04f-1f9d-458a-8ff6-408309597d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:08.335679 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ee04f-1f9d-458a-8ff6-408309597d05 None admin] PATH_INFO: `/v3/projects/852ede50488445d795524cf072c12f7e` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:08.337126 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19ee04f-1f9d-458a-8ff6-408309597d05 None admin] RBAC: Authorizing `identity:get_project(project_id=852ede50488445d795524cf072c12f7e)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:08.338555 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19ee04f-1f9d-458a-8ff6-408309597d05 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:08.341599 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 218/425] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jun 20 05:58:08 2022] GET /identity/v3/projects/852ede50488445d795524cf072c12f7e => generated 298 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:08.350618 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ee04f-1f9d-458a-8ff6-408309597d05 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:08.362436 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:08.406197 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05a89a6-d41b-4ea2-90a0-0867968303c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:08.407654 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05a89a6-d41b-4ea2-90a0-0867968303c5 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:08.516360 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 208/426] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 05:58:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 20 05:58:08.521886 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05a89a6-d41b-4ea2-90a0-0867968303c5 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:08.553077 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:08.598208 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ee04f-1f9d-458a-8ff6-408309597d05 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:08.649359 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb4532-b51d-4a07-98bd-60b085622b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:08.650656 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb4532-b51d-4a07-98bd-60b085622b68 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:08.651229 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb4532-b51d-4a07-98bd-60b085622b68 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:08.651697 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb4532-b51d-4a07-98bd-60b085622b68 None admin] PATH_INFO: `/v3/groups/1dd23e27a6e74ff9a16348eee36cd9d1` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:08.653119 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb4532-b51d-4a07-98bd-60b085622b68 None admin] RBAC: Authorizing `identity:get_group(group_id=1dd23e27a6e74ff9a16348eee36cd9d1)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:08.654960 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb4532-b51d-4a07-98bd-60b085622b68 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:08.657139 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 219/427] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Jun 20 05:58:08 2022] GET /identity/v3/groups/1dd23e27a6e74ff9a16348eee36cd9d1 => generated 226 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:08.658670 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799276ff-265b-46f7-bcc4-6fb19c076e0d None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:08.659146 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799276ff-265b-46f7-bcc4-6fb19c076e0d None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:08.659630 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799276ff-265b-46f7-bcc4-6fb19c076e0d None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:08.665312 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 220/428] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:58:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:08.666458 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799276ff-265b-46f7-bcc4-6fb19c076e0d None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:08.679858 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05a89a6-d41b-4ea2-90a0-0867968303c5 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:08.721121 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7726357d-0b5a-4f1f-9713-528feb88e80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:08.721984 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726357d-0b5a-4f1f-9713-528feb88e80e None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:08.722301 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726357d-0b5a-4f1f-9713-528feb88e80e None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:08.722576 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726357d-0b5a-4f1f-9713-528feb88e80e None admin] PATH_INFO: `/v3/projects/852ede50488445d795524cf072c12f7e` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:08.724383 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7726357d-0b5a-4f1f-9713-528feb88e80e None admin] RBAC: Authorizing `identity:get_project(project_id=852ede50488445d795524cf072c12f7e)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:08.725899 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7726357d-0b5a-4f1f-9713-528feb88e80e None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:08.728191 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 209/429] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jun 20 05:58:08 2022] GET /identity/v3/projects/852ede50488445d795524cf072c12f7e => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:58:08.729536 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa816da-5a1b-41eb-b11e-80443b0aeb7b None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:08.729820 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa816da-5a1b-41eb-b11e-80443b0aeb7b None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:08.730199 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa816da-5a1b-41eb-b11e-80443b0aeb7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:08.749507 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-baa816da-5a1b-41eb-b11e-80443b0aeb7b None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:08.750710 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-baa816da-5a1b-41eb-b11e-80443b0aeb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:08.752428 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:08.789795 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799276ff-265b-46f7-bcc4-6fb19c076e0d None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:08.835648 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 210/430] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:58:08.836746 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa816da-5a1b-41eb-b11e-80443b0aeb7b None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:08.846508 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dbf532-986f-4463-a5c1-75d10f0ccfd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:08.847186 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dbf532-986f-4463-a5c1-75d10f0ccfd6 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:08.847472 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dbf532-986f-4463-a5c1-75d10f0ccfd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:08.848780 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dbf532-986f-4463-a5c1-75d10f0ccfd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:08.849370 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dbf532-986f-4463-a5c1-75d10f0ccfd6 None admin] RBAC: Adding query filter params (group.id=1dd23e27a6e74ff9a16348eee36cd9d1, role.id=844adf3fdfaf458faa6fcbcf641d4182, scope.project.id=852ede50488445d795524cf072c12f7e) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:08.849744 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dbf532-986f-4463-a5c1-75d10f0ccfd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:08.851258 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dbf532-986f-4463-a5c1-75d10f0ccfd6 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:08.854738 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:08.865913 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 221/431] 10.222.0.39 () {56 vars in 1376 bytes} [Mon Jun 20 05:58:08 2022] GET /identity/v3/role_assignments?group.id=1dd23e27a6e74ff9a16348eee36cd9d1&scope.project.id=852ede50488445d795524cf072c12f7e&role.id=844adf3fdfaf458faa6fcbcf641d4182 => generated 611 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:08.872734 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dbf532-986f-4463-a5c1-75d10f0ccfd6 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:08.981858 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dbf532-986f-4463-a5c1-75d10f0ccfd6 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:09.021763 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa816da-5a1b-41eb-b11e-80443b0aeb7b None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:09.051691 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f4fe6-9485-4c0c-92c8-a79120fa4b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:09.052562 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f4fe6-9485-4c0c-92c8-a79120fa4b26 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:09.053027 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f4fe6-9485-4c0c-92c8-a79120fa4b26 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:09.053305 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f4fe6-9485-4c0c-92c8-a79120fa4b26 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:09.069521 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:09.077372 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f4fe6-9485-4c0c-92c8-a79120fa4b26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:09.088531 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-001f4fe6-9485-4c0c-92c8-a79120fa4b26 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:58:09.088531 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:09.088531 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:09.088531 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:09.088531 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:09.088531 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:09.088531 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:09.088531 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:09.088531 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:09.088531 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:09.088531 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:09.088531 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:09.088531 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:09.088531 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:09.088531 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:09.088531 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:09.089572 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:09.089572 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:09.089572 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:09.089572 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:09.089572 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:09.089572 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:09.089572 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:09.089572 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:09.089572 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:09.089572 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:09.089572 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:09.089572 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:09.089572 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:09.089572 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:09.089572 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:09.089572 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:09.090381 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:09.090381 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:09.090381 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:09.090381 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:09.090381 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:09.090381 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:09.090381 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:09.090381 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:09.090381 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:09.090381 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:09.090381 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:58:09.090381 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:09.090987 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 222/432] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 05:58:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:09.098426 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f4fe6-9485-4c0c-92c8-a79120fa4b26 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:09.103841 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b6f55-7114-4a01-82f2-c5348ed5f30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:09.104776 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b6f55-7114-4a01-82f2-c5348ed5f30d None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:09.105068 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b6f55-7114-4a01-82f2-c5348ed5f30d None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:09.105343 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b6f55-7114-4a01-82f2-c5348ed5f30d None admin] PATH_INFO: `/v3/groups/1dd23e27a6e74ff9a16348eee36cd9d1` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:09.106556 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43b6f55-7114-4a01-82f2-c5348ed5f30d None admin] RBAC: Authorizing `identity:get_group(group_id=1dd23e27a6e74ff9a16348eee36cd9d1)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:09.108483 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43b6f55-7114-4a01-82f2-c5348ed5f30d None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:09.110466 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 211/433] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Jun 20 05:58:08 2022] GET /identity/v3/groups/1dd23e27a6e74ff9a16348eee36cd9d1 => generated 226 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:09.115969 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b6f55-7114-4a01-82f2-c5348ed5f30d None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:09.224160 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:09.229855 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f4fe6-9485-4c0c-92c8-a79120fa4b26 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:09.251644 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b6f55-7114-4a01-82f2-c5348ed5f30d None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:09.274754 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9567b2-221f-451a-9e4b-5d54c55030b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:09.275385 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9567b2-221f-451a-9e4b-5d54c55030b1 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:09.275761 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9567b2-221f-451a-9e4b-5d54c55030b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:09.276109 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9567b2-221f-451a-9e4b-5d54c55030b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:09.276965 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9567b2-221f-451a-9e4b-5d54c55030b1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:09.277340 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9567b2-221f-451a-9e4b-5d54c55030b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:09.278773 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9567b2-221f-451a-9e4b-5d54c55030b1 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:09.288216 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 223/434] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jun 20 05:58:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:58:09.289628 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234bbb4-fa3f-407b-b42a-c9606de15d7d None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:09.289922 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234bbb4-fa3f-407b-b42a-c9606de15d7d None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:09.290198 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234bbb4-fa3f-407b-b42a-c9606de15d7d None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:09.291665 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 224/435] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:58:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:09.295573 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8234bbb4-fa3f-407b-b42a-c9606de15d7d None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:09.301676 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6205b0-4d31-410d-94b9-185d23fd0877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:09.302393 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6205b0-4d31-410d-94b9-185d23fd0877 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:09.302624 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6205b0-4d31-410d-94b9-185d23fd0877 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:09.302898 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6205b0-4d31-410d-94b9-185d23fd0877 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:09.303730 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6205b0-4d31-410d-94b9-185d23fd0877 None admin] RBAC: Adding query filter params (group.id=1dd23e27a6e74ff9a16348eee36cd9d1, role.id=c34cf84397a64ab0ad2a06daa8e13d88, scope.project.id=852ede50488445d795524cf072c12f7e) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:09.304045 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6205b0-4d31-410d-94b9-185d23fd0877 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:09.305954 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6205b0-4d31-410d-94b9-185d23fd0877 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:09.317058 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 212/436] 10.222.0.39 () {56 vars in 1376 bytes} [Mon Jun 20 05:58:09 2022] GET /identity/v3/role_assignments?group.id=1dd23e27a6e74ff9a16348eee36cd9d1&scope.project.id=852ede50488445d795524cf072c12f7e&role.id=c34cf84397a64ab0ad2a06daa8e13d88 => generated 611 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:58:09.317058 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f44d46-7257-468f-8431-49bba281ebc9 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:09.317058 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f44d46-7257-468f-8431-49bba281ebc9 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:09.317058 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f44d46-7257-468f-8431-49bba281ebc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:09.334333 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-b2f44d46-7257-468f-8431-49bba281ebc9 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:09.335590 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-b2f44d46-7257-468f-8431-49bba281ebc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:09.367531 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:09.418004 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8234bbb4-fa3f-407b-b42a-c9606de15d7d None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:09.430594 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 213/437] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:58:09.458015 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f44d46-7257-468f-8431-49bba281ebc9 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:09.470304 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae4ae8-e916-46b6-9a52-853f23bcc007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:09.471319 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae4ae8-e916-46b6-9a52-853f23bcc007 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:09.471857 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae4ae8-e916-46b6-9a52-853f23bcc007 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:09.472355 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae4ae8-e916-46b6-9a52-853f23bcc007 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:09.558952 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:09.559520 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aae4ae8-e916-46b6-9a52-853f23bcc007 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:09.561358 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aae4ae8-e916-46b6-9a52-853f23bcc007 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:09.596345 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f44d46-7257-468f-8431-49bba281ebc9 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:09.639578 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f099d2-51f8-4b0b-a211-f55b21d9685c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:09.643684 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f099d2-51f8-4b0b-a211-f55b21d9685c None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:09.643684 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f099d2-51f8-4b0b-a211-f55b21d9685c None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:09.643684 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f099d2-51f8-4b0b-a211-f55b21d9685c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:09.645592 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:09.657011 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f099d2-51f8-4b0b-a211-f55b21d9685c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:09.665327 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-66f099d2-51f8-4b0b-a211-f55b21d9685c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:58:09.665327 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:09.665327 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:09.665327 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:09.665327 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:09.665327 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:09.665327 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:09.665327 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:09.665327 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:09.665327 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:09.665327 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:09.665327 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:09.665327 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:09.665327 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:09.665327 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:09.665327 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:09.666282 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:09.666282 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:09.666282 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:09.666282 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:09.666282 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:09.666282 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:09.666282 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:09.666282 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:09.666282 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:09.666282 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:09.666282 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:09.666282 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:09.666282 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:09.666282 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:09.666282 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:09.666282 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:09.667286 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:09.667286 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:09.667286 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:09.667286 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:09.667286 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:09.667286 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:09.667286 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:09.667286 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:09.667286 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:09.667286 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:09.667286 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:58:09.667286 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:09.667286 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 214/438] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jun 20 05:58:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:58:09.672531 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f099d2-51f8-4b0b-a211-f55b21d9685c None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:09.711503 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 225/439] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 05:58:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 20 05:58:09.717062 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae4ae8-e916-46b6-9a52-853f23bcc007 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:09.807520 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f099d2-51f8-4b0b-a211-f55b21d9685c None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:09.842337 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae4ae8-e916-46b6-9a52-853f23bcc007 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:09.846941 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f61676-7074-48d3-88eb-31fae78547d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:09.847645 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f61676-7074-48d3-88eb-31fae78547d9 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:09.847919 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f61676-7074-48d3-88eb-31fae78547d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:09.848194 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f61676-7074-48d3-88eb-31fae78547d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:09.848976 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f61676-7074-48d3-88eb-31fae78547d9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:09.849281 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f61676-7074-48d3-88eb-31fae78547d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:09.851103 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f61676-7074-48d3-88eb-31fae78547d9 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:09.854347 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:09.862253 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 215/440] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:09.864418 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c00322-765f-4028-9eac-65a3f12091d0 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:09.864908 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c00322-765f-4028-9eac-65a3f12091d0 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:09.865373 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c00322-765f-4028-9eac-65a3f12091d0 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:09.867020 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 216/441] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:58:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:09.867744 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c00322-765f-4028-9eac-65a3f12091d0 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:09.886323 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653d5e75-db60-40f4-8b22-c00e194b5a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:09.887205 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d5e75-db60-40f4-8b22-c00e194b5a5c None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:09.887490 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d5e75-db60-40f4-8b22-c00e194b5a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:09.887752 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d5e75-db60-40f4-8b22-c00e194b5a5c None admin] PATH_INFO: `/v3/projects/b5e41057319e4800939cb6fcbdcd1024` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:09.888972 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653d5e75-db60-40f4-8b22-c00e194b5a5c None admin] RBAC: Authorizing `identity:get_project(project_id=b5e41057319e4800939cb6fcbdcd1024)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:09.890421 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653d5e75-db60-40f4-8b22-c00e194b5a5c None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:09.896751 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 226/442] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jun 20 05:58:09 2022] GET /identity/v3/projects/b5e41057319e4800939cb6fcbdcd1024 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:58:09.896751 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2e204-dc2d-4219-9a8c-21f54be0e26d None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:09.896751 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2e204-dc2d-4219-9a8c-21f54be0e26d None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:09.896751 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2e204-dc2d-4219-9a8c-21f54be0e26d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:09.912408 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-35e2e204-dc2d-4219-9a8c-21f54be0e26d None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:09.913680 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-35e2e204-dc2d-4219-9a8c-21f54be0e26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:09.942720 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:09.989971 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c00322-765f-4028-9eac-65a3f12091d0 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:09.998206 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 227/443] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:58:09.999046 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e2e204-dc2d-4219-9a8c-21f54be0e26d None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:10.026536 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a094894-06b2-4f8f-ac3e-9c5dda6572e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:10.027186 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a094894-06b2-4f8f-ac3e-9c5dda6572e7 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:10.027465 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a094894-06b2-4f8f-ac3e-9c5dda6572e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:10.027748 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a094894-06b2-4f8f-ac3e-9c5dda6572e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:10.091332 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:10.095376 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a094894-06b2-4f8f-ac3e-9c5dda6572e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:10.096492 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e2e204-dc2d-4219-9a8c-21f54be0e26d None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:10.096960 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a094894-06b2-4f8f-ac3e-9c5dda6572e7 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:10.130598 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362c70b6-c16d-4dbd-9c15-ed21da2feb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:10.131450 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c70b6-c16d-4dbd-9c15-ed21da2feb7d None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:10.131729 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c70b6-c16d-4dbd-9c15-ed21da2feb7d None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:10.132001 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c70b6-c16d-4dbd-9c15-ed21da2feb7d None admin] PATH_INFO: `/v3/groups/1dd23e27a6e74ff9a16348eee36cd9d1` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:10.133205 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362c70b6-c16d-4dbd-9c15-ed21da2feb7d None admin] RBAC: Authorizing `identity:get_group(group_id=1dd23e27a6e74ff9a16348eee36cd9d1)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:10.134632 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362c70b6-c16d-4dbd-9c15-ed21da2feb7d None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:10.136233 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 228/444] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Jun 20 05:58:09 2022] GET /identity/v3/groups/1dd23e27a6e74ff9a16348eee36cd9d1 => generated 226 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:10.137011 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362c70b6-c16d-4dbd-9c15-ed21da2feb7d None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:10.163558 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:10.204882 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 217/445] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 05:58:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:58:10.205727 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a094894-06b2-4f8f-ac3e-9c5dda6572e7 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:10.246120 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362c70b6-c16d-4dbd-9c15-ed21da2feb7d None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:10.278912 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71520976-a136-4792-b1b7-6385cf4d4d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:10.279718 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71520976-a136-4792-b1b7-6385cf4d4d6c None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:10.279976 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71520976-a136-4792-b1b7-6385cf4d4d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:10.280247 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71520976-a136-4792-b1b7-6385cf4d4d6c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:10.290122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71520976-a136-4792-b1b7-6385cf4d4d6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:10.297803 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-71520976-a136-4792-b1b7-6385cf4d4d6c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:58:10.297803 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:10.297803 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:10.297803 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:10.297803 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:10.297803 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:10.297803 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:10.297803 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:10.297803 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:10.297803 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:10.297803 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:10.297803 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:10.297803 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:10.297803 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:10.297803 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:10.297803 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:10.298753 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:10.298753 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:10.298753 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:10.298753 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:10.298753 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:10.298753 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:10.298753 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:10.298753 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:10.298753 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:10.298753 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:10.298753 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:10.298753 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:10.298753 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:10.298753 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:10.298753 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:10.298753 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:10.299529 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:10.299529 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:10.299529 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:10.299529 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:10.299529 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:10.299529 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:10.299529 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:10.299529 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:10.299529 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:10.299529 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:10.299529 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:58:10.299529 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:10.299529 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 229/446] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jun 20 05:58:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:10.300165 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71520976-a136-4792-b1b7-6385cf4d4d6c None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:10.301866 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:10.309043 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a094894-06b2-4f8f-ac3e-9c5dda6572e7 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:10.343570 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de0fad8-6d52-45ee-b0a5-e525e2372cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:10.344217 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0fad8-6d52-45ee-b0a5-e525e2372cca None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:10.344504 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0fad8-6d52-45ee-b0a5-e525e2372cca None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:10.344814 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0fad8-6d52-45ee-b0a5-e525e2372cca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:10.345696 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de0fad8-6d52-45ee-b0a5-e525e2372cca None admin] RBAC: Adding query filter params (group.id=1dd23e27a6e74ff9a16348eee36cd9d1, role.id=c34cf84397a64ab0ad2a06daa8e13d88, scope.project.id=b5e41057319e4800939cb6fcbdcd1024) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:10.345959 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de0fad8-6d52-45ee-b0a5-e525e2372cca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:10.347388 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de0fad8-6d52-45ee-b0a5-e525e2372cca None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:10.353239 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 218/447] 10.222.0.39 () {56 vars in 1376 bytes} [Mon Jun 20 05:58:10 2022] GET /identity/v3/role_assignments?group.id=1dd23e27a6e74ff9a16348eee36cd9d1&scope.project.id=b5e41057319e4800939cb6fcbdcd1024&role.id=c34cf84397a64ab0ad2a06daa8e13d88 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:10.354014 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de0fad8-6d52-45ee-b0a5-e525e2372cca None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:10.410955 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:10.429217 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71520976-a136-4792-b1b7-6385cf4d4d6c None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:10.466442 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de0fad8-6d52-45ee-b0a5-e525e2372cca None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:10.484878 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058120e-8e6f-451b-a040-1c6b8e883fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:10.485767 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058120e-8e6f-451b-a040-1c6b8e883fd3 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:10.486053 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058120e-8e6f-451b-a040-1c6b8e883fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:10.486327 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058120e-8e6f-451b-a040-1c6b8e883fd3 None admin] PATH_INFO: `/v3/projects/b5e41057319e4800939cb6fcbdcd1024` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:10.487767 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9058120e-8e6f-451b-a040-1c6b8e883fd3 None admin] RBAC: Authorizing `identity:get_project(project_id=b5e41057319e4800939cb6fcbdcd1024)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:10.489505 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9058120e-8e6f-451b-a040-1c6b8e883fd3 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:10.491289 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 230/448] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jun 20 05:58:10 2022] GET /identity/v3/projects/b5e41057319e4800939cb6fcbdcd1024 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:10.496812 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058120e-8e6f-451b-a040-1c6b8e883fd3 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:10.507052 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c555eef-9cde-47b9-bd9b-f4793760c7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:10.507727 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c555eef-9cde-47b9-bd9b-f4793760c7d4 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:10.508013 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c555eef-9cde-47b9-bd9b-f4793760c7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:10.508286 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c555eef-9cde-47b9-bd9b-f4793760c7d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:10.509233 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c555eef-9cde-47b9-bd9b-f4793760c7d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:10.509544 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c555eef-9cde-47b9-bd9b-f4793760c7d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:10.510911 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c555eef-9cde-47b9-bd9b-f4793760c7d4 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:10.519721 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 219/449] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 05:58:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:10.525810 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c555eef-9cde-47b9-bd9b-f4793760c7d4 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:10.561602 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:10.610311 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058120e-8e6f-451b-a040-1c6b8e883fd3 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:10.651376 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada951e0-0608-47f1-9a7e-7188de33535d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:10.652244 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada951e0-0608-47f1-9a7e-7188de33535d None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:10.652531 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada951e0-0608-47f1-9a7e-7188de33535d None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:10.652845 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada951e0-0608-47f1-9a7e-7188de33535d None admin] PATH_INFO: `/v3/groups/1dd23e27a6e74ff9a16348eee36cd9d1` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:10.654119 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada951e0-0608-47f1-9a7e-7188de33535d None admin] RBAC: Authorizing `identity:get_group(group_id=1dd23e27a6e74ff9a16348eee36cd9d1)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:10.655606 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada951e0-0608-47f1-9a7e-7188de33535d None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:10.657322 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 231/450] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Jun 20 05:58:10 2022] GET /identity/v3/groups/1dd23e27a6e74ff9a16348eee36cd9d1 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:58:10.659422 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c555eef-9cde-47b9-bd9b-f4793760c7d4 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:10.663821 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada951e0-0608-47f1-9a7e-7188de33535d None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:10.693644 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:10.709053 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f8aae-481d-4d2d-b28b-d09ede010f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:10.709774 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f8aae-481d-4d2d-b28b-d09ede010f4b None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:10.710059 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f8aae-481d-4d2d-b28b-d09ede010f4b None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:10.710333 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f8aae-481d-4d2d-b28b-d09ede010f4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:10.772422 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada951e0-0608-47f1-9a7e-7188de33535d None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:10.782145 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40f8aae-481d-4d2d-b28b-d09ede010f4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:10.783600 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40f8aae-481d-4d2d-b28b-d09ede010f4b None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:10.805798 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5cd5b-8a28-49bd-91a0-19685b1c19f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:10.806466 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5cd5b-8a28-49bd-91a0-19685b1c19f4 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:10.806749 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5cd5b-8a28-49bd-91a0-19685b1c19f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:10.807027 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5cd5b-8a28-49bd-91a0-19685b1c19f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:10.807860 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c5cd5b-8a28-49bd-91a0-19685b1c19f4 None admin] RBAC: Adding query filter params (group.id=1dd23e27a6e74ff9a16348eee36cd9d1, role.id=844adf3fdfaf458faa6fcbcf641d4182, scope.project.id=b5e41057319e4800939cb6fcbdcd1024) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:10.808178 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c5cd5b-8a28-49bd-91a0-19685b1c19f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:10.808636 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:10.809660 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c5cd5b-8a28-49bd-91a0-19685b1c19f4 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:10.815928 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 232/451] 10.222.0.39 () {56 vars in 1376 bytes} [Mon Jun 20 05:58:10 2022] GET /identity/v3/role_assignments?group.id=1dd23e27a6e74ff9a16348eee36cd9d1&scope.project.id=b5e41057319e4800939cb6fcbdcd1024&role.id=844adf3fdfaf458faa6fcbcf641d4182 => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:58:10.892203 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 220/452] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 05:58:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 20 05:58:10.899162 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5cd5b-8a28-49bd-91a0-19685b1c19f4 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:10.988042 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:11.003851 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5cd5b-8a28-49bd-91a0-19685b1c19f4 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:11.038290 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0602600-5e16-470a-8658-efd35c4b2840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:11.039160 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0602600-5e16-470a-8658-efd35c4b2840 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:11.039444 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0602600-5e16-470a-8658-efd35c4b2840 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:11.039717 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0602600-5e16-470a-8658-efd35c4b2840 None admin] PATH_INFO: `/v3/projects/9e16e10aec7d4a579d849fde0e5b0904` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:11.040964 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0602600-5e16-470a-8658-efd35c4b2840 None admin] RBAC: Authorizing `identity:get_project(project_id=9e16e10aec7d4a579d849fde0e5b0904)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:11.042397 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0602600-5e16-470a-8658-efd35c4b2840 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:11.044099 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 233/453] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jun 20 05:58:10 2022] GET /identity/v3/projects/9e16e10aec7d4a579d849fde0e5b0904 => generated 344 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:11.049873 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f8aae-481d-4d2d-b28b-d09ede010f4b None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:11.152808 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f8aae-481d-4d2d-b28b-d09ede010f4b None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:11.177450 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:11.189320 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f8c323-bd73-4342-a0ff-967beeb6f559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:11.190171 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f8c323-bd73-4342-a0ff-967beeb6f559 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:11.190459 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f8c323-bd73-4342-a0ff-967beeb6f559 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:11.190733 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f8c323-bd73-4342-a0ff-967beeb6f559 None admin] PATH_INFO: `/v3/groups/0b7f1fdaa3094dc385e54c0193140a34` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:11.191987 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f8c323-bd73-4342-a0ff-967beeb6f559 None admin] RBAC: Authorizing `identity:get_group(group_id=0b7f1fdaa3094dc385e54c0193140a34)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:11.193461 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f8c323-bd73-4342-a0ff-967beeb6f559 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:11.195078 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 221/454] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Jun 20 05:58:11 2022] GET /identity/v3/groups/0b7f1fdaa3094dc385e54c0193140a34 => generated 229 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:58:11.200830 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0602600-5e16-470a-8658-efd35c4b2840 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:11.297912 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0602600-5e16-470a-8658-efd35c4b2840 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:11.330475 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c48a1-f00a-4ae9-93c1-d72bbdb3ae20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:11.331118 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c48a1-f00a-4ae9-93c1-d72bbdb3ae20 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:11.331403 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c48a1-f00a-4ae9-93c1-d72bbdb3ae20 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:11.331679 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c48a1-f00a-4ae9-93c1-d72bbdb3ae20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:11.332682 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2c48a1-f00a-4ae9-93c1-d72bbdb3ae20 None admin] RBAC: Adding query filter params (group.id=0b7f1fdaa3094dc385e54c0193140a34, role.id=5a64bd8372704de98e75436ff69e46b3, scope.project.id=9e16e10aec7d4a579d849fde0e5b0904) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:11.333025 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2c48a1-f00a-4ae9-93c1-d72bbdb3ae20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:11.334450 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2c48a1-f00a-4ae9-93c1-d72bbdb3ae20 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:11.340169 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 234/455] 10.222.0.39 () {56 vars in 1376 bytes} [Mon Jun 20 05:58:11 2022] GET /identity/v3/role_assignments?group.id=0b7f1fdaa3094dc385e54c0193140a34&scope.project.id=9e16e10aec7d4a579d849fde0e5b0904&role.id=5a64bd8372704de98e75436ff69e46b3 => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:13.775966 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878bf20-1236-48a7-b4df-0ede3cc261dc None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:13.776456 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878bf20-1236-48a7-b4df-0ede3cc261dc None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:13.776456 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878bf20-1236-48a7-b4df-0ede3cc261dc None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:13.778075 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 222/456] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:58:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:13.786942 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e3e19-6d57-4294-9a75-221c1e61c949 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:13.787450 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e3e19-6d57-4294-9a75-221c1e61c949 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:13.787528 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e3e19-6d57-4294-9a75-221c1e61c949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:13.813944 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-f68e3e19-6d57-4294-9a75-221c1e61c949 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:13.815143 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-f68e3e19-6d57-4294-9a75-221c1e61c949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:13.835331 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:13.907997 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 235/457] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:58:13.933177 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f878bf20-1236-48a7-b4df-0ede3cc261dc None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:14.005594 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852804d-b93a-4a41-a3bf-d52bb827620f None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:14.006234 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852804d-b93a-4a41-a3bf-d52bb827620f None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:14.006730 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852804d-b93a-4a41-a3bf-d52bb827620f None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:14.008539 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 236/458] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:58:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:14.013628 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3d5e5-3002-48b3-a62a-b7da4dce50f5 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:14.014131 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3d5e5-3002-48b3-a62a-b7da4dce50f5 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:14.014601 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3d5e5-3002-48b3-a62a-b7da4dce50f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:14.052451 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-58d3d5e5-3002-48b3-a62a-b7da4dce50f5 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:14.053585 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-58d3d5e5-3002-48b3-a62a-b7da4dce50f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:14.055991 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f878bf20-1236-48a7-b4df-0ede3cc261dc None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:14.099787 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ecc3d-1051-4087-bae1-3543e8644ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:14.101247 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ecc3d-1051-4087-bae1-3543e8644ec2 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:14.101539 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ecc3d-1051-4087-bae1-3543e8644ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:14.102091 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ecc3d-1051-4087-bae1-3543e8644ec2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:14.114595 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ecc3d-1051-4087-bae1-3543e8644ec2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:14.116541 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ecc3d-1051-4087-bae1-3543e8644ec2 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:14.141150 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-3e1ecc3d-1051-4087-bae1-3543e8644ec2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:14.141150 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:14.141150 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:14.141150 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:14.141150 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:14.141150 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:14.141150 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:14.141150 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:14.141150 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:14.141150 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:14.141150 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:14.141150 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:14.141150 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:14.141150 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:14.141150 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:14.142248 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:14.142248 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:14.142248 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:14.142248 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:14.142248 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:14.142248 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:14.142248 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:14.142248 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:14.142248 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:14.142248 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:14.142248 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:14.142248 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:14.142248 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:14.142248 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:14.142248 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:14.142248 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:14.142248 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:14.143313 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:14.143313 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:14.143313 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:14.143313 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:14.145659 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 223/459] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:14.146581 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 237/460] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:58:14.147242 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d00440-6972-4986-8307-59cdcfbb4d04 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:14.147773 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d00440-6972-4986-8307-59cdcfbb4d04 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:14.148194 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d00440-6972-4986-8307-59cdcfbb4d04 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:14.149640 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 224/461] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:58:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:14.154774 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe48e5-6eec-4040-9277-69d191845468 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:14.155278 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe48e5-6eec-4040-9277-69d191845468 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:14.155773 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe48e5-6eec-4040-9277-69d191845468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:14.161120 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3d5e5-3002-48b3-a62a-b7da4dce50f5 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:14.179979 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-08fe48e5-6eec-4040-9277-69d191845468 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:14.181191 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-08fe48e5-6eec-4040-9277-69d191845468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:14.228088 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:14.257130 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:14.266065 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 225/462] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:58:14.267092 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe48e5-6eec-4040-9277-69d191845468 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:14.306298 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3d5e5-3002-48b3-a62a-b7da4dce50f5 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:14.342551 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b77b8-f688-4c00-9bbe-038ff4cb9ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:14.343218 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b77b8-f688-4c00-9bbe-038ff4cb9ad7 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:14.343736 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b77b8-f688-4c00-9bbe-038ff4cb9ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:14.344010 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b77b8-f688-4c00-9bbe-038ff4cb9ad7 None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:14.344957 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42b77b8-f688-4c00-9bbe-038ff4cb9ad7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:14.345411 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42b77b8-f688-4c00-9bbe-038ff4cb9ad7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:14.346941 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42b77b8-f688-4c00-9bbe-038ff4cb9ad7 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:14.361073 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 238/463] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:14.362364 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b77b8-f688-4c00-9bbe-038ff4cb9ad7 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:14.401928 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe48e5-6eec-4040-9277-69d191845468 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:14.440641 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f756d-566e-45a0-bd1d-5204c58c9df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:14.442033 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f756d-566e-45a0-bd1d-5204c58c9df1 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:14.442322 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f756d-566e-45a0-bd1d-5204c58c9df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:14.442589 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f756d-566e-45a0-bd1d-5204c58c9df1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:14.454337 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99f756d-566e-45a0-bd1d-5204c58c9df1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:14.455976 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99f756d-566e-45a0-bd1d-5204c58c9df1 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:14.476426 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-c99f756d-566e-45a0-bd1d-5204c58c9df1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:14.476426 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:14.476426 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:14.476426 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:14.476426 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:14.476426 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:14.476426 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:14.476426 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:14.476426 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:14.476426 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:14.476426 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:14.476426 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:14.476426 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:14.476426 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:14.476426 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:14.477527 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:14.477527 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:14.477527 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:14.477527 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:14.477527 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:14.477527 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:14.477527 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:14.477527 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:14.477527 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:14.477527 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:14.477527 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:14.477527 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:14.477527 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:14.477527 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:14.477527 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:14.477527 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:14.477527 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:14.478456 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:14.478456 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:14.478456 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:14.478456 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:14.478456 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 226/464] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:14.479024 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f756d-566e-45a0-bd1d-5204c58c9df1 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:14.481721 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b77b8-f688-4c00-9bbe-038ff4cb9ad7 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:14.509176 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:14.519021 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d836f6-c079-4e97-9c30-dfa97ff05309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:14.520024 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d836f6-c079-4e97-9c30-dfa97ff05309 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:14.520407 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d836f6-c079-4e97-9c30-dfa97ff05309 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:14.520830 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d836f6-c079-4e97-9c30-dfa97ff05309 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:14.527996 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:14.535919 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d836f6-c079-4e97-9c30-dfa97ff05309 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:14.537454 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d836f6-c079-4e97-9c30-dfa97ff05309 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:14.558762 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-b4d836f6-c079-4e97-9c30-dfa97ff05309 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:14.558762 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:14.558762 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:14.558762 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:14.558762 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:14.558762 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:14.558762 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:14.558762 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:14.558762 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:14.558762 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:14.558762 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:14.558762 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:14.558762 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:14.558762 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:14.558762 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:14.559631 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:14.559631 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:14.559631 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:14.559631 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:14.559631 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:14.559631 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:14.559631 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:14.559631 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:14.559631 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:14.559631 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:14.559631 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:14.559631 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:14.559631 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:14.559631 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:14.559631 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:14.559631 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:14.559631 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:14.560449 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:14.560449 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:14.560449 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:14.560449 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:14.564966 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 239/465] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:14.565881 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d836f6-c079-4e97-9c30-dfa97ff05309 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:14.602468 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f756d-566e-45a0-bd1d-5204c58c9df1 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:14.640481 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea5798e-f78f-4c48-b71c-87ca9dd28061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:14.641922 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5798e-f78f-4c48-b71c-87ca9dd28061 None admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:14.642405 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5798e-f78f-4c48-b71c-87ca9dd28061 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:14.642897 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5798e-f78f-4c48-b71c-87ca9dd28061 None admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:14.643788 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea5798e-f78f-4c48-b71c-87ca9dd28061 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:14.646067 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea5798e-f78f-4c48-b71c-87ca9dd28061 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:14.671481 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 227/466] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Jun 20 05:58:14 2022] POST /identity/v3/users => generated 246 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:58:14.672904 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea5798e-f78f-4c48-b71c-87ca9dd28061 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:14.674771 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d836f6-c079-4e97-9c30-dfa97ff05309 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:14.713247 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d317154-8e16-41d9-8c3b-4956e6380c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:14.713923 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d317154-8e16-41d9-8c3b-4956e6380c94 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:14.714208 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d317154-8e16-41d9-8c3b-4956e6380c94 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:14.714484 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d317154-8e16-41d9-8c3b-4956e6380c94 None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:14.715222 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d317154-8e16-41d9-8c3b-4956e6380c94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:14.715532 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d317154-8e16-41d9-8c3b-4956e6380c94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:14.716950 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d317154-8e16-41d9-8c3b-4956e6380c94 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:14.731170 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 240/467] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:14.732619 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737977df-1624-4173-a93a-5af549286fcb None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:14.733280 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737977df-1624-4173-a93a-5af549286fcb None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:14.733280 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737977df-1624-4173-a93a-5af549286fcb None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:14.734650 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 241/468] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:58:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:14.741299 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb139fa-24d2-4b43-b6ee-a77c8b93c98e None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:14.741468 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb139fa-24d2-4b43-b6ee-a77c8b93c98e None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:14.741708 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb139fa-24d2-4b43-b6ee-a77c8b93c98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:14.759692 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-fbb139fa-24d2-4b43-b6ee-a77c8b93c98e None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:14.760942 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-fbb139fa-24d2-4b43-b6ee-a77c8b93c98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:14.777807 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:14.801475 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea5798e-f78f-4c48-b71c-87ca9dd28061 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:14.819219 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:14.839627 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a07c2-9984-4677-a367-dbe6fee87d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:14.840714 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a07c2-9984-4677-a367-dbe6fee87d39 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:14.841005 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a07c2-9984-4677-a367-dbe6fee87d39 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:14.841286 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a07c2-9984-4677-a367-dbe6fee87d39 None admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:14.842022 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176a07c2-9984-4677-a367-dbe6fee87d39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:14.842328 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176a07c2-9984-4677-a367-dbe6fee87d39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:14.843738 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176a07c2-9984-4677-a367-dbe6fee87d39 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:14.850821 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 242/469] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:58:14.852130 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb139fa-24d2-4b43-b6ee-a77c8b93c98e None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:14.882446 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 228/470] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:14.889723 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a07c2-9984-4677-a367-dbe6fee87d39 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:14.974773 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb139fa-24d2-4b43-b6ee-a77c8b93c98e None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:15.014695 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef61d682-cb40-458c-a40d-8fe58fc6c40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:15.015685 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61d682-cb40-458c-a40d-8fe58fc6c40c None admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:15.016014 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61d682-cb40-458c-a40d-8fe58fc6c40c None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:15.016549 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61d682-cb40-458c-a40d-8fe58fc6c40c None admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:15.017323 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef61d682-cb40-458c-a40d-8fe58fc6c40c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:15.018446 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a07c2-9984-4677-a367-dbe6fee87d39 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:15.018762 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef61d682-cb40-458c-a40d-8fe58fc6c40c None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:15.047108 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 243/471] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Jun 20 05:58:14 2022] POST /identity/v3/users => generated 248 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:58:15.048034 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef61d682-cb40-458c-a40d-8fe58fc6c40c None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:15.085920 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ac5ae-6e45-4bf6-9e6f-92170057287a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:15.088391 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ac5ae-6e45-4bf6-9e6f-92170057287a None admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:15.088710 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ac5ae-6e45-4bf6-9e6f-92170057287a None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:15.088991 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ac5ae-6e45-4bf6-9e6f-92170057287a None admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:15.089742 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8ac5ae-6e45-4bf6-9e6f-92170057287a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:15.094088 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8ac5ae-6e45-4bf6-9e6f-92170057287a None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:15.132683 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:15.137898 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 229/472] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Jun 20 05:58:14 2022] POST /identity/v3/users => generated 248 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:58:15.171344 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:15.275684 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef61d682-cb40-458c-a40d-8fe58fc6c40c None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:15.315917 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af915b-d188-4857-ae15-0534d4e0256d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:15.317197 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af915b-d188-4857-ae15-0534d4e0256d None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:15.317679 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af915b-d188-4857-ae15-0534d4e0256d None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:15.318176 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af915b-d188-4857-ae15-0534d4e0256d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:15.332834 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76af915b-d188-4857-ae15-0534d4e0256d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:15.334637 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76af915b-d188-4857-ae15-0534d4e0256d None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:15.354725 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-76af915b-d188-4857-ae15-0534d4e0256d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:15.354725 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:15.354725 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:15.354725 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:15.354725 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:15.354725 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:15.354725 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:15.354725 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:15.354725 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:15.354725 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:15.354725 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:15.354725 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:15.354725 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:15.354725 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:15.354725 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:15.355581 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:15.355581 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:15.355581 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:15.355581 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:15.355581 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:15.355581 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:15.355581 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:15.355581 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:15.355581 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:15.355581 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:15.355581 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:15.355581 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:15.355581 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:15.355581 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:15.355581 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:15.355581 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:15.355581 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:15.356423 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:15.356423 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:15.356423 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:15.356423 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:15.358750 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 244/473] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:15.365328 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ac5ae-6e45-4bf6-9e6f-92170057287a None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:15.425958 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3de82-1a2e-4ddd-946a-38161157365d None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:15.426788 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3de82-1a2e-4ddd-946a-38161157365d None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:15.426788 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3de82-1a2e-4ddd-946a-38161157365d None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:15.428180 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 245/474] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:58:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:58:15.433674 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f2bd7-c1a1-45f9-aa23-51fb266455b5 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:15.433958 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f2bd7-c1a1-45f9-aa23-51fb266455b5 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:15.434328 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f2bd7-c1a1-45f9-aa23-51fb266455b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:15.458564 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-ff3f2bd7-c1a1-45f9-aa23-51fb266455b5 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:15.460807 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-ff3f2bd7-c1a1-45f9-aa23-51fb266455b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:15.496140 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ac5ae-6e45-4bf6-9e6f-92170057287a None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:15.533592 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe830c3a-7c52-4481-8a09-d78cb9e2851e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:15.534274 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe830c3a-7c52-4481-8a09-d78cb9e2851e None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:15.534579 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe830c3a-7c52-4481-8a09-d78cb9e2851e None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:15.535464 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe830c3a-7c52-4481-8a09-d78cb9e2851e None admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:15.536947 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe830c3a-7c52-4481-8a09-d78cb9e2851e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:15.537261 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe830c3a-7c52-4481-8a09-d78cb9e2851e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:15.540066 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe830c3a-7c52-4481-8a09-d78cb9e2851e None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:15.552555 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 230/475] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:15.560827 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe830c3a-7c52-4481-8a09-d78cb9e2851e None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:15.568467 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 246/476] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:58:15.622335 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f2bd7-c1a1-45f9-aa23-51fb266455b5 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:15.631583 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:15.665073 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:15.677506 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe830c3a-7c52-4481-8a09-d78cb9e2851e None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:15.722961 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b92b6c-ca02-4b1f-a447-4fb791128ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:15.724114 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b92b6c-ca02-4b1f-a447-4fb791128ea3 None admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:15.724398 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b92b6c-ca02-4b1f-a447-4fb791128ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:15.724674 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b92b6c-ca02-4b1f-a447-4fb791128ea3 None admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:15.725417 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b92b6c-ca02-4b1f-a447-4fb791128ea3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:15.726861 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b92b6c-ca02-4b1f-a447-4fb791128ea3 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:15.766384 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 231/477] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Jun 20 05:58:15 2022] POST /identity/v3/users => generated 249 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:58:15.826013 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f2bd7-c1a1-45f9-aa23-51fb266455b5 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:15.885271 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b85136-134c-4b49-9161-c755a0f2c65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:15.886017 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b85136-134c-4b49-9161-c755a0f2c65a None admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:15.886308 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b85136-134c-4b49-9161-c755a0f2c65a None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:15.886629 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b85136-134c-4b49-9161-c755a0f2c65a None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:15.887402 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b85136-134c-4b49-9161-c755a0f2c65a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:15.888826 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b85136-134c-4b49-9161-c755a0f2c65a None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:15.900925 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.sql.core [None req-55b85136-134c-4b49-9161-c755a0f2c65a None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 20 05:58:15.900925 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 20 05:58:15.900925 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [parameters: {'id': 'fdf06e8355b64a2da733b8fad5ed40b1', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 20 05:58:15.900925 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80271) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 20 05:58:15.922761 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-55b85136-134c-4b49-9161-c755a0f2c65a None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 20 05:58:15.922761 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:15.922761 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 20 05:58:15.922761 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 20 05:58:15.922761 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 20 05:58:15.922761 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 20 05:58:15.922761 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 20 05:58:15.922761 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application result = self._query(query) Jun 20 05:58:15.922761 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 20 05:58:15.922761 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application conn.query(q) Jun 20 05:58:15.922761 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 20 05:58:15.922761 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 20 05:58:15.922761 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 20 05:58:15.922761 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application result.read() Jun 20 05:58:15.922761 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 20 05:58:15.923653 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 20 05:58:15.923653 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 20 05:58:15.923653 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 20 05:58:15.923653 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 20 05:58:15.923653 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 20 05:58:15.923653 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 20 05:58:15.923653 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 20 05:58:15.923653 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 20 05:58:15.923653 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:15.923653 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 20 05:58:15.923653 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:15.923653 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:15.923653 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 20 05:58:15.923653 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 20 05:58:15.923653 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 20 05:58:15.923653 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return ref.to_dict() Jun 20 05:58:15.923653 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 20 05:58:15.923653 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application next(self.gen) Jun 20 05:58:15.925152 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 20 05:58:15.925152 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application yield resource Jun 20 05:58:15.925152 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 20 05:58:15.925152 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application next(self.gen) Jun 20 05:58:15.925152 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 20 05:58:15.925152 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application self.session.rollback() Jun 20 05:58:15.925152 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 05:58:15.925152 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application self.force_reraise() Jun 20 05:58:15.925152 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 05:58:15.925152 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise self.value Jun 20 05:58:15.925152 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 20 05:58:15.925152 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 20 05:58:15.925152 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 20 05:58:15.925152 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application session.commit() Jun 20 05:58:15.925152 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 20 05:58:15.925152 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 20 05:58:15.925152 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 20 05:58:15.927302 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application self._prepare_impl() Jun 20 05:58:15.927302 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 20 05:58:15.927302 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application self.session.flush() Jun 20 05:58:15.927302 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 20 05:58:15.927302 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application self._flush(objects) Jun 20 05:58:15.927302 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 20 05:58:15.927302 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 20 05:58:15.927302 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 20 05:58:15.927302 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application compat.raise_( Jun 20 05:58:15.927302 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 20 05:58:15.927302 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception Jun 20 05:58:15.927302 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 20 05:58:15.927302 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application flush_context.execute() Jun 20 05:58:15.927302 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 20 05:58:15.927302 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rec.execute(self) Jun 20 05:58:15.927302 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 20 05:58:15.927302 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 20 05:58:15.929405 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 20 05:58:15.929405 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 20 05:58:15.929405 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 20 05:58:15.929405 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 20 05:58:15.929405 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 20 05:58:15.929405 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 20 05:58:15.929405 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 20 05:58:15.929405 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 20 05:58:15.929405 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 20 05:58:15.929405 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 20 05:58:15.929405 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 20 05:58:15.929405 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 20 05:58:15.929405 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 20 05:58:15.929405 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 20 05:58:15.929405 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 20 05:58:15.929405 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception Jun 20 05:58:15.931315 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 20 05:58:15.931315 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 20 05:58:15.931315 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 20 05:58:15.931315 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 20 05:58:15.931315 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 20 05:58:15.931315 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application result = self._query(query) Jun 20 05:58:15.931315 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 20 05:58:15.931315 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application conn.query(q) Jun 20 05:58:15.931315 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 20 05:58:15.931315 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 20 05:58:15.931315 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 20 05:58:15.931315 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application result.read() Jun 20 05:58:15.931315 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 20 05:58:15.931315 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 20 05:58:15.931315 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 20 05:58:15.931315 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 20 05:58:15.933856 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 20 05:58:15.933856 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 20 05:58:15.933856 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 20 05:58:15.933856 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 20 05:58:15.933856 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 20 05:58:15.933856 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 20 05:58:15.933856 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [parameters: {'id': 'fdf06e8355b64a2da733b8fad5ed40b1', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 20 05:58:15.933856 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 20 05:58:15.933856 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:15.933856 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:58:15.933856 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:15.933856 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:15.933856 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:15.933856 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:15.933856 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:15.933856 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:15.935754 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:15.935754 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:15.935754 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:15.935754 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:15.935754 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:15.935754 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:15.935754 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 20 05:58:15.935754 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 20 05:58:15.935754 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:15.935754 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:15.935754 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 20 05:58:15.935754 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 20 05:58:15.935754 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 20 05:58:15.935754 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 20 05:58:15.935754 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 20 05:58:15.935754 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:15.937797 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 247/478] 10.222.0.39 () {60 vars in 1131 bytes} [Mon Jun 20 05:58:15 2022] POST /identity/v3/roles => generated 144 bytes in 303 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:58:15.937929 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b92b6c-ca02-4b1f-a447-4fb791128ea3 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:16.050932 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b92b6c-ca02-4b1f-a447-4fb791128ea3 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:16.066921 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:16.091488 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d23bb7-c651-4493-99ed-aeee898b9771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:16.092310 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d23bb7-c651-4493-99ed-aeee898b9771 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:16.092595 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d23bb7-c651-4493-99ed-aeee898b9771 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:16.092909 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d23bb7-c651-4493-99ed-aeee898b9771 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:16.104400 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d23bb7-c651-4493-99ed-aeee898b9771 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:16.112499 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-b8d23bb7-c651-4493-99ed-aeee898b9771 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:58:16.112499 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:16.112499 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:16.112499 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:16.112499 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:16.112499 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:16.112499 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:16.112499 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:16.112499 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:16.112499 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:16.112499 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:16.112499 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:16.112499 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:16.112499 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:16.112499 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:16.112499 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:16.115060 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:16.115060 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:16.115060 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:16.115060 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:16.115060 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:16.115060 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:16.115060 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:16.115060 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:16.115060 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:16.115060 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:16.115060 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:16.115060 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:16.115060 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:16.115060 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:16.115060 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:16.115060 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:16.117042 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:16.117042 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:16.117042 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:16.117042 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:16.117042 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:16.117042 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:16.117042 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:16.117042 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:16.117042 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:16.117042 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:16.117042 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:58:16.117042 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:16.117042 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 232/479] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jun 20 05:58:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:16.122099 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b85136-134c-4b49-9161-c755a0f2c65a None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:16.224631 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:16.245089 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b85136-134c-4b49-9161-c755a0f2c65a None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:16.305414 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c52b4-60bb-4854-a087-2545a095069b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:16.306097 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c52b4-60bb-4854-a087-2545a095069b None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:16.306433 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c52b4-60bb-4854-a087-2545a095069b None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:16.306712 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c52b4-60bb-4854-a087-2545a095069b None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:16.307523 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2c52b4-60bb-4854-a087-2545a095069b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:16.307837 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2c52b4-60bb-4854-a087-2545a095069b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:16.309262 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2c52b4-60bb-4854-a087-2545a095069b None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:16.318698 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 248/480] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:17.248973 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f86509-7d54-4526-bd1a-0c464eaad230 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:17.249707 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f86509-7d54-4526-bd1a-0c464eaad230 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:17.249707 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f86509-7d54-4526-bd1a-0c464eaad230 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:17.251154 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 233/481] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:58:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:17.257599 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b80c18-3d2c-44a3-bf78-5c9be7b7cd2e None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:17.258132 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b80c18-3d2c-44a3-bf78-5c9be7b7cd2e None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:17.258132 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b80c18-3d2c-44a3-bf78-5c9be7b7cd2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:17.285516 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-a6b80c18-3d2c-44a3-bf78-5c9be7b7cd2e None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:17.286708 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-a6b80c18-3d2c-44a3-bf78-5c9be7b7cd2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:17.386228 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 249/482] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:58:17.417729 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f86509-7d54-4526-bd1a-0c464eaad230 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:17.550781 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f86509-7d54-4526-bd1a-0c464eaad230 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:17.602936 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c57e69-2712-469a-9109-0163b8da01a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:17.603751 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c57e69-2712-469a-9109-0163b8da01a4 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:17.604036 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c57e69-2712-469a-9109-0163b8da01a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:17.604313 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c57e69-2712-469a-9109-0163b8da01a4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:17.623640 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c57e69-2712-469a-9109-0163b8da01a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:17.631459 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-75c57e69-2712-469a-9109-0163b8da01a4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:17.631459 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:17.631459 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:17.631459 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:17.631459 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:17.631459 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:17.631459 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:17.631459 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:17.631459 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:17.631459 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:17.631459 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:17.631459 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:17.631459 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:17.631459 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:17.631459 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:17.631459 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:17.633520 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:17.633520 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:17.633520 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:17.633520 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:17.633520 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:17.633520 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:17.633520 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:17.633520 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:17.633520 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:17.633520 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:17.633520 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:17.633520 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:17.633520 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:17.633520 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:17.633520 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:17.633520 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:17.635392 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:17.635392 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:17.635392 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:17.635392 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:17.635392 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:17.635392 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:17.635392 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:17.635392 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:17.635392 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:17.635392 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:17.635392 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:17.635392 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:17.640748 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 234/483] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jun 20 05:58:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:17.641765 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b80c18-3d2c-44a3-bf78-5c9be7b7cd2e None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:17.721491 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5102a-97f1-4f3f-9f50-4610ed00f97d None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:17.721808 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5102a-97f1-4f3f-9f50-4610ed00f97d None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:17.722625 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5102a-97f1-4f3f-9f50-4610ed00f97d None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:17.724216 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 235/484] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:58:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:17.729283 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69418e-172c-44e7-8a41-a6f2463e1789 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:17.729570 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69418e-172c-44e7-8a41-a6f2463e1789 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:17.729849 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69418e-172c-44e7-8a41-a6f2463e1789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:17.751373 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:17.760210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-5f69418e-172c-44e7-8a41-a6f2463e1789 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:17.761449 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-5f69418e-172c-44e7-8a41-a6f2463e1789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:17.782841 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b80c18-3d2c-44a3-bf78-5c9be7b7cd2e None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:17.820886 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411d9b1-8398-424c-a3cd-f5322937f241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:17.821442 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411d9b1-8398-424c-a3cd-f5322937f241 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:17.821720 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411d9b1-8398-424c-a3cd-f5322937f241 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:17.821995 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411d9b1-8398-424c-a3cd-f5322937f241 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:17.822734 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4411d9b1-8398-424c-a3cd-f5322937f241 None admin] RBAC: Adding query filter params (name=service) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:17.823038 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4411d9b1-8398-424c-a3cd-f5322937f241 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:17.824398 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4411d9b1-8398-424c-a3cd-f5322937f241 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:17.833049 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:17.849452 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 250/485] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jun 20 05:58:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:17.850342 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411d9b1-8398-424c-a3cd-f5322937f241 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:17.914550 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 236/486] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:58:17.949301 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69418e-172c-44e7-8a41-a6f2463e1789 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:17.976541 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411d9b1-8398-424c-a3cd-f5322937f241 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:18.016448 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd30bf0-055e-4da7-b746-f969f7203317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:18.017278 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd30bf0-055e-4da7-b746-f969f7203317 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:18.017556 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd30bf0-055e-4da7-b746-f969f7203317 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:18.017827 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd30bf0-055e-4da7-b746-f969f7203317 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:18.022796 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:18.034532 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd30bf0-055e-4da7-b746-f969f7203317 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:18.036300 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd30bf0-055e-4da7-b746-f969f7203317 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:18.059296 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-1bd30bf0-055e-4da7-b746-f969f7203317 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:18.059296 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:18.059296 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:18.059296 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:18.059296 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:18.059296 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:18.059296 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:18.059296 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:18.059296 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:18.059296 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:18.059296 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:18.059296 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:18.059296 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:18.059296 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:18.059296 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:18.060178 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:18.060178 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:18.060178 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:18.060178 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:18.060178 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:18.060178 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:18.060178 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:18.060178 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:18.060178 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:18.060178 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:18.060178 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:18.060178 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:18.060178 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:18.060178 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:18.060178 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:18.060178 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:18.060178 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:18.061061 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:18.061061 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:18.061061 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:18.061061 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:18.061679 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 251/487] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:18.063196 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3b8e2-72d9-45e3-9641-d46060652e88 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:18.063479 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3b8e2-72d9-45e3-9641-d46060652e88 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:18.063750 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3b8e2-72d9-45e3-9641-d46060652e88 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:18.066564 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 252/488] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:58:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:18.071359 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3b8e2-72d9-45e3-9641-d46060652e88 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:18.089073 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69418e-172c-44e7-8a41-a6f2463e1789 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:18.126557 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6230e869-15dd-42a7-bb8b-295d85d8ad07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:18.127501 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230e869-15dd-42a7-bb8b-295d85d8ad07 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:18.127795 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230e869-15dd-42a7-bb8b-295d85d8ad07 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:18.128072 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230e869-15dd-42a7-bb8b-295d85d8ad07 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:18.140293 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6230e869-15dd-42a7-bb8b-295d85d8ad07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:18.149564 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-6230e869-15dd-42a7-bb8b-295d85d8ad07 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:18.149564 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:18.149564 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:18.149564 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:18.149564 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:18.149564 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:18.149564 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:18.149564 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:18.149564 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:18.149564 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:18.149564 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:18.149564 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:18.149564 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:18.149564 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:18.149564 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:18.149564 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:18.150440 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:18.150440 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:18.150440 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:18.150440 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:18.150440 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:18.150440 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:18.150440 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:18.150440 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:18.150440 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:18.150440 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:18.150440 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:18.150440 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:18.150440 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:18.150440 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:18.150440 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:18.150440 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:18.151263 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:18.151263 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:18.151263 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:18.151263 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:18.151263 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:18.151263 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:18.151263 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:18.151263 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:18.151263 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:18.151263 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:18.151263 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:18.151263 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:18.151263 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 237/489] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jun 20 05:58:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:58:18.152743 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b6a9c-de03-4d9c-a756-5cbbfa3726b7 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:18.152893 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b6a9c-de03-4d9c-a756-5cbbfa3726b7 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:18.156720 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b6a9c-de03-4d9c-a756-5cbbfa3726b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:18.172043 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-c31b6a9c-de03-4d9c-a756-5cbbfa3726b7 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:18.173325 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-c31b6a9c-de03-4d9c-a756-5cbbfa3726b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:18.181745 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3b8e2-72d9-45e3-9641-d46060652e88 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:18.196117 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:18.222131 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c4be19-7a36-4943-a655-6afb261bd4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:18.223235 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c4be19-7a36-4943-a655-6afb261bd4c9 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:18.223661 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c4be19-7a36-4943-a655-6afb261bd4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:18.224075 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c4be19-7a36-4943-a655-6afb261bd4c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:18.225024 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c4be19-7a36-4943-a655-6afb261bd4c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:18.225489 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c4be19-7a36-4943-a655-6afb261bd4c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:18.227114 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c4be19-7a36-4943-a655-6afb261bd4c9 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:18.242465 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 253/490] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:18.243684 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c4be19-7a36-4943-a655-6afb261bd4c9 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:18.258008 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 238/491] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:58:18.258989 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b6a9c-de03-4d9c-a756-5cbbfa3726b7 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:18.307791 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:18.374147 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b6a9c-de03-4d9c-a756-5cbbfa3726b7 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:18.375838 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c4be19-7a36-4943-a655-6afb261bd4c9 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:18.418497 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3778011c-39c4-4b9d-a655-922720e7a6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:18.419432 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778011c-39c4-4b9d-a655-922720e7a6c5 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:18.419855 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778011c-39c4-4b9d-a655-922720e7a6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:18.420203 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778011c-39c4-4b9d-a655-922720e7a6c5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:18.426670 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f3169-7ded-4811-9a47-3c42df89329d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:18.427631 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f3169-7ded-4811-9a47-3c42df89329d None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:18.427923 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f3169-7ded-4811-9a47-3c42df89329d None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:18.428204 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f3169-7ded-4811-9a47-3c42df89329d None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:18.428352 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3778011c-39c4-4b9d-a655-922720e7a6c5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:18.429001 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253f3169-7ded-4811-9a47-3c42df89329d None admin] RBAC: Adding query filter params (name=service) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:18.429313 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253f3169-7ded-4811-9a47-3c42df89329d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:18.430079 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3778011c-39c4-4b9d-a655-922720e7a6c5 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:18.430670 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253f3169-7ded-4811-9a47-3c42df89329d None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:18.440567 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 254/492] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jun 20 05:58:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:18.441539 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f3169-7ded-4811-9a47-3c42df89329d None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:18.456972 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-3778011c-39c4-4b9d-a655-922720e7a6c5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 05:58:18.456972 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:18.456972 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:18.456972 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:18.456972 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:18.456972 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:18.456972 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:18.456972 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:18.456972 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:18.456972 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:18.456972 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:18.456972 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:18.456972 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:58:18.456972 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:58:18.456972 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:58:18.456972 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:58:18.457907 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:18.457907 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:18.457907 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:58:18.457907 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:18.457907 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:58:18.457907 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:18.457907 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:18.457907 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:18.457907 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:18.457907 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:18.457907 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:18.457907 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:18.457907 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:18.457907 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:18.457907 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:18.457907 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:18.457907 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:18.457907 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:18.458784 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:18.458784 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:18.458784 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:58:18.458784 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:58:18.458784 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:58:18.458784 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:58:18.458784 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:58:18.458784 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:58:18.458784 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 05:58:18.458784 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:18.458784 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 239/493] 10.222.0.39 () {56 vars in 1093 bytes} [Mon Jun 20 05:58:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:18.458784 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3778011c-39c4-4b9d-a655-922720e7a6c5 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:18.473865 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:18.566906 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3778011c-39c4-4b9d-a655-922720e7a6c5 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:18.572107 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f3169-7ded-4811-9a47-3c42df89329d None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:18.585349 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:18.601193 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e0287-5d9a-45e8-ada6-6f8082271175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:18.601979 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e0287-5d9a-45e8-ada6-6f8082271175 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:18.602261 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e0287-5d9a-45e8-ada6-6f8082271175 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:18.602534 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e0287-5d9a-45e8-ada6-6f8082271175 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:18.612304 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e0287-5d9a-45e8-ada6-6f8082271175 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:18.613690 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b29cefb-3602-4f36-a5ba-62cf5ce8d8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:18.613910 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e0287-5d9a-45e8-ada6-6f8082271175 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:18.615068 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29cefb-3602-4f36-a5ba-62cf5ce8d8f9 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:18.615663 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29cefb-3602-4f36-a5ba-62cf5ce8d8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:18.616258 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29cefb-3602-4f36-a5ba-62cf5ce8d8f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:18.627156 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b29cefb-3602-4f36-a5ba-62cf5ce8d8f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:18.631501 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-c86e0287-5d9a-45e8-ada6-6f8082271175 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:18.631501 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:18.631501 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:18.631501 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:18.631501 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:18.631501 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:18.631501 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:18.631501 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:18.631501 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:18.631501 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:18.631501 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:18.631501 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:18.631501 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:18.631501 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:18.631501 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:18.632312 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:18.632312 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:18.632312 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:18.632312 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:18.632312 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:18.632312 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:18.632312 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:18.632312 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:18.632312 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:18.632312 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:18.632312 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:18.632312 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:18.632312 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:18.632312 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:18.632312 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:18.632312 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:18.632312 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:18.633221 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:18.633221 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:18.633221 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:18.633221 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:18.636047 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-3b29cefb-3602-4f36-a5ba-62cf5ce8d8f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:18.636047 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:18.636047 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:18.636047 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:18.636047 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:18.636047 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:18.636047 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:18.636047 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:18.636047 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:18.636047 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:18.636047 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:18.636047 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:18.636047 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:18.636047 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:18.636047 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:18.636047 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:18.637423 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:18.637423 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:18.637423 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:18.637423 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:18.637423 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:18.637423 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:18.637423 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:18.637423 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:18.637423 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:18.637423 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:18.637423 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:18.637423 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:18.637423 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:18.637423 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:18.637423 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:18.637423 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:18.638686 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:18.638686 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:18.638686 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:18.638686 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:18.638686 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:18.638686 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:18.638686 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:18.638686 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:18.638686 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:18.638686 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:18.638686 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:18.638686 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:18.640161 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 240/494] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:18.640161 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e0287-5d9a-45e8-ada6-6f8082271175 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:18.641042 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 255/495] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jun 20 05:58:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:18.643302 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c135a0-cf73-48fc-8bf0-5774a2f12bef None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:18.643595 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c135a0-cf73-48fc-8bf0-5774a2f12bef None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:18.644036 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c135a0-cf73-48fc-8bf0-5774a2f12bef None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:18.645509 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 256/496] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:58:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:18.646142 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c135a0-cf73-48fc-8bf0-5774a2f12bef None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:18.715199 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:18.750513 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c135a0-cf73-48fc-8bf0-5774a2f12bef None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:18.756791 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e0287-5d9a-45e8-ada6-6f8082271175 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:18.784207 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9cfa77-f08f-4f80-9ed5-c14c2988ff6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:18.785838 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9cfa77-f08f-4f80-9ed5-c14c2988ff6b None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:18.786066 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9cfa77-f08f-4f80-9ed5-c14c2988ff6b None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:18.786342 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9cfa77-f08f-4f80-9ed5-c14c2988ff6b None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:18.787071 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9cfa77-f08f-4f80-9ed5-c14c2988ff6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:18.787374 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9cfa77-f08f-4f80-9ed5-c14c2988ff6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:18.788769 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9cfa77-f08f-4f80-9ed5-c14c2988ff6b None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:18.794518 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec1320-0693-48c9-9f17-b2411c2af22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:18.795526 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec1320-0693-48c9-9f17-b2411c2af22b None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:18.795813 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec1320-0693-48c9-9f17-b2411c2af22b None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:18.796092 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec1320-0693-48c9-9f17-b2411c2af22b None admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:18.796978 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aec1320-0693-48c9-9f17-b2411c2af22b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:18.797413 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aec1320-0693-48c9-9f17-b2411c2af22b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:18.798839 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aec1320-0693-48c9-9f17-b2411c2af22b None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:18.806076 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 257/497] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:18.806076 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9cfa77-f08f-4f80-9ed5-c14c2988ff6b None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:18.833401 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:18.844908 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 241/498] 10.222.0.39 () {56 vars in 1133 bytes} [Mon Jun 20 05:58:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:18.846117 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e436cb-1bde-483f-b749-7ed6e54eaf2a None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:18.846416 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e436cb-1bde-483f-b749-7ed6e54eaf2a None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:18.846698 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e436cb-1bde-483f-b749-7ed6e54eaf2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:18.865136 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-f3e436cb-1bde-483f-b749-7ed6e54eaf2a None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:18.866468 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-f3e436cb-1bde-483f-b749-7ed6e54eaf2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:18.907613 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9cfa77-f08f-4f80-9ed5-c14c2988ff6b None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:18.937093 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 242/499] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:58:18.938402 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e436cb-1bde-483f-b749-7ed6e54eaf2a None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:18.954235 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d48d644-1467-42ac-adb7-26cae0714625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:18.954910 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48d644-1467-42ac-adb7-26cae0714625 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:18.955196 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48d644-1467-42ac-adb7-26cae0714625 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:18.955471 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48d644-1467-42ac-adb7-26cae0714625 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:18.957232 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d48d644-1467-42ac-adb7-26cae0714625 None admin] RBAC: Adding query filter params (name=service) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:18.957540 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d48d644-1467-42ac-adb7-26cae0714625 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:18.959212 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d48d644-1467-42ac-adb7-26cae0714625 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:18.969168 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 258/500] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jun 20 05:58:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:18.969968 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d48d644-1467-42ac-adb7-26cae0714625 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:19.000519 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:19.052673 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e436cb-1bde-483f-b749-7ed6e54eaf2a None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:19.075361 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:19.086498 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d48d644-1467-42ac-adb7-26cae0714625 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:19.089983 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b3529-b04c-439c-be99-bf6f12c2c104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:19.090861 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b3529-b04c-439c-be99-bf6f12c2c104 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:19.091150 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b3529-b04c-439c-be99-bf6f12c2c104 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:19.091426 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b3529-b04c-439c-be99-bf6f12c2c104 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:19.100029 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b3529-b04c-439c-be99-bf6f12c2c104 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:19.101543 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b3529-b04c-439c-be99-bf6f12c2c104 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:19.116945 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-c29b3529-b04c-439c-be99-bf6f12c2c104 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 05:58:19.116945 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:19.116945 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:19.116945 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:19.116945 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:19.116945 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:19.116945 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:19.116945 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:19.116945 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:19.116945 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:19.116945 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:19.116945 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:19.116945 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:58:19.116945 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:58:19.116945 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:58:19.116945 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:58:19.118158 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:19.118158 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:19.118158 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:58:19.118158 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:19.118158 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:58:19.118158 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:19.118158 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:19.118158 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:19.118158 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:19.118158 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:19.118158 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:19.118158 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:19.118158 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:19.118158 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:19.118158 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:19.118158 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:19.118158 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:19.118158 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:19.119275 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:19.119275 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:19.119275 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:58:19.119275 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:58:19.119275 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:58:19.119275 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:58:19.119275 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:58:19.119275 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:58:19.119275 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 05:58:19.119275 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:19.119275 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 243/501] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 05:58:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:19.119275 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b3529-b04c-439c-be99-bf6f12c2c104 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:19.127848 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22664a-8fa2-4abd-98f1-a78271322f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:19.129316 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22664a-8fa2-4abd-98f1-a78271322f77 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:19.129750 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22664a-8fa2-4abd-98f1-a78271322f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:19.130171 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22664a-8fa2-4abd-98f1-a78271322f77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:19.206528 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b22664a-8fa2-4abd-98f1-a78271322f77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:19.208088 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b22664a-8fa2-4abd-98f1-a78271322f77 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:19.228509 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b3529-b04c-439c-be99-bf6f12c2c104 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:19.243306 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:19.267543 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678212df-dd62-4393-a0a2-b02bf0a81b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:19.268371 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678212df-dd62-4393-a0a2-b02bf0a81b0f None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:19.268653 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678212df-dd62-4393-a0a2-b02bf0a81b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:19.269651 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678212df-dd62-4393-a0a2-b02bf0a81b0f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:19.280191 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678212df-dd62-4393-a0a2-b02bf0a81b0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:19.288442 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-678212df-dd62-4393-a0a2-b02bf0a81b0f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:19.288442 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:19.288442 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:19.288442 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:19.288442 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:19.288442 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:19.288442 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:19.288442 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:19.288442 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:19.288442 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:19.288442 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:19.288442 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:19.288442 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:19.288442 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:19.288442 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:19.288442 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:19.289603 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:19.289603 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:19.289603 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:19.289603 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:19.289603 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:19.289603 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:19.289603 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:19.289603 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:19.289603 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:19.289603 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:19.289603 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:19.289603 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:19.289603 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:19.289603 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:19.289603 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:19.289603 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:19.290891 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:19.290891 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:19.290891 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:19.290891 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:19.290891 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:19.290891 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:19.290891 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:19.290891 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:19.290891 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:19.290891 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:19.290891 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:19.290891 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:19.290891 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 244/502] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jun 20 05:58:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:19.290891 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678212df-dd62-4393-a0a2-b02bf0a81b0f None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:19.308598 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:19.319652 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 259/503] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 05:58:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:58:19.320466 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22664a-8fa2-4abd-98f1-a78271322f77 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:19.398568 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678212df-dd62-4393-a0a2-b02bf0a81b0f None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:19.420679 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22664a-8fa2-4abd-98f1-a78271322f77 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:19.432506 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf3810-bb76-4fa3-b39f-67f57c4e6711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:19.433326 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf3810-bb76-4fa3-b39f-67f57c4e6711 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:19.433617 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf3810-bb76-4fa3-b39f-67f57c4e6711 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:19.433893 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf3810-bb76-4fa3-b39f-67f57c4e6711 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:19.447103 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf3810-bb76-4fa3-b39f-67f57c4e6711 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:19.448753 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf3810-bb76-4fa3-b39f-67f57c4e6711 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:19.456906 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c82216-0a96-4730-b6e0-a3ea20e4d75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:19.457519 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c82216-0a96-4730-b6e0-a3ea20e4d75b None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:19.457805 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c82216-0a96-4730-b6e0-a3ea20e4d75b None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:19.458077 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c82216-0a96-4730-b6e0-a3ea20e4d75b None admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:19.458912 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c82216-0a96-4730-b6e0-a3ea20e4d75b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:19.459220 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c82216-0a96-4730-b6e0-a3ea20e4d75b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:19.460623 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c82216-0a96-4730-b6e0-a3ea20e4d75b None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:19.466772 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-c1cf3810-bb76-4fa3-b39f-67f57c4e6711 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:19.466772 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:19.466772 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:19.466772 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:19.466772 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:19.466772 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:19.466772 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:19.466772 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:19.466772 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:19.466772 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:19.466772 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:19.466772 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:19.466772 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:19.466772 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:19.466772 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:19.467582 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:19.467582 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:19.467582 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:19.467582 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:19.467582 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:19.467582 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:19.467582 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:19.467582 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:19.467582 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:19.467582 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:19.467582 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:19.467582 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:19.467582 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:19.467582 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:19.467582 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:19.467582 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:19.467582 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:19.468407 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:19.468407 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:19.468407 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:19.468407 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:19.468407 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 245/504] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:19.469518 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d494a30-87fb-42e4-a140-200623d06083 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:19.469842 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d494a30-87fb-42e4-a140-200623d06083 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:19.470077 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d494a30-87fb-42e4-a140-200623d06083 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:19.471451 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 246/505] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:58:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:19.473201 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d494a30-87fb-42e4-a140-200623d06083 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:19.499554 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 260/506] 10.222.0.39 () {56 vars in 1137 bytes} [Mon Jun 20 05:58:19 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:19.500392 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c82216-0a96-4730-b6e0-a3ea20e4d75b None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:19.504326 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:19.549210 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:19.576953 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d494a30-87fb-42e4-a140-200623d06083 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:19.604171 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c82216-0a96-4730-b6e0-a3ea20e4d75b None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:19.615026 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa714b-c605-47fd-95ae-f149aeaae442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:19.615689 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa714b-c605-47fd-95ae-f149aeaae442 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:19.615966 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa714b-c605-47fd-95ae-f149aeaae442 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:19.616235 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa714b-c605-47fd-95ae-f149aeaae442 None admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:19.617001 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa714b-c605-47fd-95ae-f149aeaae442 None admin] RBAC: Adding query filter params (name=service) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:19.617299 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa714b-c605-47fd-95ae-f149aeaae442 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:19.618656 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa714b-c605-47fd-95ae-f149aeaae442 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:19.626508 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 247/507] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jun 20 05:58:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:19.627290 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa714b-c605-47fd-95ae-f149aeaae442 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:19.639507 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce13eab7-bf2e-4b43-abba-ec56ad3604b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:19.640304 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13eab7-bf2e-4b43-abba-ec56ad3604b6 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:19.640591 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13eab7-bf2e-4b43-abba-ec56ad3604b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:19.640894 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13eab7-bf2e-4b43-abba-ec56ad3604b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:19.651073 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce13eab7-bf2e-4b43-abba-ec56ad3604b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:19.652535 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce13eab7-bf2e-4b43-abba-ec56ad3604b6 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:19.670290 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-ce13eab7-bf2e-4b43-abba-ec56ad3604b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:19.670290 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:19.670290 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:19.670290 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:19.670290 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:19.670290 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:19.670290 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:19.670290 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:19.670290 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:19.670290 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:19.670290 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:19.670290 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:19.670290 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:19.670290 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:19.670290 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:19.671225 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:19.671225 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:19.671225 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:19.671225 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:19.671225 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:19.671225 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:19.671225 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:19.671225 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:19.671225 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:19.671225 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:19.671225 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:19.671225 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:19.671225 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:19.671225 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:19.671225 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:19.671225 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:19.671225 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:19.672056 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:19.672056 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:19.672056 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:19.672056 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:19.672056 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 261/508] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:19.672732 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74af1ce-b439-4330-8b7a-1d3d9d58a2f2 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:19.672957 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74af1ce-b439-4330-8b7a-1d3d9d58a2f2 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:19.673233 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74af1ce-b439-4330-8b7a-1d3d9d58a2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:19.689838 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-a74af1ce-b439-4330-8b7a-1d3d9d58a2f2 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:19.691084 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-a74af1ce-b439-4330-8b7a-1d3d9d58a2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:19.720985 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:19.733952 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa714b-c605-47fd-95ae-f149aeaae442 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:19.758206 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 262/509] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:58:19.759034 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74af1ce-b439-4330-8b7a-1d3d9d58a2f2 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:19.767839 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b868108-723a-4961-884a-21e2511d1526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:19.768503 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b868108-723a-4961-884a-21e2511d1526 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:19.769385 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b868108-723a-4961-884a-21e2511d1526 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:19.769935 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b868108-723a-4961-884a-21e2511d1526 None admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:19.770498 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b868108-723a-4961-884a-21e2511d1526 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:19.770807 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b868108-723a-4961-884a-21e2511d1526 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:19.772166 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b868108-723a-4961-884a-21e2511d1526 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:19.788887 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 248/510] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:19.788887 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b868108-723a-4961-884a-21e2511d1526 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:19.796315 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:19.863254 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74af1ce-b439-4330-8b7a-1d3d9d58a2f2 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:19.883952 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b868108-723a-4961-884a-21e2511d1526 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:19.896612 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e9c41-335b-47e6-bd09-5758fda048d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:19.897286 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e9c41-335b-47e6-bd09-5758fda048d8 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:19.897566 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e9c41-335b-47e6-bd09-5758fda048d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:19.897847 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e9c41-335b-47e6-bd09-5758fda048d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:19.918808 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78085250-ede5-4cd2-8e10-296d167ed273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:19.919599 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78085250-ede5-4cd2-8e10-296d167ed273 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:19.919878 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78085250-ede5-4cd2-8e10-296d167ed273 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:19.920149 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78085250-ede5-4cd2-8e10-296d167ed273 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:19.930099 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78085250-ede5-4cd2-8e10-296d167ed273 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:19.931556 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78085250-ede5-4cd2-8e10-296d167ed273 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:19.940504 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:19.954803 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-78085250-ede5-4cd2-8e10-296d167ed273 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:19.954803 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:19.954803 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:19.954803 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:19.954803 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:19.954803 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:19.954803 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:19.954803 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:19.954803 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:19.954803 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:19.954803 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:19.954803 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:19.954803 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:19.954803 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:19.954803 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:19.955844 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:19.955844 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:19.955844 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:19.955844 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:19.955844 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:19.955844 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:19.955844 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:19.955844 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:19.955844 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:19.955844 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:19.955844 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:19.955844 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:19.955844 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:19.955844 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:19.955844 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:19.955844 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:19.955844 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:19.962514 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:19.962514 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:19.962514 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:19.962514 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:19.962514 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 249/511] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:19.962514 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78085250-ede5-4cd2-8e10-296d167ed273 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:19.969412 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77e9c41-335b-47e6-bd09-5758fda048d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:19.970875 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77e9c41-335b-47e6-bd09-5758fda048d8 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:20.001642 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:20.062222 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78085250-ede5-4cd2-8e10-296d167ed273 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:20.070099 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 263/512] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 05:58:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:58:20.070929 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e9c41-335b-47e6-bd09-5758fda048d8 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:20.097374 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca58fae7-f65d-4a6b-98d8-7d91487a7d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:20.098171 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58fae7-f65d-4a6b-98d8-7d91487a7d9b None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:20.098454 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58fae7-f65d-4a6b-98d8-7d91487a7d9b None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:20.098724 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58fae7-f65d-4a6b-98d8-7d91487a7d9b None admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:20.099444 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca58fae7-f65d-4a6b-98d8-7d91487a7d9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:20.099749 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca58fae7-f65d-4a6b-98d8-7d91487a7d9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:20.101155 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca58fae7-f65d-4a6b-98d8-7d91487a7d9b None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:20.112020 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 250/513] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:20.113055 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca58fae7-f65d-4a6b-98d8-7d91487a7d9b None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:20.173315 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:20.177447 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e9c41-335b-47e6-bd09-5758fda048d8 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:20.208717 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:20.213960 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f354220-e7aa-4241-9b1a-fe32cd1d4cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:20.214752 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f354220-e7aa-4241-9b1a-fe32cd1d4cf4 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:20.215035 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f354220-e7aa-4241-9b1a-fe32cd1d4cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:20.215312 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f354220-e7aa-4241-9b1a-fe32cd1d4cf4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:20.217486 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca58fae7-f65d-4a6b-98d8-7d91487a7d9b None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:20.226978 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f354220-e7aa-4241-9b1a-fe32cd1d4cf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:20.228997 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f354220-e7aa-4241-9b1a-fe32cd1d4cf4 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:20.247013 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-8f354220-e7aa-4241-9b1a-fe32cd1d4cf4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:20.247013 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:20.247013 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:20.247013 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:20.247013 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:20.247013 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:20.247013 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:20.247013 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:20.247013 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:20.247013 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:20.247013 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:20.247013 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:20.247013 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:20.247013 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:20.247013 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:20.248023 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:20.248023 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:20.248023 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:20.248023 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:20.248023 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:20.248023 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:20.248023 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:20.248023 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:20.248023 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:20.248023 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:20.248023 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:20.248023 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:20.248023 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:20.248023 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:20.248023 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:20.248023 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:20.248023 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:20.249124 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:20.249124 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:20.249124 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:20.249124 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:20.252897 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 264/514] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:20.253824 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74108854-ca25-4504-a166-61227bf85808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:20.254620 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74108854-ca25-4504-a166-61227bf85808 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:20.254895 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74108854-ca25-4504-a166-61227bf85808 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:20.254988 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f354220-e7aa-4241-9b1a-fe32cd1d4cf4 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:20.255167 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74108854-ca25-4504-a166-61227bf85808 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:20.262779 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74108854-ca25-4504-a166-61227bf85808 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:20.264225 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74108854-ca25-4504-a166-61227bf85808 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:20.278641 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-74108854-ca25-4504-a166-61227bf85808 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 20 05:58:20.278641 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:20.278641 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:20.278641 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:20.278641 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:20.278641 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:20.278641 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:20.278641 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:20.278641 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:20.278641 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:20.278641 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:20.278641 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:20.278641 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:58:20.278641 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:58:20.278641 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:58:20.278641 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:58:20.279988 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:20.279988 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:20.279988 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:58:20.279988 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:20.279988 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:58:20.279988 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:20.279988 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:20.279988 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:20.279988 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:20.279988 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:20.279988 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:20.279988 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:20.279988 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:20.279988 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:20.279988 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:20.279988 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:20.279988 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:20.279988 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:20.281271 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:20.281271 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:20.281271 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:58:20.281271 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:58:20.281271 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:58:20.281271 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:58:20.281271 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:58:20.281271 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:58:20.281271 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 20 05:58:20.281271 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:20.281271 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 251/515] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 05:58:20 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:20.281271 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74108854-ca25-4504-a166-61227bf85808 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:20.359421 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f354220-e7aa-4241-9b1a-fe32cd1d4cf4 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:20.377537 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74108854-ca25-4504-a166-61227bf85808 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:20.392486 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb951c1-a60f-43d0-a21f-58dd3a23cda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:20.393171 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb951c1-a60f-43d0-a21f-58dd3a23cda3 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:20.393453 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb951c1-a60f-43d0-a21f-58dd3a23cda3 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:20.394364 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb951c1-a60f-43d0-a21f-58dd3a23cda3 None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:20.395250 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb951c1-a60f-43d0-a21f-58dd3a23cda3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:20.395559 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb951c1-a60f-43d0-a21f-58dd3a23cda3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:20.396950 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb951c1-a60f-43d0-a21f-58dd3a23cda3 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:20.398354 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:20.408039 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 265/516] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:20.408671 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb951c1-a60f-43d0-a21f-58dd3a23cda3 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:20.417315 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292336df-3bed-4c87-a98f-02852895e985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:20.418105 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292336df-3bed-4c87-a98f-02852895e985 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:20.418389 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292336df-3bed-4c87-a98f-02852895e985 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:20.418663 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292336df-3bed-4c87-a98f-02852895e985 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:20.429252 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292336df-3bed-4c87-a98f-02852895e985 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:20.430689 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292336df-3bed-4c87-a98f-02852895e985 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:20.448046 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-292336df-3bed-4c87-a98f-02852895e985 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:20.448046 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:20.448046 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:20.448046 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:20.448046 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:20.448046 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:20.448046 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:20.448046 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:20.448046 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:20.448046 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:20.448046 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:20.448046 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:20.448046 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:20.448046 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:20.448046 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:20.449087 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:20.449087 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:20.449087 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:20.449087 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:20.449087 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:20.449087 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:20.449087 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:20.449087 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:20.449087 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:20.449087 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:20.449087 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:20.449087 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:20.449087 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:20.449087 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:20.449087 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:20.449087 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:20.449087 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:20.449925 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:20.449925 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:20.449925 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:20.449925 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:20.449925 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 252/517] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:20.450178 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292336df-3bed-4c87-a98f-02852895e985 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:20.459171 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:20.513062 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb951c1-a60f-43d0-a21f-58dd3a23cda3 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:20.546013 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491fc332-6e3d-47ce-bc3d-fc960c8cf404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:20.546802 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fc332-6e3d-47ce-bc3d-fc960c8cf404 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:20.547086 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fc332-6e3d-47ce-bc3d-fc960c8cf404 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:20.547359 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fc332-6e3d-47ce-bc3d-fc960c8cf404 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:20.549708 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292336df-3bed-4c87-a98f-02852895e985 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:20.554568 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491fc332-6e3d-47ce-bc3d-fc960c8cf404 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:20.556010 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491fc332-6e3d-47ce-bc3d-fc960c8cf404 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:20.571103 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-491fc332-6e3d-47ce-bc3d-fc960c8cf404 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:20.571103 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:20.571103 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:20.571103 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:20.571103 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:20.571103 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:20.571103 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:20.571103 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:20.571103 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:20.571103 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:20.571103 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:20.571103 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:20.571103 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:58:20.571103 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:58:20.571103 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:58:20.572143 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:58:20.572143 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:20.572143 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:20.572143 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:20.572143 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:20.572143 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:20.572143 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:20.572143 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:20.572143 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:20.572143 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:20.572143 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:20.572143 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:20.572143 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:20.572143 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:20.572143 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:20.572143 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:20.572143 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:20.573158 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:58:20.573158 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:58:20.573158 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:58:20.573158 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:58:20.573158 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:58:20.573158 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:58:20.573158 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:20.573158 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:20.573158 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 266/518] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:20.573158 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491fc332-6e3d-47ce-bc3d-fc960c8cf404 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:20.587042 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af60b35-ac14-4d4b-a121-98029222807f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:20.587700 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af60b35-ac14-4d4b-a121-98029222807f None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:20.587982 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af60b35-ac14-4d4b-a121-98029222807f None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:20.588255 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af60b35-ac14-4d4b-a121-98029222807f None admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:20.589010 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af60b35-ac14-4d4b-a121-98029222807f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:20.589316 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af60b35-ac14-4d4b-a121-98029222807f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:20.590701 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af60b35-ac14-4d4b-a121-98029222807f None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:20.603005 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 253/519] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:20.603786 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af60b35-ac14-4d4b-a121-98029222807f None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:20.634917 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:20.674042 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491fc332-6e3d-47ce-bc3d-fc960c8cf404 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:20.676887 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:20.705965 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af60b35-ac14-4d4b-a121-98029222807f None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:20.709149 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6db8d-9207-460f-be89-161d0f7a744b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:20.709814 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6db8d-9207-460f-be89-161d0f7a744b None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:20.710091 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6db8d-9207-460f-be89-161d0f7a744b None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:20.710359 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6db8d-9207-460f-be89-161d0f7a744b None admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:20.711186 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f6db8d-9207-460f-be89-161d0f7a744b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:20.711494 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f6db8d-9207-460f-be89-161d0f7a744b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:20.712930 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f6db8d-9207-460f-be89-161d0f7a744b None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:20.729688 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 267/520] 10.222.0.39 () {56 vars in 1137 bytes} [Mon Jun 20 05:58:20 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:20.730474 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6db8d-9207-460f-be89-161d0f7a744b None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:20.742475 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf3054-9a68-419d-8aa6-40274d9c4133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:20.743271 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf3054-9a68-419d-8aa6-40274d9c4133 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:20.743551 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf3054-9a68-419d-8aa6-40274d9c4133 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:20.743822 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf3054-9a68-419d-8aa6-40274d9c4133 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:20.750899 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bf3054-9a68-419d-8aa6-40274d9c4133 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:20.752344 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bf3054-9a68-419d-8aa6-40274d9c4133 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:20.767984 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-c4bf3054-9a68-419d-8aa6-40274d9c4133 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 20 05:58:20.767984 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:20.767984 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:20.767984 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:20.767984 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:20.767984 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:20.767984 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:20.767984 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:20.767984 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:20.767984 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:20.767984 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:20.767984 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:20.767984 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:58:20.767984 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:58:20.767984 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:58:20.767984 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:58:20.769249 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:20.769249 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:20.769249 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:58:20.769249 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:20.769249 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:58:20.769249 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:20.769249 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:20.769249 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:20.769249 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:20.769249 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:20.769249 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:20.769249 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:20.769249 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:20.769249 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:20.769249 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:20.769249 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:20.769249 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:20.769249 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:20.770146 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:20.770146 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:20.770146 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:58:20.770146 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:58:20.770146 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:58:20.770146 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:58:20.770146 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:58:20.770146 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:58:20.770146 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 20 05:58:20.770146 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:20.771151 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 254/521] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jun 20 05:58:20 2022] GET /identity/v3/users/neutron => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:20.771151 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf3054-9a68-419d-8aa6-40274d9c4133 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:20.830202 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6db8d-9207-460f-be89-161d0f7a744b None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:20.861518 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:20.864908 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94be64d-09f5-42c6-b817-b9313f2de5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:20.865577 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94be64d-09f5-42c6-b817-b9313f2de5ad None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:20.865854 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94be64d-09f5-42c6-b817-b9313f2de5ad None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:20.866131 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94be64d-09f5-42c6-b817-b9313f2de5ad None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:20.866847 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94be64d-09f5-42c6-b817-b9313f2de5ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:20.867152 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94be64d-09f5-42c6-b817-b9313f2de5ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:20.868513 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94be64d-09f5-42c6-b817-b9313f2de5ad None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:20.871615 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf3054-9a68-419d-8aa6-40274d9c4133 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:20.879558 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 268/522] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:20.880329 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94be64d-09f5-42c6-b817-b9313f2de5ad None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:20.905149 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f3419-256d-4790-b54b-53a1a444d091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:20.905803 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f3419-256d-4790-b54b-53a1a444d091 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:20.905909 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:20.906084 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f3419-256d-4790-b54b-53a1a444d091 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:20.906356 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f3419-256d-4790-b54b-53a1a444d091 None admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:20.907143 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753f3419-256d-4790-b54b-53a1a444d091 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:20.907446 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753f3419-256d-4790-b54b-53a1a444d091 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:20.908940 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753f3419-256d-4790-b54b-53a1a444d091 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:20.928019 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 255/523] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jun 20 05:58:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:20.928868 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f3419-256d-4790-b54b-53a1a444d091 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:20.981242 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94be64d-09f5-42c6-b817-b9313f2de5ad None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:21.014478 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75824c3e-f391-44a6-9936-ce74c69986d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:21.015139 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75824c3e-f391-44a6-9936-ce74c69986d5 None admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:21.015416 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75824c3e-f391-44a6-9936-ce74c69986d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:21.015686 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75824c3e-f391-44a6-9936-ce74c69986d5 None admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:21.016383 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75824c3e-f391-44a6-9936-ce74c69986d5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:21.017840 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75824c3e-f391-44a6-9936-ce74c69986d5 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:21.027460 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f3419-256d-4790-b54b-53a1a444d091 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:21.039103 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 269/524] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Jun 20 05:58:20 2022] POST /identity/v3/users => generated 247 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:58:21.039951 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75824c3e-f391-44a6-9936-ce74c69986d5 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:21.073734 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b57f8a-1548-4e65-b753-490707aec9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:21.074762 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b57f8a-1548-4e65-b753-490707aec9f1 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:21.075212 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b57f8a-1548-4e65-b753-490707aec9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:21.075653 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b57f8a-1548-4e65-b753-490707aec9f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:21.114523 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:21.167422 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:21.184734 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b57f8a-1548-4e65-b753-490707aec9f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:21.186547 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b57f8a-1548-4e65-b753-490707aec9f1 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:21.200547 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75824c3e-f391-44a6-9936-ce74c69986d5 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:21.241811 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37df53e-b473-4107-898d-6678c5f53cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:21.242789 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37df53e-b473-4107-898d-6678c5f53cf4 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:21.243175 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37df53e-b473-4107-898d-6678c5f53cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:21.243682 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37df53e-b473-4107-898d-6678c5f53cf4 None admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:21.244400 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37df53e-b473-4107-898d-6678c5f53cf4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:21.244811 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37df53e-b473-4107-898d-6678c5f53cf4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:21.246226 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37df53e-b473-4107-898d-6678c5f53cf4 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:21.265369 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 270/525] 10.222.0.39 () {56 vars in 1139 bytes} [Mon Jun 20 05:58:21 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:21.266289 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37df53e-b473-4107-898d-6678c5f53cf4 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:21.308151 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 256/526] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 05:58:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:58:21.308950 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b57f8a-1548-4e65-b753-490707aec9f1 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:21.371456 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:21.379058 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37df53e-b473-4107-898d-6678c5f53cf4 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:21.416213 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd842139-92db-477d-a69e-46b3813e2c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:21.417330 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd842139-92db-477d-a69e-46b3813e2c0b None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:21.417797 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd842139-92db-477d-a69e-46b3813e2c0b None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:21.418075 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd842139-92db-477d-a69e-46b3813e2c0b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:21.421350 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:21.424251 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b57f8a-1548-4e65-b753-490707aec9f1 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:21.426400 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd842139-92db-477d-a69e-46b3813e2c0b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:21.428967 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd842139-92db-477d-a69e-46b3813e2c0b None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:21.444447 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-bd842139-92db-477d-a69e-46b3813e2c0b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:21.444447 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:21.444447 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:21.444447 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:21.444447 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:21.444447 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:21.444447 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:21.444447 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:21.444447 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:21.444447 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:21.444447 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:21.444447 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:21.444447 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:58:21.444447 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:58:21.444447 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:58:21.445380 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:58:21.445380 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:21.445380 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:21.445380 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:21.445380 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:21.445380 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:21.445380 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:21.445380 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:21.445380 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:21.445380 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:21.445380 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:21.445380 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:21.445380 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:21.445380 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:21.445380 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:21.445380 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:21.445380 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:21.446222 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:58:21.446222 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:58:21.446222 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:58:21.446222 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:58:21.446222 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:58:21.446222 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:58:21.446222 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:21.446222 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:21.450168 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 271/527] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:21.451239 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd842139-92db-477d-a69e-46b3813e2c0b None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:21.466150 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4754639-34f1-4236-8ea6-376ab9631349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:21.466815 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4754639-34f1-4236-8ea6-376ab9631349 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:21.467100 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4754639-34f1-4236-8ea6-376ab9631349 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:21.467377 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4754639-34f1-4236-8ea6-376ab9631349 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:21.468210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4754639-34f1-4236-8ea6-376ab9631349 None admin] RBAC: Adding query filter params (role.id=b7e86f43512c42bfa0d069e3e6fb97c5, scope.project.id=b349043204b34d1794818184ffe6505c, user.id=3cee106502e54829ad802ee41c9165fa) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:21.468528 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4754639-34f1-4236-8ea6-376ab9631349 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:21.470055 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4754639-34f1-4236-8ea6-376ab9631349 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:21.478982 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 257/528] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jun 20 05:58:21 2022] GET /identity/v3/role_assignments?user.id=3cee106502e54829ad802ee41c9165fa&scope.project.id=b349043204b34d1794818184ffe6505c&role.id=b7e86f43512c42bfa0d069e3e6fb97c5 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:21.480113 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4754639-34f1-4236-8ea6-376ab9631349 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:21.584130 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd842139-92db-477d-a69e-46b3813e2c0b None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:21.616085 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4754639-34f1-4236-8ea6-376ab9631349 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:21.632563 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0776a7c-54c0-4ce5-8af4-4ca3e4200e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:21.633263 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0776a7c-54c0-4ce5-8af4-4ca3e4200e5c None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:21.633551 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0776a7c-54c0-4ce5-8af4-4ca3e4200e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:21.633820 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0776a7c-54c0-4ce5-8af4-4ca3e4200e5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:21.637190 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:21.664227 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb84a01-bbb7-43ec-a026-8f25f25b2663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:21.665222 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb84a01-bbb7-43ec-a026-8f25f25b2663 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:21.665222 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb84a01-bbb7-43ec-a026-8f25f25b2663 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:21.665500 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb84a01-bbb7-43ec-a026-8f25f25b2663 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:21.678297 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb84a01-bbb7-43ec-a026-8f25f25b2663 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:21.679779 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb84a01-bbb7-43ec-a026-8f25f25b2663 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:21.699681 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-cbb84a01-bbb7-43ec-a026-8f25f25b2663 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:21.699681 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:21.699681 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:21.699681 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:21.699681 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:21.699681 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:21.699681 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:21.699681 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:21.699681 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:21.699681 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:21.699681 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:21.699681 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:21.699681 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:21.699681 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:21.699681 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:21.700601 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:21.700601 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:21.700601 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:21.700601 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:21.700601 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:21.700601 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:21.700601 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:21.700601 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:21.700601 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:21.700601 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:21.700601 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:21.700601 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:21.700601 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:21.700601 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:21.700601 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:21.700601 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:21.700601 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:21.702184 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:21.702184 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:21.702184 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:21.702184 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:21.702184 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 258/529] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:21.702723 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb84a01-bbb7-43ec-a026-8f25f25b2663 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:21.713967 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:21.724155 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0776a7c-54c0-4ce5-8af4-4ca3e4200e5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:21.725649 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0776a7c-54c0-4ce5-8af4-4ca3e4200e5c None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:21.808793 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb84a01-bbb7-43ec-a026-8f25f25b2663 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:21.844209 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560ab93-3c73-449a-ac5d-14d1ffbbd62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:21.845141 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560ab93-3c73-449a-ac5d-14d1ffbbd62e None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:21.845428 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560ab93-3c73-449a-ac5d-14d1ffbbd62e None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:21.845960 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560ab93-3c73-449a-ac5d-14d1ffbbd62e None admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:21.847292 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560ab93-3c73-449a-ac5d-14d1ffbbd62e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:21.847752 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560ab93-3c73-449a-ac5d-14d1ffbbd62e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:21.849886 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560ab93-3c73-449a-ac5d-14d1ffbbd62e None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:21.860430 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 272/530] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 05:58:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:58:21.861446 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0776a7c-54c0-4ce5-8af4-4ca3e4200e5c None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:21.872275 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 259/531] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jun 20 05:58:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:21.873210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560ab93-3c73-449a-ac5d-14d1ffbbd62e None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:21.908975 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:21.975255 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:21.986345 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0776a7c-54c0-4ce5-8af4-4ca3e4200e5c None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:21.994188 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560ab93-3c73-449a-ac5d-14d1ffbbd62e None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:22.025746 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24918e8a-32e3-426d-860f-3393af46d78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:22.026583 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24918e8a-32e3-426d-860f-3393af46d78a None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:22.026977 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24918e8a-32e3-426d-860f-3393af46d78a None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:22.027406 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24918e8a-32e3-426d-860f-3393af46d78a None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:22.028399 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24918e8a-32e3-426d-860f-3393af46d78a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:22.028817 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24918e8a-32e3-426d-860f-3393af46d78a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:22.030658 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24918e8a-32e3-426d-860f-3393af46d78a None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:22.031254 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0516bab-d815-40bf-8cac-4011d9557a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:22.032232 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0516bab-d815-40bf-8cac-4011d9557a70 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:22.032729 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0516bab-d815-40bf-8cac-4011d9557a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:22.033182 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0516bab-d815-40bf-8cac-4011d9557a70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:22.043691 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 273/532] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:22.044611 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24918e8a-32e3-426d-860f-3393af46d78a None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:22.044863 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0516bab-d815-40bf-8cac-4011d9557a70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:22.046485 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0516bab-d815-40bf-8cac-4011d9557a70 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:22.065437 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-a0516bab-d815-40bf-8cac-4011d9557a70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:22.065437 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:22.065437 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:22.065437 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:22.065437 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:22.065437 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:22.065437 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:22.065437 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:22.065437 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:22.065437 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:22.065437 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:22.065437 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:22.065437 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:22.065437 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:22.065437 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:22.067001 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:22.067001 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:22.067001 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:22.067001 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:22.067001 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:22.067001 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:22.067001 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:22.067001 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:22.067001 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:22.067001 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:22.067001 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:22.067001 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:22.067001 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:22.067001 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:22.067001 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:22.067001 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:22.067001 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:22.068028 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:22.068028 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:22.068028 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:22.068028 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:22.074058 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 260/533] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:22.075264 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0516bab-d815-40bf-8cac-4011d9557a70 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:22.157640 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24918e8a-32e3-426d-860f-3393af46d78a None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:22.158948 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:22.181224 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0516bab-d815-40bf-8cac-4011d9557a70 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:22.207227 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a593e1c3-5a1d-4348-a089-4f05fe22bdeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:22.207903 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593e1c3-5a1d-4348-a089-4f05fe22bdeb None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:22.208190 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593e1c3-5a1d-4348-a089-4f05fe22bdeb None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:22.208470 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593e1c3-5a1d-4348-a089-4f05fe22bdeb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:22.209522 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a593e1c3-5a1d-4348-a089-4f05fe22bdeb None admin] RBAC: Adding query filter params (role.id=b7e86f43512c42bfa0d069e3e6fb97c5, scope.project.id=b349043204b34d1794818184ffe6505c, user.id=19bd2ac77c5d48d49b58712f4025e279) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:22.209844 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a593e1c3-5a1d-4348-a089-4f05fe22bdeb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:22.211740 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a593e1c3-5a1d-4348-a089-4f05fe22bdeb None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:22.218840 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 274/534] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jun 20 05:58:22 2022] GET /identity/v3/role_assignments?user.id=19bd2ac77c5d48d49b58712f4025e279&scope.project.id=b349043204b34d1794818184ffe6505c&role.id=b7e86f43512c42bfa0d069e3e6fb97c5 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:22.219846 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a593e1c3-5a1d-4348-a089-4f05fe22bdeb None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:22.223043 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e6aa4-53e7-493c-b6a8-6d8c69da6bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:22.225245 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e6aa4-53e7-493c-b6a8-6d8c69da6bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:22.225980 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e6aa4-53e7-493c-b6a8-6d8c69da6bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:22.226580 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e6aa4-53e7-493c-b6a8-6d8c69da6bf9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:22.235972 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9e6aa4-53e7-493c-b6a8-6d8c69da6bf9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:22.238688 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9e6aa4-53e7-493c-b6a8-6d8c69da6bf9 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:22.247511 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:22.257091 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-6f9e6aa4-53e7-493c-b6a8-6d8c69da6bf9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:22.257091 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:22.257091 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:22.257091 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:22.257091 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:22.257091 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:22.257091 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:22.257091 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:22.257091 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:22.257091 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:22.257091 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:22.257091 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:22.257091 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:58:22.257091 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:58:22.257091 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:58:22.258202 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:58:22.258202 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:22.258202 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:22.258202 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:22.258202 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:22.258202 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:22.258202 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:22.258202 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:22.258202 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:22.258202 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:22.258202 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:22.258202 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:22.258202 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:22.258202 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:22.258202 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:22.258202 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:22.258202 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:22.259456 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:58:22.259456 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:58:22.259456 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:58:22.259456 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:58:22.259456 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:58:22.259456 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:58:22.259456 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:22.259456 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:22.259456 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 261/535] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:22.265916 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e6aa4-53e7-493c-b6a8-6d8c69da6bf9 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:22.376606 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a593e1c3-5a1d-4348-a089-4f05fe22bdeb None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:22.415420 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41587bd-e617-49a9-870c-a8ef1f669d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:22.416817 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41587bd-e617-49a9-870c-a8ef1f669d3a None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:22.417250 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41587bd-e617-49a9-870c-a8ef1f669d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:22.417815 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41587bd-e617-49a9-870c-a8ef1f669d3a None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:22.418700 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41587bd-e617-49a9-870c-a8ef1f669d3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:22.419198 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41587bd-e617-49a9-870c-a8ef1f669d3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:22.420827 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41587bd-e617-49a9-870c-a8ef1f669d3a None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:22.435534 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 275/536] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:22.443589 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41587bd-e617-49a9-870c-a8ef1f669d3a None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:22.535431 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e6aa4-53e7-493c-b6a8-6d8c69da6bf9 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:22.553381 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:22.587454 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41587bd-e617-49a9-870c-a8ef1f669d3a None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:22.606323 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52622557-cfc8-4eb8-a3e1-05565acd7e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:22.606990 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52622557-cfc8-4eb8-a3e1-05565acd7e80 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:22.607268 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52622557-cfc8-4eb8-a3e1-05565acd7e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:22.607536 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52622557-cfc8-4eb8-a3e1-05565acd7e80 None admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:22.608324 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52622557-cfc8-4eb8-a3e1-05565acd7e80 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:22.608629 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52622557-cfc8-4eb8-a3e1-05565acd7e80 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:22.610083 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52622557-cfc8-4eb8-a3e1-05565acd7e80 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:22.631957 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:22.638029 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 262/537] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jun 20 05:58:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:22.653698 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52622557-cfc8-4eb8-a3e1-05565acd7e80 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:22.667691 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691f63d-4af8-4f48-bbc1-27e5b785e036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:22.668423 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691f63d-4af8-4f48-bbc1-27e5b785e036 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:22.668732 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691f63d-4af8-4f48-bbc1-27e5b785e036 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:22.668992 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691f63d-4af8-4f48-bbc1-27e5b785e036 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:22.681863 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e691f63d-4af8-4f48-bbc1-27e5b785e036 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:22.685006 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e691f63d-4af8-4f48-bbc1-27e5b785e036 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:22.706664 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-e691f63d-4af8-4f48-bbc1-27e5b785e036 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:22.706664 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:22.706664 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:22.706664 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:22.706664 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:22.706664 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:22.706664 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:22.706664 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:22.706664 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:22.706664 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:22.706664 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:22.706664 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:22.706664 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:58:22.706664 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:58:22.706664 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:58:22.707552 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:58:22.707552 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:22.707552 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:22.707552 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:22.707552 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:22.707552 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:22.707552 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:22.707552 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:22.707552 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:22.707552 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:22.707552 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:22.707552 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:22.707552 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:22.707552 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:22.707552 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:22.707552 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:22.707552 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:22.708387 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:58:22.708387 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:58:22.708387 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:58:22.708387 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:58:22.708387 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:58:22.708387 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:58:22.708387 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:22.708387 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:22.715771 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 276/538] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:22.721153 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691f63d-4af8-4f48-bbc1-27e5b785e036 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:22.841943 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52622557-cfc8-4eb8-a3e1-05565acd7e80 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:22.902736 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79031204-9978-4f87-a5bb-9ef0cf17a23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:22.903751 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79031204-9978-4f87-a5bb-9ef0cf17a23c None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:22.905035 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79031204-9978-4f87-a5bb-9ef0cf17a23c None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:22.906344 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691f63d-4af8-4f48-bbc1-27e5b785e036 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:22.906829 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79031204-9978-4f87-a5bb-9ef0cf17a23c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:22.907878 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79031204-9978-4f87-a5bb-9ef0cf17a23c None admin] RBAC: Adding query filter params (role.id=b7e86f43512c42bfa0d069e3e6fb97c5, scope.project.id=b349043204b34d1794818184ffe6505c, user.id=b9cb22811a754357ab9d839b70d44261) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:22.910045 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79031204-9978-4f87-a5bb-9ef0cf17a23c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:22.911732 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79031204-9978-4f87-a5bb-9ef0cf17a23c None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:22.926286 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 263/539] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jun 20 05:58:22 2022] GET /identity/v3/role_assignments?user.id=b9cb22811a754357ab9d839b70d44261&scope.project.id=b349043204b34d1794818184ffe6505c&role.id=b7e86f43512c42bfa0d069e3e6fb97c5 => generated 259 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:58:22.951659 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb0b014-6000-4dc9-b423-565cb7d74584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:22.952738 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0b014-6000-4dc9-b423-565cb7d74584 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:22.953251 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0b014-6000-4dc9-b423-565cb7d74584 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:22.953726 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0b014-6000-4dc9-b423-565cb7d74584 None admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:22.954751 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb0b014-6000-4dc9-b423-565cb7d74584 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:22.955308 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb0b014-6000-4dc9-b423-565cb7d74584 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:22.957564 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb0b014-6000-4dc9-b423-565cb7d74584 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:22.979670 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 277/540] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jun 20 05:58:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:22.981099 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:22.985935 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79031204-9978-4f87-a5bb-9ef0cf17a23c None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:23.094580 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:23.140410 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79031204-9978-4f87-a5bb-9ef0cf17a23c None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:23.182045 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db600756-4bff-43fd-b2b4-ada143867aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:23.182711 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db600756-4bff-43fd-b2b4-ada143867aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:23.183034 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db600756-4bff-43fd-b2b4-ada143867aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:23.183312 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db600756-4bff-43fd-b2b4-ada143867aa6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:23.184230 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db600756-4bff-43fd-b2b4-ada143867aa6 None admin] RBAC: Adding query filter params (role.id=b7e86f43512c42bfa0d069e3e6fb97c5, scope.project.id=b349043204b34d1794818184ffe6505c, user.id=83e77cb05c4546c7a98ada817573edf3) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:23.184575 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db600756-4bff-43fd-b2b4-ada143867aa6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:23.186031 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db600756-4bff-43fd-b2b4-ada143867aa6 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:23.193393 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 264/541] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jun 20 05:58:22 2022] GET /identity/v3/role_assignments?user.id=83e77cb05c4546c7a98ada817573edf3&scope.project.id=b349043204b34d1794818184ffe6505c&role.id=b7e86f43512c42bfa0d069e3e6fb97c5 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:58:23.258125 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb12e56-c6e0-4c47-b3d9-c239bf5f13de None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:23.258734 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb12e56-c6e0-4c47-b3d9-c239bf5f13de None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:23.259202 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb12e56-c6e0-4c47-b3d9-c239bf5f13de None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:23.261136 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 278/542] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:58:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:23.266780 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24ba6f-0a35-4afc-ae8a-a9a7a14a70a0 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:23.267067 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24ba6f-0a35-4afc-ae8a-a9a7a14a70a0 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:23.267345 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24ba6f-0a35-4afc-ae8a-a9a7a14a70a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:23.290857 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-0c24ba6f-0a35-4afc-ae8a-a9a7a14a70a0 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:23.292153 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-0c24ba6f-0a35-4afc-ae8a-a9a7a14a70a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:23.398034 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 265/543] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:58:23.421389 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb12e56-c6e0-4c47-b3d9-c239bf5f13de None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:23.573957 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb12e56-c6e0-4c47-b3d9-c239bf5f13de None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:23.620159 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e9fe90-3350-4970-a6d1-27469656cb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:23.621000 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9fe90-3350-4970-a6d1-27469656cb42 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:23.621283 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9fe90-3350-4970-a6d1-27469656cb42 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:23.621559 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9fe90-3350-4970-a6d1-27469656cb42 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:23.640536 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e9fe90-3350-4970-a6d1-27469656cb42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:23.649419 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-25e9fe90-3350-4970-a6d1-27469656cb42 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:23.649419 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:23.649419 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:23.649419 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:23.649419 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:23.649419 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:23.649419 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:23.649419 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:23.649419 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:23.649419 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:23.649419 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:23.649419 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:23.649419 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:23.649419 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:23.649419 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:23.649419 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:23.650278 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:23.650278 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:23.650278 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:23.650278 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:23.650278 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:23.650278 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:23.650278 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:23.650278 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:23.650278 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:23.650278 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:23.650278 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:23.650278 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:23.650278 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:23.650278 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:23.650278 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:23.650278 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:23.651065 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:23.651065 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:23.651065 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:23.651065 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:23.651065 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:23.651065 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:23.651065 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:23.651065 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:23.651065 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:23.651065 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:23.651065 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:23.651065 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:23.657480 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 279/544] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jun 20 05:58:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:23.665830 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c24ba6f-0a35-4afc-ae8a-a9a7a14a70a0 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:23.759494 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:23.819459 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c24ba6f-0a35-4afc-ae8a-a9a7a14a70a0 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:23.838281 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e8090-c62b-406c-bc99-c1a39a4e1193 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:23.838878 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e8090-c62b-406c-bc99-c1a39a4e1193 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:23.839359 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e8090-c62b-406c-bc99-c1a39a4e1193 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:23.841263 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 280/545] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:58:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:23.854060 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be78847-7303-4e0b-9138-0a2fe467d834 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:23.854639 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be78847-7303-4e0b-9138-0a2fe467d834 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:23.855115 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be78847-7303-4e0b-9138-0a2fe467d834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:23.875233 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7065dea4-f47c-4614-b4e2-737e9c6acc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:23.876231 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065dea4-f47c-4614-b4e2-737e9c6acc15 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:23.876729 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065dea4-f47c-4614-b4e2-737e9c6acc15 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:23.877226 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065dea4-f47c-4614-b4e2-737e9c6acc15 None admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:23.879011 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7065dea4-f47c-4614-b4e2-737e9c6acc15 None admin] RBAC: Adding query filter params (name=service) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:23.879537 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7065dea4-f47c-4614-b4e2-737e9c6acc15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:23.881159 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7065dea4-f47c-4614-b4e2-737e9c6acc15 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:23.893944 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-2be78847-7303-4e0b-9138-0a2fe467d834 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:23.895753 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-2be78847-7303-4e0b-9138-0a2fe467d834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:23.898693 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 266/546] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jun 20 05:58:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:23.904861 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7065dea4-f47c-4614-b4e2-737e9c6acc15 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:24.001052 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:24.020607 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 281/547] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:58:24.060294 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be78847-7303-4e0b-9138-0a2fe467d834 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:24.088332 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7065dea4-f47c-4614-b4e2-737e9c6acc15 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:24.125284 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:24.152356 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9b88e-abbd-4507-ae5d-3e99ba992dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:24.153177 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9b88e-abbd-4507-ae5d-3e99ba992dba None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:24.153459 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9b88e-abbd-4507-ae5d-3e99ba992dba None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:24.153733 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9b88e-abbd-4507-ae5d-3e99ba992dba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:24.172605 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad9b88e-abbd-4507-ae5d-3e99ba992dba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:24.176913 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad9b88e-abbd-4507-ae5d-3e99ba992dba None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:24.209916 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-aad9b88e-abbd-4507-ae5d-3e99ba992dba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:24.209916 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:24.209916 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:24.209916 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:24.209916 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:24.209916 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:24.209916 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:24.209916 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:24.209916 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:24.209916 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:24.209916 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:24.209916 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:24.209916 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:24.209916 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:24.209916 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:24.210817 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:24.210817 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:24.210817 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:24.210817 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:24.210817 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:24.210817 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:24.210817 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:24.210817 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:24.210817 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:24.210817 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:24.210817 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:24.210817 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:24.210817 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:24.210817 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:24.210817 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:24.210817 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:24.210817 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:24.211643 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:24.211643 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:24.211643 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:24.211643 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:24.214891 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 267/548] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:24.218585 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9b88e-abbd-4507-ae5d-3e99ba992dba None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:24.229694 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be78847-7303-4e0b-9138-0a2fe467d834 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:24.275105 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226d756-0844-4399-8dfb-9d32cb455de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:24.275866 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226d756-0844-4399-8dfb-9d32cb455de6 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:24.276152 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226d756-0844-4399-8dfb-9d32cb455de6 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:24.276430 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226d756-0844-4399-8dfb-9d32cb455de6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:24.288434 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b226d756-0844-4399-8dfb-9d32cb455de6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:24.297283 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-b226d756-0844-4399-8dfb-9d32cb455de6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:24.297283 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:24.297283 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:24.297283 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:24.297283 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:24.297283 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:24.297283 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:24.297283 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:24.297283 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:24.297283 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:24.297283 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:24.297283 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:24.297283 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:24.297283 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:24.297283 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:24.297283 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:24.298265 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:24.298265 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:24.298265 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:24.298265 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:24.298265 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:24.298265 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:24.298265 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:24.298265 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:24.298265 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:24.298265 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:24.298265 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:24.298265 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:24.298265 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:24.298265 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:24.298265 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:24.298265 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:24.300064 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:24.300064 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:24.300064 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:24.300064 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:24.300064 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:24.300064 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:24.300064 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:24.300064 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:24.300064 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:24.300064 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:24.300064 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:24.300064 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:24.300064 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 282/549] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jun 20 05:58:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:58:24.306692 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226d756-0844-4399-8dfb-9d32cb455de6 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:24.405120 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:24.417969 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9b88e-abbd-4507-ae5d-3e99ba992dba None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:24.467185 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96a316e-94f6-44a0-b7ca-da43fcf12d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:24.467855 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a316e-94f6-44a0-b7ca-da43fcf12d67 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:24.468138 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a316e-94f6-44a0-b7ca-da43fcf12d67 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:24.468413 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a316e-94f6-44a0-b7ca-da43fcf12d67 None admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:24.469198 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96a316e-94f6-44a0-b7ca-da43fcf12d67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:24.469502 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96a316e-94f6-44a0-b7ca-da43fcf12d67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:24.470899 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96a316e-94f6-44a0-b7ca-da43fcf12d67 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:24.484805 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 268/550] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:24.494135 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96a316e-94f6-44a0-b7ca-da43fcf12d67 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:24.527034 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226d756-0844-4399-8dfb-9d32cb455de6 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:24.552866 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:24.588850 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ef10f2-34d6-44f0-8c1b-54680417ff88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:24.589878 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef10f2-34d6-44f0-8c1b-54680417ff88 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:24.590355 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef10f2-34d6-44f0-8c1b-54680417ff88 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:24.590847 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef10f2-34d6-44f0-8c1b-54680417ff88 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:24.591789 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ef10f2-34d6-44f0-8c1b-54680417ff88 None admin] RBAC: Adding query filter params (name=service) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:24.592294 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ef10f2-34d6-44f0-8c1b-54680417ff88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:24.593893 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ef10f2-34d6-44f0-8c1b-54680417ff88 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:24.607902 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 283/551] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jun 20 05:58:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:24.617285 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ef10f2-34d6-44f0-8c1b-54680417ff88 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:24.673954 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96a316e-94f6-44a0-b7ca-da43fcf12d67 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:24.710733 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26df1db4-42da-4d81-988c-4cf8a9b95ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:24.711889 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df1db4-42da-4d81-988c-4cf8a9b95ef8 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:24.712400 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df1db4-42da-4d81-988c-4cf8a9b95ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:24.712892 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df1db4-42da-4d81-988c-4cf8a9b95ef8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:24.728625 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26df1db4-42da-4d81-988c-4cf8a9b95ef8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:24.731057 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26df1db4-42da-4d81-988c-4cf8a9b95ef8 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:24.748604 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ef10f2-34d6-44f0-8c1b-54680417ff88 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:24.751813 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-26df1db4-42da-4d81-988c-4cf8a9b95ef8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 20 05:58:24.751813 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:24.751813 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:24.751813 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:24.751813 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:24.751813 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:24.751813 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:24.751813 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:24.751813 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:24.751813 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:24.751813 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:24.751813 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:24.751813 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:58:24.751813 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:58:24.751813 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:58:24.751813 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:58:24.753285 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:24.753285 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:24.753285 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:58:24.753285 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:24.753285 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:58:24.753285 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:24.753285 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:24.753285 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:24.753285 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:24.753285 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:24.753285 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:24.753285 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:24.753285 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:24.753285 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:24.753285 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:24.753285 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:24.753285 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:24.753285 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:24.754491 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:24.754491 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:24.754491 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:58:24.754491 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:58:24.754491 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:58:24.754491 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:58:24.754491 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:58:24.754491 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:58:24.754491 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 20 05:58:24.754491 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:24.756751 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 269/552] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jun 20 05:58:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:24.762050 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b11950-6b3e-4956-9f32-99f340db1779 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:24.762328 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b11950-6b3e-4956-9f32-99f340db1779 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:24.762598 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b11950-6b3e-4956-9f32-99f340db1779 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:24.763995 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 270/553] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:58:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:24.764559 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b11950-6b3e-4956-9f32-99f340db1779 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:24.771850 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:24.796486 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714fd145-862d-43d1-97d8-ea15b9406769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:24.797173 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714fd145-862d-43d1-97d8-ea15b9406769 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:24.797503 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714fd145-862d-43d1-97d8-ea15b9406769 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:24.797777 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714fd145-862d-43d1-97d8-ea15b9406769 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:24.810523 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714fd145-862d-43d1-97d8-ea15b9406769 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:24.812389 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714fd145-862d-43d1-97d8-ea15b9406769 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:24.831271 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-714fd145-862d-43d1-97d8-ea15b9406769 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:24.831271 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:24.831271 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:24.831271 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:24.831271 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:24.831271 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:24.831271 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:24.831271 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:24.831271 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:24.831271 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:24.831271 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:24.831271 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:24.831271 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:24.831271 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:24.831271 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:24.832244 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:24.832244 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:24.832244 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:24.832244 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:24.832244 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:24.832244 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:24.832244 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:24.832244 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:24.832244 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:24.832244 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:24.832244 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:24.832244 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:24.832244 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:24.832244 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:24.832244 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:24.832244 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:24.832244 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:24.833199 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:24.833199 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:24.833199 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:24.833199 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:24.833199 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 284/554] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:24.834054 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a86b3-0033-446b-b457-7e1ec7ea2b30 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:24.834336 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a86b3-0033-446b-b457-7e1ec7ea2b30 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:24.834611 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a86b3-0033-446b-b457-7e1ec7ea2b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:24.852679 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-e77a86b3-0033-446b-b457-7e1ec7ea2b30 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:24.853921 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-e77a86b3-0033-446b-b457-7e1ec7ea2b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:24.890413 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:24.903005 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b11950-6b3e-4956-9f32-99f340db1779 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:24.930359 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 285/555] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:58:24.931245 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a86b3-0033-446b-b457-7e1ec7ea2b30 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:24.949425 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84161c3d-7ccd-45d4-96ab-cbbd964a1d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:24.951292 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84161c3d-7ccd-45d4-96ab-cbbd964a1d5a None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:24.951776 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84161c3d-7ccd-45d4-96ab-cbbd964a1d5a None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:24.952252 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84161c3d-7ccd-45d4-96ab-cbbd964a1d5a None admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:24.953335 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84161c3d-7ccd-45d4-96ab-cbbd964a1d5a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:24.953865 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84161c3d-7ccd-45d4-96ab-cbbd964a1d5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:24.956952 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84161c3d-7ccd-45d4-96ab-cbbd964a1d5a None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:24.979267 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 271/556] 10.222.0.39 () {56 vars in 1135 bytes} [Mon Jun 20 05:58:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:24.985523 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84161c3d-7ccd-45d4-96ab-cbbd964a1d5a None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:25.041246 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:25.050338 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a86b3-0033-446b-b457-7e1ec7ea2b30 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:25.089711 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60252da8-6a99-48f0-a8a5-0f4a0da43855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:25.090427 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60252da8-6a99-48f0-a8a5-0f4a0da43855 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:25.090730 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60252da8-6a99-48f0-a8a5-0f4a0da43855 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:25.091004 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60252da8-6a99-48f0-a8a5-0f4a0da43855 None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:25.091775 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60252da8-6a99-48f0-a8a5-0f4a0da43855 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:25.092084 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60252da8-6a99-48f0-a8a5-0f4a0da43855 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:25.093729 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60252da8-6a99-48f0-a8a5-0f4a0da43855 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:25.106561 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 286/557] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:25.107556 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60252da8-6a99-48f0-a8a5-0f4a0da43855 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:25.111364 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84161c3d-7ccd-45d4-96ab-cbbd964a1d5a None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:25.161649 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7093f-239e-4d0a-9430-c37180287ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:25.163199 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7093f-239e-4d0a-9430-c37180287ff2 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:25.163680 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7093f-239e-4d0a-9430-c37180287ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:25.164173 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7093f-239e-4d0a-9430-c37180287ff2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:25.178670 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7093f-239e-4d0a-9430-c37180287ff2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:25.189639 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-c1c7093f-239e-4d0a-9430-c37180287ff2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:25.189639 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:25.189639 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:25.189639 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:25.189639 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:25.189639 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:25.189639 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:25.189639 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:25.189639 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:25.189639 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:25.189639 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:25.189639 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:25.189639 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:25.189639 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:25.189639 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:25.189639 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:25.192388 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:25.192388 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:25.192388 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:25.192388 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:25.192388 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:25.192388 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:25.192388 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:25.192388 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:25.192388 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:25.192388 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:25.192388 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:25.192388 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:25.192388 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:25.192388 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:25.192388 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:25.192388 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:25.194406 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:25.194406 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:25.194406 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:25.194406 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:25.194406 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:25.194406 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:25.194406 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:25.194406 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:25.194406 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:25.194406 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:25.194406 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:25.194406 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:25.198603 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 272/558] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jun 20 05:58:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:25.199666 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7093f-239e-4d0a-9430-c37180287ff2 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:25.216320 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:25.228413 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60252da8-6a99-48f0-a8a5-0f4a0da43855 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:25.269061 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1cb0c4-160a-4b9e-b0ba-43953f067942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:25.269718 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1cb0c4-160a-4b9e-b0ba-43953f067942 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:25.269996 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1cb0c4-160a-4b9e-b0ba-43953f067942 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:25.270263 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1cb0c4-160a-4b9e-b0ba-43953f067942 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:25.302064 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:25.337002 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7093f-239e-4d0a-9430-c37180287ff2 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:25.353291 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1cb0c4-160a-4b9e-b0ba-43953f067942 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:25.354744 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1cb0c4-160a-4b9e-b0ba-43953f067942 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:25.383277 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e921c-285c-47d0-adc2-e4d6f85d46a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:25.385070 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e921c-285c-47d0-adc2-e4d6f85d46a2 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:25.385558 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e921c-285c-47d0-adc2-e4d6f85d46a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:25.386260 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e921c-285c-47d0-adc2-e4d6f85d46a2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:25.398257 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e921c-285c-47d0-adc2-e4d6f85d46a2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:25.400485 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e921c-285c-47d0-adc2-e4d6f85d46a2 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:25.421397 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-966e921c-285c-47d0-adc2-e4d6f85d46a2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 05:58:25.421397 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:25.421397 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:25.421397 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:25.421397 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:25.421397 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:25.421397 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:25.421397 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:25.421397 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:25.421397 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:25.421397 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:25.421397 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:25.421397 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:58:25.421397 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:58:25.421397 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:58:25.421397 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:58:25.422461 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:25.422461 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:25.422461 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:58:25.422461 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:25.422461 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:58:25.422461 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:25.422461 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:25.422461 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:25.422461 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:25.422461 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:25.422461 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:25.422461 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:25.422461 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:25.422461 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:25.422461 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:25.422461 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:25.422461 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:25.422461 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:25.423392 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:25.423392 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:25.423392 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:58:25.423392 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:58:25.423392 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:58:25.423392 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:58:25.423392 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:58:25.423392 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:58:25.423392 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 05:58:25.423392 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:25.423392 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 273/559] 10.222.0.39 () {56 vars in 1093 bytes} [Mon Jun 20 05:58:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:25.423975 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e921c-285c-47d0-adc2-e4d6f85d46a2 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:25.479827 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 287/560] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 05:58:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:58:25.479827 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1cb0c4-160a-4b9e-b0ba-43953f067942 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:25.512260 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:25.537790 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:25.547153 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e921c-285c-47d0-adc2-e4d6f85d46a2 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:25.583831 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca40fb7-8959-40ed-92b9-7b9d335a55ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:25.584408 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca40fb7-8959-40ed-92b9-7b9d335a55ca None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:25.584686 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca40fb7-8959-40ed-92b9-7b9d335a55ca None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:25.584987 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca40fb7-8959-40ed-92b9-7b9d335a55ca None admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:25.585727 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca40fb7-8959-40ed-92b9-7b9d335a55ca None admin] RBAC: Adding query filter params (name=service) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:25.586030 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca40fb7-8959-40ed-92b9-7b9d335a55ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:25.586122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1cb0c4-160a-4b9e-b0ba-43953f067942 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:25.587389 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca40fb7-8959-40ed-92b9-7b9d335a55ca None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:25.595563 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 274/561] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jun 20 05:58:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:25.596894 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34771114-0a38-4298-a182-4d40f92f3073 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:25.597188 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34771114-0a38-4298-a182-4d40f92f3073 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:25.597464 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34771114-0a38-4298-a182-4d40f92f3073 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:25.600758 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 275/562] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:58:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:25.600758 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34771114-0a38-4298-a182-4d40f92f3073 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:25.621032 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878445a8-fca9-4350-87ee-063b3bf80a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:25.621700 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878445a8-fca9-4350-87ee-063b3bf80a0d None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:25.621977 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878445a8-fca9-4350-87ee-063b3bf80a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:25.622250 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878445a8-fca9-4350-87ee-063b3bf80a0d None admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:25.623077 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878445a8-fca9-4350-87ee-063b3bf80a0d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:25.623384 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878445a8-fca9-4350-87ee-063b3bf80a0d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:25.624812 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878445a8-fca9-4350-87ee-063b3bf80a0d None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:25.642413 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 288/563] 10.222.0.39 () {56 vars in 1133 bytes} [Mon Jun 20 05:58:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:25.644246 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192abc07-3050-4885-860e-be0c8c8d0034 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:25.644531 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192abc07-3050-4885-860e-be0c8c8d0034 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:25.644831 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192abc07-3050-4885-860e-be0c8c8d0034 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:25.646070 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 289/564] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:58:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:25.646757 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192abc07-3050-4885-860e-be0c8c8d0034 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:25.704966 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34771114-0a38-4298-a182-4d40f92f3073 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:25.733914 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:25.739930 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ecff72-c080-4c9e-bf82-57addc7617d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:25.740744 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ecff72-c080-4c9e-bf82-57addc7617d1 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:25.741036 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ecff72-c080-4c9e-bf82-57addc7617d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:25.741315 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ecff72-c080-4c9e-bf82-57addc7617d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:25.746759 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192abc07-3050-4885-860e-be0c8c8d0034 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:25.751923 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ecff72-c080-4c9e-bf82-57addc7617d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:25.754067 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ecff72-c080-4c9e-bf82-57addc7617d1 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:25.760238 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:25.771114 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-18ecff72-c080-4c9e-bf82-57addc7617d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:25.771114 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:25.771114 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:25.771114 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:25.771114 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:25.771114 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:25.771114 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:25.771114 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:25.771114 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:25.771114 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:25.771114 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:25.771114 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:25.771114 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:25.771114 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:25.771114 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:25.772012 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:25.772012 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:25.772012 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:25.772012 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:25.772012 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:25.772012 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:25.772012 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:25.772012 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:25.772012 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:25.772012 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:25.772012 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:25.772012 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:25.772012 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:25.772012 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:25.772012 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:25.772012 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:25.772012 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:25.772964 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:25.772964 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:25.772964 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:25.772964 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:25.772964 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 276/565] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:25.773651 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ded37-004a-49a0-8837-71e5eebea510 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:25.773939 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ded37-004a-49a0-8837-71e5eebea510 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:25.774218 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ded37-004a-49a0-8837-71e5eebea510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:25.785939 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0a7c3-02d6-4dbb-9305-d218106fd80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:25.786724 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0a7c3-02d6-4dbb-9305-d218106fd80b None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:25.787002 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0a7c3-02d6-4dbb-9305-d218106fd80b None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:25.787272 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0a7c3-02d6-4dbb-9305-d218106fd80b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:25.790189 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-e61ded37-004a-49a0-8837-71e5eebea510 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:25.791384 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-e61ded37-004a-49a0-8837-71e5eebea510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:25.797427 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb0a7c3-02d6-4dbb-9305-d218106fd80b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:25.798896 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb0a7c3-02d6-4dbb-9305-d218106fd80b None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:25.817524 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-5fb0a7c3-02d6-4dbb-9305-d218106fd80b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:25.817524 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:25.817524 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:25.817524 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:25.817524 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:25.817524 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:25.817524 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:25.817524 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:25.817524 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:25.817524 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:25.817524 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:25.817524 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:25.817524 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:25.817524 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:25.817524 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:25.818449 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:25.818449 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:25.818449 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:25.818449 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:25.818449 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:25.818449 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:25.818449 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:25.818449 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:25.818449 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:25.818449 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:25.818449 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:25.818449 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:25.818449 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:25.818449 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:25.818449 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:25.818449 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:25.818449 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:25.819318 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:25.819318 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:25.819318 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:25.819318 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:25.819318 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 290/566] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:25.819596 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0a7c3-02d6-4dbb-9305-d218106fd80b None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:25.858404 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 277/567] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:58:25.859467 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4527e-c4a7-4a7c-b477-117c72483958 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:25.859758 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4527e-c4a7-4a7c-b477-117c72483958 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:25.860038 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4527e-c4a7-4a7c-b477-117c72483958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:25.876215 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-71a4527e-c4a7-4a7c-b477-117c72483958 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:25.877435 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-71a4527e-c4a7-4a7c-b477-117c72483958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:25.931724 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0a7c3-02d6-4dbb-9305-d218106fd80b None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:25.943564 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 278/568] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:58:25.944393 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a4527e-c4a7-4a7c-b477-117c72483958 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:25.967513 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e67974-23b8-4fe7-8cc0-62a96d3aeddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:25.968306 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e67974-23b8-4fe7-8cc0-62a96d3aeddd None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:25.968585 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e67974-23b8-4fe7-8cc0-62a96d3aeddd None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:25.968884 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e67974-23b8-4fe7-8cc0-62a96d3aeddd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:25.979152 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e67974-23b8-4fe7-8cc0-62a96d3aeddd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:25.980623 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e67974-23b8-4fe7-8cc0-62a96d3aeddd None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:25.992285 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:25.998479 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-23e67974-23b8-4fe7-8cc0-62a96d3aeddd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:25.998479 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:25.998479 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:25.998479 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:25.998479 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:25.998479 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:25.998479 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:25.998479 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:25.998479 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:25.998479 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:25.998479 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:25.998479 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:25.998479 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:25.998479 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:25.998479 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:25.999554 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:25.999554 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:25.999554 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:25.999554 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:25.999554 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:25.999554 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:25.999554 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:25.999554 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:25.999554 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:25.999554 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:25.999554 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:25.999554 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:25.999554 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:25.999554 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:25.999554 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:25.999554 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:25.999554 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:26.000435 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:26.000435 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:26.000435 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:26.000435 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:26.000435 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 291/569] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:26.000737 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e67974-23b8-4fe7-8cc0-62a96d3aeddd None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:26.021655 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:26.051303 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a4527e-c4a7-4a7c-b477-117c72483958 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:26.086563 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f0feef-f6e5-4ce9-a0e1-c74bce2008fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:26.087225 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0feef-f6e5-4ce9-a0e1-c74bce2008fe None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:26.087506 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0feef-f6e5-4ce9-a0e1-c74bce2008fe None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:26.087783 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0feef-f6e5-4ce9-a0e1-c74bce2008fe None admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:26.088506 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f0feef-f6e5-4ce9-a0e1-c74bce2008fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:26.088842 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f0feef-f6e5-4ce9-a0e1-c74bce2008fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:26.090211 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f0feef-f6e5-4ce9-a0e1-c74bce2008fe None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:26.101850 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 279/570] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:26.102300 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e67974-23b8-4fe7-8cc0-62a96d3aeddd None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:26.102676 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f0feef-f6e5-4ce9-a0e1-c74bce2008fe None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:26.136889 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b4f9b-70ed-4f55-9918-b359a467bc08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:26.137481 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b4f9b-70ed-4f55-9918-b359a467bc08 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:26.137770 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b4f9b-70ed-4f55-9918-b359a467bc08 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:26.138040 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b4f9b-70ed-4f55-9918-b359a467bc08 None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:26.138762 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8b4f9b-70ed-4f55-9918-b359a467bc08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:26.139071 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8b4f9b-70ed-4f55-9918-b359a467bc08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:26.140434 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8b4f9b-70ed-4f55-9918-b359a467bc08 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:26.151996 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 292/571] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:26.152822 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b4f9b-70ed-4f55-9918-b359a467bc08 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:26.205290 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f0feef-f6e5-4ce9-a0e1-c74bce2008fe None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:26.208145 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:26.230630 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:26.240803 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be60e979-1b78-499a-b2fa-f77c3cccfd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:26.241594 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be60e979-1b78-499a-b2fa-f77c3cccfd76 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:26.241875 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be60e979-1b78-499a-b2fa-f77c3cccfd76 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:26.242150 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be60e979-1b78-499a-b2fa-f77c3cccfd76 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:26.251967 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be60e979-1b78-499a-b2fa-f77c3cccfd76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:26.255382 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b4f9b-70ed-4f55-9918-b359a467bc08 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:26.262655 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-be60e979-1b78-499a-b2fa-f77c3cccfd76 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:26.262655 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:26.262655 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:26.262655 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:26.262655 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:26.262655 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:26.262655 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:26.262655 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:26.262655 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:26.262655 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:26.262655 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:26.262655 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:26.262655 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:26.262655 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:26.262655 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:26.262655 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:26.263583 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:26.263583 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:26.263583 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:26.263583 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:26.263583 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:26.263583 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:26.263583 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:26.263583 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:26.263583 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:26.263583 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:26.263583 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:26.263583 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:26.263583 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:26.263583 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:26.263583 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:26.263583 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:26.264402 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:26.264402 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:26.264402 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:26.264402 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:26.264402 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:26.264402 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:26.264402 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:26.264402 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:26.264402 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:26.264402 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:26.264402 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:26.264402 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:26.264402 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 280/572] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jun 20 05:58:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:26.265193 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be60e979-1b78-499a-b2fa-f77c3cccfd76 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:26.296388 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df3343-a513-4520-afdf-b6597eea8931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:26.297219 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df3343-a513-4520-afdf-b6597eea8931 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:26.297555 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df3343-a513-4520-afdf-b6597eea8931 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:26.297836 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df3343-a513-4520-afdf-b6597eea8931 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:26.310610 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df3343-a513-4520-afdf-b6597eea8931 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:26.318681 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-63df3343-a513-4520-afdf-b6597eea8931 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:26.318681 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:26.318681 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:26.318681 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:26.318681 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:26.318681 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:26.318681 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:26.318681 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:26.318681 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:26.318681 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:26.318681 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:26.318681 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:26.318681 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:26.318681 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:26.318681 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:26.318681 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:26.319594 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:26.319594 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:26.319594 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:26.319594 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:26.319594 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:26.319594 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:26.319594 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:26.319594 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:26.319594 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:26.319594 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:26.319594 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:26.319594 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:26.319594 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:26.319594 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:26.319594 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:26.319594 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:26.320436 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:26.320436 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:26.320436 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:26.320436 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:26.320436 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:26.320436 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:26.320436 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:26.320436 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:26.320436 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:26.320436 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:26.320436 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:26.320436 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:26.320436 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 293/573] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jun 20 05:58:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:26.321305 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df3343-a513-4520-afdf-b6597eea8931 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:26.371303 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be60e979-1b78-499a-b2fa-f77c3cccfd76 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:26.403942 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ef68d-ccc7-40ed-a3ac-415fed10ca6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:26.404523 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ef68d-ccc7-40ed-a3ac-415fed10ca6f None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:26.404845 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ef68d-ccc7-40ed-a3ac-415fed10ca6f None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:26.405125 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ef68d-ccc7-40ed-a3ac-415fed10ca6f None admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:26.405845 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5ef68d-ccc7-40ed-a3ac-415fed10ca6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:26.406150 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5ef68d-ccc7-40ed-a3ac-415fed10ca6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:26.407524 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5ef68d-ccc7-40ed-a3ac-415fed10ca6f None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:26.419750 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 281/574] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:26.420540 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ef68d-ccc7-40ed-a3ac-415fed10ca6f None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:26.427897 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df3343-a513-4520-afdf-b6597eea8931 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:26.445687 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:26.465958 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044ad883-d499-47b6-bac1-6e91fac750d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:26.466759 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ad883-d499-47b6-bac1-6e91fac750d8 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:26.467036 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ad883-d499-47b6-bac1-6e91fac750d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:26.467304 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ad883-d499-47b6-bac1-6e91fac750d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:26.469963 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:26.475654 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044ad883-d499-47b6-bac1-6e91fac750d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:26.477230 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044ad883-d499-47b6-bac1-6e91fac750d8 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:26.491309 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-044ad883-d499-47b6-bac1-6e91fac750d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:26.491309 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:26.491309 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:26.491309 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:26.491309 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:26.491309 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:26.491309 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:26.491309 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:26.491309 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:26.491309 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:26.491309 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:26.491309 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:26.491309 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:58:26.491309 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:58:26.491309 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:58:26.492379 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:58:26.492379 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:26.492379 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:26.492379 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:26.492379 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:26.492379 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:26.492379 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:26.492379 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:26.492379 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:26.492379 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:26.492379 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:26.492379 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:26.492379 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:26.492379 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:26.492379 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:26.492379 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:26.492379 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:26.493507 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:58:26.493507 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:58:26.493507 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:58:26.493507 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:58:26.493507 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:58:26.493507 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:58:26.493507 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:26.493507 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:26.493507 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 294/575] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:26.493507 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044ad883-d499-47b6-bac1-6e91fac750d8 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:26.524520 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ef68d-ccc7-40ed-a3ac-415fed10ca6f None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:26.557633 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d46e5-2f8a-447a-b127-721aa9fba58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:26.558417 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d46e5-2f8a-447a-b127-721aa9fba58a None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:26.558694 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d46e5-2f8a-447a-b127-721aa9fba58a None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:26.558963 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d46e5-2f8a-447a-b127-721aa9fba58a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:26.566128 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2d46e5-2f8a-447a-b127-721aa9fba58a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:26.567554 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2d46e5-2f8a-447a-b127-721aa9fba58a None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:26.582484 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-3e2d46e5-2f8a-447a-b127-721aa9fba58a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 05:58:26.582484 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:26.582484 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:26.582484 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:26.582484 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:26.582484 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:26.582484 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:26.582484 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:26.582484 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:26.582484 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:26.582484 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:26.582484 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:26.582484 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:58:26.582484 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:58:26.582484 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:58:26.582484 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:58:26.583423 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:26.583423 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:26.583423 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:58:26.583423 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:26.583423 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:58:26.583423 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:26.583423 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:26.583423 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:26.583423 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:26.583423 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:26.583423 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:26.583423 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:26.583423 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:26.583423 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:26.583423 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:26.583423 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:26.583423 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:26.583423 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:26.584367 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:26.584367 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:26.584367 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:58:26.584367 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:58:26.584367 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:58:26.584367 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:58:26.584367 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:58:26.584367 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:58:26.584367 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 05:58:26.584367 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:26.584367 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 282/576] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 05:58:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:26.585001 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d46e5-2f8a-447a-b127-721aa9fba58a None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:26.600443 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044ad883-d499-47b6-bac1-6e91fac750d8 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:26.635022 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a1520-c632-4c18-89d5-4d8637a77f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:26.635710 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a1520-c632-4c18-89d5-4d8637a77f98 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:26.636030 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a1520-c632-4c18-89d5-4d8637a77f98 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:26.636347 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a1520-c632-4c18-89d5-4d8637a77f98 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:26.637163 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a1520-c632-4c18-89d5-4d8637a77f98 None admin] RBAC: Adding query filter params (name=service) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:26.637493 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a1520-c632-4c18-89d5-4d8637a77f98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:26.638860 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a1520-c632-4c18-89d5-4d8637a77f98 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:26.647988 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 295/577] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jun 20 05:58:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:26.648824 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a1520-c632-4c18-89d5-4d8637a77f98 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:26.666553 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:26.683627 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d46e5-2f8a-447a-b127-721aa9fba58a None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:26.712205 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:26.717962 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47576a8f-330a-43ff-a71b-5f0ed08b13d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:26.718658 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47576a8f-330a-43ff-a71b-5f0ed08b13d2 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:26.718942 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47576a8f-330a-43ff-a71b-5f0ed08b13d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:26.719219 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47576a8f-330a-43ff-a71b-5f0ed08b13d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:26.719969 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47576a8f-330a-43ff-a71b-5f0ed08b13d2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:26.720275 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47576a8f-330a-43ff-a71b-5f0ed08b13d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:26.721776 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47576a8f-330a-43ff-a71b-5f0ed08b13d2 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:26.729693 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 283/578] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jun 20 05:58:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:26.730479 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47576a8f-330a-43ff-a71b-5f0ed08b13d2 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:26.758310 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a1520-c632-4c18-89d5-4d8637a77f98 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:26.791573 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f55f878-fe15-467c-9690-0321b190b134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:26.792360 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55f878-fe15-467c-9690-0321b190b134 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:26.792639 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55f878-fe15-467c-9690-0321b190b134 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:26.792942 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55f878-fe15-467c-9690-0321b190b134 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:26.799914 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f55f878-fe15-467c-9690-0321b190b134 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:26.801379 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f55f878-fe15-467c-9690-0321b190b134 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:26.815940 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-6f55f878-fe15-467c-9690-0321b190b134 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:26.815940 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:26.815940 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:26.815940 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:26.815940 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:26.815940 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:26.815940 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:26.815940 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:26.815940 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:26.815940 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:26.815940 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:26.815940 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:26.815940 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:58:26.815940 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:58:26.815940 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:58:26.816886 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:58:26.816886 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:26.816886 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:26.816886 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:26.816886 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:26.816886 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:26.816886 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:26.816886 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:26.816886 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:26.816886 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:26.816886 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:26.816886 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:26.816886 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:26.816886 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:26.816886 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:26.816886 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:26.816886 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:26.817859 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:58:26.817859 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:58:26.817859 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:58:26.817859 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:58:26.817859 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:58:26.817859 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:58:26.817859 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:26.817859 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:26.817859 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 296/579] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:26.818364 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f55f878-fe15-467c-9690-0321b190b134 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:26.840026 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47576a8f-330a-43ff-a71b-5f0ed08b13d2 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:26.874235 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6d19c-4c09-4b3e-b504-26138e0ae8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:26.874891 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6d19c-4c09-4b3e-b504-26138e0ae8dc None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:26.875175 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6d19c-4c09-4b3e-b504-26138e0ae8dc None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:26.875450 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6d19c-4c09-4b3e-b504-26138e0ae8dc None admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:26.876230 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a6d19c-4c09-4b3e-b504-26138e0ae8dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:26.876539 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a6d19c-4c09-4b3e-b504-26138e0ae8dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:26.878072 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a6d19c-4c09-4b3e-b504-26138e0ae8dc None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:26.890466 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 284/580] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jun 20 05:58:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:26.891434 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6d19c-4c09-4b3e-b504-26138e0ae8dc None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:26.901337 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:26.914936 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f55f878-fe15-467c-9690-0321b190b134 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:26.932597 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:26.948999 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3fb2d-0ff6-4493-9531-4ceb3382a32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:26.949668 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3fb2d-0ff6-4493-9531-4ceb3382a32f None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:26.949951 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3fb2d-0ff6-4493-9531-4ceb3382a32f None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:26.950224 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3fb2d-0ff6-4493-9531-4ceb3382a32f None admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:26.951304 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f3fb2d-0ff6-4493-9531-4ceb3382a32f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:26.951608 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f3fb2d-0ff6-4493-9531-4ceb3382a32f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:26.953047 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f3fb2d-0ff6-4493-9531-4ceb3382a32f None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:26.969827 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 297/581] 10.222.0.39 () {56 vars in 1137 bytes} [Mon Jun 20 05:58:26 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:26.970614 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3fb2d-0ff6-4493-9531-4ceb3382a32f None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:26.998332 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6d19c-4c09-4b3e-b504-26138e0ae8dc None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:27.032009 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5607cf24-e170-42f2-b326-590b9b097722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:27.032819 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607cf24-e170-42f2-b326-590b9b097722 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:27.033095 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607cf24-e170-42f2-b326-590b9b097722 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:27.033363 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607cf24-e170-42f2-b326-590b9b097722 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:27.043766 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5607cf24-e170-42f2-b326-590b9b097722 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:27.045226 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5607cf24-e170-42f2-b326-590b9b097722 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:27.062268 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-5607cf24-e170-42f2-b326-590b9b097722 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:27.062268 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:27.062268 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:27.062268 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:27.062268 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:27.062268 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:27.062268 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:27.062268 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:27.062268 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:27.062268 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:27.062268 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:27.062268 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:27.062268 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:27.062268 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:27.062268 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:27.063202 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:27.063202 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:27.063202 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:27.063202 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:27.063202 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:27.063202 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:27.063202 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:27.063202 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:27.063202 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:27.063202 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:27.063202 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:27.063202 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:27.063202 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:27.063202 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:27.063202 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:27.063202 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:27.063202 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:27.064096 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:27.064096 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:27.064096 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:27.064096 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:27.064096 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 285/582] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:27.064384 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5607cf24-e170-42f2-b326-590b9b097722 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:27.071556 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3fb2d-0ff6-4493-9531-4ceb3382a32f None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:27.106682 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3784e256-16c9-4caf-8d9a-3d85540b941e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:27.107471 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784e256-16c9-4caf-8d9a-3d85540b941e None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:27.107754 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784e256-16c9-4caf-8d9a-3d85540b941e None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:27.108030 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784e256-16c9-4caf-8d9a-3d85540b941e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:27.118366 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3784e256-16c9-4caf-8d9a-3d85540b941e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:27.119790 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3784e256-16c9-4caf-8d9a-3d85540b941e None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:27.121251 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:27.138389 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-3784e256-16c9-4caf-8d9a-3d85540b941e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:27.138389 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:27.138389 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:27.138389 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:27.138389 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:27.138389 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:27.138389 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:27.138389 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:27.138389 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:27.138389 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:27.138389 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:27.138389 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:27.138389 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:27.138389 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:27.138389 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:27.139462 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:27.139462 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:27.139462 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:27.139462 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:27.139462 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:27.139462 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:27.139462 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:27.139462 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:27.139462 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:27.139462 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:27.139462 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:27.139462 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:27.139462 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:27.139462 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:27.139462 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:27.139462 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:27.139462 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:27.140357 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:27.140357 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:27.140357 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:27.140357 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:27.140357 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 298/583] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:27.140357 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3784e256-16c9-4caf-8d9a-3d85540b941e None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:27.164471 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5607cf24-e170-42f2-b326-590b9b097722 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:27.168036 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:27.199672 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d98a7aa-de47-4bd1-9747-71273685fe13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:27.200326 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98a7aa-de47-4bd1-9747-71273685fe13 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:27.200608 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98a7aa-de47-4bd1-9747-71273685fe13 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:27.201159 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98a7aa-de47-4bd1-9747-71273685fe13 None admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:27.201940 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d98a7aa-de47-4bd1-9747-71273685fe13 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:27.202244 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d98a7aa-de47-4bd1-9747-71273685fe13 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:27.203657 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d98a7aa-de47-4bd1-9747-71273685fe13 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:27.217039 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 286/584] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jun 20 05:58:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:27.217847 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d98a7aa-de47-4bd1-9747-71273685fe13 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:27.246108 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3784e256-16c9-4caf-8d9a-3d85540b941e None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:27.279386 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cfeb91-7e16-4502-b04a-b3aaa0e5b3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:27.280037 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfeb91-7e16-4502-b04a-b3aaa0e5b3fc None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:27.280320 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfeb91-7e16-4502-b04a-b3aaa0e5b3fc None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:27.280598 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfeb91-7e16-4502-b04a-b3aaa0e5b3fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:27.281457 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cfeb91-7e16-4502-b04a-b3aaa0e5b3fc None admin] RBAC: Adding query filter params (role.id=b7e86f43512c42bfa0d069e3e6fb97c5, scope.project.id=b349043204b34d1794818184ffe6505c, user.id=b2b490cf71bc468da5ea2be04239e33f) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:27.281769 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cfeb91-7e16-4502-b04a-b3aaa0e5b3fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:27.283187 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cfeb91-7e16-4502-b04a-b3aaa0e5b3fc None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:27.288867 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 299/585] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jun 20 05:58:27 2022] GET /identity/v3/role_assignments?user.id=b2b490cf71bc468da5ea2be04239e33f&scope.project.id=b349043204b34d1794818184ffe6505c&role.id=b7e86f43512c42bfa0d069e3e6fb97c5 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:27.289636 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cfeb91-7e16-4502-b04a-b3aaa0e5b3fc None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:27.333102 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d98a7aa-de47-4bd1-9747-71273685fe13 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:27.352224 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:27.369690 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f394e29a-6935-4212-a3b7-ba28b79521d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:27.370589 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394e29a-6935-4212-a3b7-ba28b79521d8 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:27.370936 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394e29a-6935-4212-a3b7-ba28b79521d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:27.371276 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394e29a-6935-4212-a3b7-ba28b79521d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:27.383431 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f394e29a-6935-4212-a3b7-ba28b79521d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:27.384940 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f394e29a-6935-4212-a3b7-ba28b79521d8 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:27.398308 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:27.403201 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-f394e29a-6935-4212-a3b7-ba28b79521d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:27.403201 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:27.403201 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:27.403201 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:27.403201 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:27.403201 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:27.403201 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:27.403201 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:27.403201 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:27.403201 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:27.403201 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:27.403201 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:27.403201 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:27.403201 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:27.403201 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:27.404174 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:27.404174 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:27.404174 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:27.404174 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:27.404174 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:27.404174 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:27.404174 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:27.404174 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:27.404174 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:27.404174 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:27.404174 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:27.404174 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:27.404174 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:27.404174 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:27.404174 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:27.404174 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:27.404174 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:27.405197 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:27.405197 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:27.405197 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:27.405197 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:27.405197 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 287/586] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:27.405497 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f394e29a-6935-4212-a3b7-ba28b79521d8 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:27.416252 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cfeb91-7e16-4502-b04a-b3aaa0e5b3fc None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:27.472977 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10695ab0-fe6f-4e56-913d-21ca19e1fedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:27.473650 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10695ab0-fe6f-4e56-913d-21ca19e1fedc None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:27.473931 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10695ab0-fe6f-4e56-913d-21ca19e1fedc None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:27.474205 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10695ab0-fe6f-4e56-913d-21ca19e1fedc None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:27.475066 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10695ab0-fe6f-4e56-913d-21ca19e1fedc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:27.475369 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10695ab0-fe6f-4e56-913d-21ca19e1fedc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:27.476784 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10695ab0-fe6f-4e56-913d-21ca19e1fedc None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:27.494533 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 300/587] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:27.494533 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10695ab0-fe6f-4e56-913d-21ca19e1fedc None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:27.539134 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f394e29a-6935-4212-a3b7-ba28b79521d8 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:27.574672 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d260b9ff-919c-4d0f-8a0d-42bbcffbb53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:27.575340 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260b9ff-919c-4d0f-8a0d-42bbcffbb53a None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:27.575620 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260b9ff-919c-4d0f-8a0d-42bbcffbb53a None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:27.576144 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260b9ff-919c-4d0f-8a0d-42bbcffbb53a None admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:27.576898 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d260b9ff-919c-4d0f-8a0d-42bbcffbb53a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:27.577206 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d260b9ff-919c-4d0f-8a0d-42bbcffbb53a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:27.578586 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d260b9ff-919c-4d0f-8a0d-42bbcffbb53a None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:27.595873 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 288/588] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:27.595873 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d260b9ff-919c-4d0f-8a0d-42bbcffbb53a None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:27.610398 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10695ab0-fe6f-4e56-913d-21ca19e1fedc None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:27.623979 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:27.648402 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc2d51-2f3f-47c1-9c3d-ea6ec8de0975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:27.649332 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc2d51-2f3f-47c1-9c3d-ea6ec8de0975 None admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:27.649615 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc2d51-2f3f-47c1-9c3d-ea6ec8de0975 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:27.649887 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc2d51-2f3f-47c1-9c3d-ea6ec8de0975 None admin] PATH_INFO: `/v3/projects/b349043204b34d1794818184ffe6505c/users/3cee106502e54829ad802ee41c9165fa/roles/b7e86f43512c42bfa0d069e3e6fb97c5` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:27.665141 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbc2d51-2f3f-47c1-9c3d-ea6ec8de0975 None admin] RBAC: Authorizing `identity:create_grant(project_id=b349043204b34d1794818184ffe6505c, user_id=3cee106502e54829ad802ee41c9165fa, role_id=b7e86f43512c42bfa0d069e3e6fb97c5)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:27.666578 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbc2d51-2f3f-47c1-9c3d-ea6ec8de0975 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:27.682691 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 301/589] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jun 20 05:58:27 2022] PUT /identity/v3/projects/b349043204b34d1794818184ffe6505c/users/3cee106502e54829ad802ee41c9165fa/roles/b7e86f43512c42bfa0d069e3e6fb97c5 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:58:27.683514 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc2d51-2f3f-47c1-9c3d-ea6ec8de0975 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:27.686122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:27.722692 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d260b9ff-919c-4d0f-8a0d-42bbcffbb53a None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:27.763726 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ef0a7-797a-4997-bc9f-69f8ea21ce69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:27.764622 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ef0a7-797a-4997-bc9f-69f8ea21ce69 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:27.765035 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ef0a7-797a-4997-bc9f-69f8ea21ce69 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:27.765410 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ef0a7-797a-4997-bc9f-69f8ea21ce69 None admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:27.766414 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ef0a7-797a-4997-bc9f-69f8ea21ce69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:27.766868 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ef0a7-797a-4997-bc9f-69f8ea21ce69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:27.769581 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ef0a7-797a-4997-bc9f-69f8ea21ce69 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:27.788193 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 289/590] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:27.789390 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ef0a7-797a-4997-bc9f-69f8ea21ce69 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:27.842208 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc2d51-2f3f-47c1-9c3d-ea6ec8de0975 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:27.888950 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2b2a7-8e79-458c-8dac-db72a0ceeb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:27.890001 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2b2a7-8e79-458c-8dac-db72a0ceeb84 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:27.890747 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2b2a7-8e79-458c-8dac-db72a0ceeb84 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:27.891159 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2b2a7-8e79-458c-8dac-db72a0ceeb84 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:27.903114 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff2b2a7-8e79-458c-8dac-db72a0ceeb84 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:27.905650 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff2b2a7-8e79-458c-8dac-db72a0ceeb84 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:27.906619 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:27.917657 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ef0a7-797a-4997-bc9f-69f8ea21ce69 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:27.932886 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-1ff2b2a7-8e79-458c-8dac-db72a0ceeb84 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 20 05:58:27.932886 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:27.932886 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:27.932886 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:27.932886 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:27.932886 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:27.932886 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:27.932886 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:27.932886 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:27.932886 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:27.932886 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:27.932886 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:27.932886 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:58:27.932886 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:58:27.932886 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:58:27.932886 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:58:27.934060 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:27.934060 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:27.934060 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:58:27.934060 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:27.934060 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:58:27.934060 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:27.934060 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:27.934060 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:27.934060 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:27.934060 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:27.934060 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:27.934060 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:27.934060 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:27.934060 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:27.934060 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:27.934060 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:27.934060 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:27.934060 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:27.935128 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:27.935128 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:27.935128 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:58:27.935128 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:58:27.935128 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:58:27.935128 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:58:27.935128 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:58:27.935128 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:58:27.935128 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 20 05:58:27.935128 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:27.935128 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 302/591] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 05:58:27 2022] GET /identity/v3/users/glance => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:27.935761 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2b2a7-8e79-458c-8dac-db72a0ceeb84 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:27.967982 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce04c43-9dfe-4511-97b6-dddd57b43eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:27.968810 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce04c43-9dfe-4511-97b6-dddd57b43eeb None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:27.969098 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce04c43-9dfe-4511-97b6-dddd57b43eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:27.969375 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce04c43-9dfe-4511-97b6-dddd57b43eeb None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:27.980546 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce04c43-9dfe-4511-97b6-dddd57b43eeb None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:27.981983 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce04c43-9dfe-4511-97b6-dddd57b43eeb None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:28.001041 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-fce04c43-9dfe-4511-97b6-dddd57b43eeb None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 20 05:58:28.001041 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:28.001041 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:28.001041 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:28.001041 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:28.001041 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:28.001041 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:28.001041 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:28.001041 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:28.001041 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:28.001041 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:28.001041 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:28.001041 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:58:28.001041 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:58:28.001041 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:58:28.001041 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:58:28.002250 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:28.002250 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:28.002250 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:58:28.002250 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:28.002250 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:58:28.002250 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:28.002250 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:28.002250 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:28.002250 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:28.002250 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:28.002250 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:28.002250 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:28.002250 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:28.002250 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:28.002250 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:28.002250 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:28.002250 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:28.002250 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:28.003981 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:28.003981 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:28.003981 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:58:28.003981 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:58:28.003981 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:58:28.003981 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:58:28.003981 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:58:28.003981 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:58:28.003981 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 20 05:58:28.003981 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:28.007758 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 290/592] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jun 20 05:58:27 2022] GET /identity/v3/users/neutron => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:28.009019 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce04c43-9dfe-4511-97b6-dddd57b43eeb None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:28.015560 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:28.072608 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2b2a7-8e79-458c-8dac-db72a0ceeb84 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:28.115680 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b695ba-530a-4be9-a3c5-de83ee4ab225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:28.116558 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b695ba-530a-4be9-a3c5-de83ee4ab225 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:28.116888 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b695ba-530a-4be9-a3c5-de83ee4ab225 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:28.117167 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b695ba-530a-4be9-a3c5-de83ee4ab225 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:28.124309 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b695ba-530a-4be9-a3c5-de83ee4ab225 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:28.125789 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b695ba-530a-4be9-a3c5-de83ee4ab225 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:28.132103 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce04c43-9dfe-4511-97b6-dddd57b43eeb None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:28.140875 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-c5b695ba-530a-4be9-a3c5-de83ee4ab225 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:28.140875 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:28.140875 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:28.140875 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:28.140875 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:28.140875 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:28.140875 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:28.140875 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:28.140875 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:28.140875 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:28.140875 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:28.140875 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:28.140875 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:58:28.140875 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:58:28.140875 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:58:28.141943 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:58:28.141943 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:28.141943 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:28.141943 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:28.141943 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:28.141943 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:28.141943 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:28.141943 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:28.141943 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:28.141943 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:28.141943 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:28.141943 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:28.141943 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:28.141943 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:28.141943 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:28.141943 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:28.141943 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:28.142851 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:58:28.142851 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:58:28.142851 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:58:28.142851 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:58:28.142851 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:58:28.142851 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:58:28.142851 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:28.142851 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:28.142851 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 303/593] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:28.143362 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b695ba-530a-4be9-a3c5-de83ee4ab225 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:28.170819 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e6f4a6-509a-4f3a-a86f-8eb82881d619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:28.171840 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6f4a6-509a-4f3a-a86f-8eb82881d619 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:28.172339 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6f4a6-509a-4f3a-a86f-8eb82881d619 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:28.172854 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6f4a6-509a-4f3a-a86f-8eb82881d619 None admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:28.173883 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e6f4a6-509a-4f3a-a86f-8eb82881d619 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:28.175223 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e6f4a6-509a-4f3a-a86f-8eb82881d619 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:28.176953 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e6f4a6-509a-4f3a-a86f-8eb82881d619 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:28.198294 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 291/594] 10.222.0.39 () {56 vars in 1137 bytes} [Mon Jun 20 05:58:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:28.199451 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e6f4a6-509a-4f3a-a86f-8eb82881d619 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:28.211787 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:28.260956 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b695ba-530a-4be9-a3c5-de83ee4ab225 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:28.287250 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:28.299063 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fda13b-23e5-4588-be34-6089fcbb3bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:28.300157 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fda13b-23e5-4588-be34-6089fcbb3bbc None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:28.300467 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fda13b-23e5-4588-be34-6089fcbb3bbc None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:28.300777 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fda13b-23e5-4588-be34-6089fcbb3bbc None admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:28.301629 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fda13b-23e5-4588-be34-6089fcbb3bbc None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:28.301939 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fda13b-23e5-4588-be34-6089fcbb3bbc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:28.303388 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fda13b-23e5-4588-be34-6089fcbb3bbc None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:28.325049 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 304/595] 10.222.0.39 () {56 vars in 1139 bytes} [Mon Jun 20 05:58:28 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:28.326178 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fda13b-23e5-4588-be34-6089fcbb3bbc None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:28.341401 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e6f4a6-509a-4f3a-a86f-8eb82881d619 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:28.387024 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef5746-beff-47ac-9ddf-a02ea47a0387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:28.388209 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef5746-beff-47ac-9ddf-a02ea47a0387 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:28.388975 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef5746-beff-47ac-9ddf-a02ea47a0387 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:28.389693 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef5746-beff-47ac-9ddf-a02ea47a0387 None admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:28.390804 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ef5746-beff-47ac-9ddf-a02ea47a0387 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:28.391293 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ef5746-beff-47ac-9ddf-a02ea47a0387 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:28.394137 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ef5746-beff-47ac-9ddf-a02ea47a0387 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:28.411348 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 292/596] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jun 20 05:58:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:28.412883 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef5746-beff-47ac-9ddf-a02ea47a0387 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:28.439832 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fda13b-23e5-4588-be34-6089fcbb3bbc None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:28.478979 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d5e08-f6c3-4a5e-ad7c-ddbfe4b4fc9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:28.479772 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d5e08-f6c3-4a5e-ad7c-ddbfe4b4fc9c None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:28.480100 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d5e08-f6c3-4a5e-ad7c-ddbfe4b4fc9c None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:28.480371 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d5e08-f6c3-4a5e-ad7c-ddbfe4b4fc9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:28.492792 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454d5e08-f6c3-4a5e-ad7c-ddbfe4b4fc9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:28.494240 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454d5e08-f6c3-4a5e-ad7c-ddbfe4b4fc9c None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:28.497299 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:28.516198 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-454d5e08-f6c3-4a5e-ad7c-ddbfe4b4fc9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:28.516198 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:28.516198 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:28.516198 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:28.516198 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:28.516198 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:28.516198 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:28.516198 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:28.516198 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:28.516198 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:28.516198 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:28.516198 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:28.516198 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:28.516198 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:28.516198 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:28.517151 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:28.517151 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:28.517151 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:28.517151 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:28.517151 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:28.517151 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:28.517151 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:28.517151 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:28.517151 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:28.517151 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:28.517151 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:28.517151 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:28.517151 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:28.517151 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:28.517151 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:28.517151 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:28.517151 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:28.518095 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:28.518095 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:28.518095 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:28.518095 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:28.518095 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 305/597] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:28.518636 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d5e08-f6c3-4a5e-ad7c-ddbfe4b4fc9c None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:28.537186 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef5746-beff-47ac-9ddf-a02ea47a0387 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:28.552349 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:28.572939 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4e25d-03bf-437d-a257-4eb721ccf431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:28.574270 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4e25d-03bf-437d-a257-4eb721ccf431 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:28.575194 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4e25d-03bf-437d-a257-4eb721ccf431 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:28.575950 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4e25d-03bf-437d-a257-4eb721ccf431 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:28.591643 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee4e25d-03bf-437d-a257-4eb721ccf431 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:28.593855 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee4e25d-03bf-437d-a257-4eb721ccf431 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:28.617560 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-6ee4e25d-03bf-437d-a257-4eb721ccf431 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:28.617560 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:28.617560 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:28.617560 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:28.617560 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:28.617560 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:28.617560 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:28.617560 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:28.617560 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:28.617560 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:28.617560 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:28.617560 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:28.617560 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:28.617560 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:28.617560 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:28.618534 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:28.618534 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:28.618534 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:28.618534 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:28.618534 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:28.618534 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:28.618534 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:28.618534 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:28.618534 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:28.618534 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:28.618534 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:28.618534 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:28.618534 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:28.618534 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:28.618534 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:28.618534 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:28.618534 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:28.619463 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:28.619463 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:28.619463 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:28.619463 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:28.622184 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 293/598] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:28.623910 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4e25d-03bf-437d-a257-4eb721ccf431 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:28.636359 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d5e08-f6c3-4a5e-ad7c-ddbfe4b4fc9c None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:28.681706 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd988faf-1edf-4494-b06a-109d2f887f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:28.682631 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd988faf-1edf-4494-b06a-109d2f887f77 None admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:28.683400 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd988faf-1edf-4494-b06a-109d2f887f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:28.683720 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd988faf-1edf-4494-b06a-109d2f887f77 None admin] PATH_INFO: `/v3/projects/b349043204b34d1794818184ffe6505c/users/19bd2ac77c5d48d49b58712f4025e279/roles/b7e86f43512c42bfa0d069e3e6fb97c5` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:28.703158 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd988faf-1edf-4494-b06a-109d2f887f77 None admin] RBAC: Authorizing `identity:create_grant(project_id=b349043204b34d1794818184ffe6505c, user_id=19bd2ac77c5d48d49b58712f4025e279, role_id=b7e86f43512c42bfa0d069e3e6fb97c5)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:28.704925 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd988faf-1edf-4494-b06a-109d2f887f77 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:28.726344 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 306/599] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jun 20 05:58:28 2022] PUT /identity/v3/projects/b349043204b34d1794818184ffe6505c/users/19bd2ac77c5d48d49b58712f4025e279/roles/b7e86f43512c42bfa0d069e3e6fb97c5 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:58:28.727456 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd988faf-1edf-4494-b06a-109d2f887f77 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:28.758277 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4e25d-03bf-437d-a257-4eb721ccf431 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:28.788563 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:28.809321 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e8790-60d7-4995-96fb-f9f9e3b1ad46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:28.810073 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e8790-60d7-4995-96fb-f9f9e3b1ad46 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:28.810528 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e8790-60d7-4995-96fb-f9f9e3b1ad46 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:28.810901 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e8790-60d7-4995-96fb-f9f9e3b1ad46 None admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:28.811638 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4e8790-60d7-4995-96fb-f9f9e3b1ad46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:28.811949 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4e8790-60d7-4995-96fb-f9f9e3b1ad46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:28.814506 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4e8790-60d7-4995-96fb-f9f9e3b1ad46 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:28.833593 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:28.836331 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 294/600] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:28.841845 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e8790-60d7-4995-96fb-f9f9e3b1ad46 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:28.856311 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd988faf-1edf-4494-b06a-109d2f887f77 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:28.905255 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c16af-815e-49cf-88e7-b12fa040cac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:28.906472 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c16af-815e-49cf-88e7-b12fa040cac6 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:28.906988 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c16af-815e-49cf-88e7-b12fa040cac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:28.907505 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c16af-815e-49cf-88e7-b12fa040cac6 None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:28.909242 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c16af-815e-49cf-88e7-b12fa040cac6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:28.909786 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c16af-815e-49cf-88e7-b12fa040cac6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:28.911556 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c16af-815e-49cf-88e7-b12fa040cac6 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:28.946178 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 307/601] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:28.953072 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c16af-815e-49cf-88e7-b12fa040cac6 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:28.986090 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e8790-60d7-4995-96fb-f9f9e3b1ad46 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:29.037663 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd53511a-c8ce-47b9-812b-e10bd7acfb6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:29.039468 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53511a-c8ce-47b9-812b-e10bd7acfb6f None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:29.039953 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53511a-c8ce-47b9-812b-e10bd7acfb6f None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:29.040426 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53511a-c8ce-47b9-812b-e10bd7acfb6f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:29.056611 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd53511a-c8ce-47b9-812b-e10bd7acfb6f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:29.058173 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd53511a-c8ce-47b9-812b-e10bd7acfb6f None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:29.085881 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-bd53511a-c8ce-47b9-812b-e10bd7acfb6f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:29.085881 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:29.085881 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:29.085881 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:29.085881 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:29.085881 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:29.085881 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:29.085881 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:29.085881 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:29.085881 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:29.085881 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:29.085881 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:29.085881 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:58:29.085881 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:58:29.085881 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:58:29.086833 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:58:29.086833 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:29.086833 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:29.086833 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:29.086833 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:29.086833 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:29.086833 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:29.086833 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:29.086833 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:29.086833 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:29.086833 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:29.086833 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:29.086833 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:29.086833 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:29.086833 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:29.086833 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:29.086833 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:29.087706 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:58:29.087706 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:58:29.087706 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:58:29.087706 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:58:29.087706 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:58:29.087706 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:58:29.087706 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:29.087706 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:29.088579 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 295/602] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:29.095075 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd53511a-c8ce-47b9-812b-e10bd7acfb6f None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:29.117828 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c16af-815e-49cf-88e7-b12fa040cac6 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:29.175756 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:29.184345 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ac09c-75a9-4ae1-b08b-75cb428df4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:29.185182 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ac09c-75a9-4ae1-b08b-75cb428df4f2 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:29.185468 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ac09c-75a9-4ae1-b08b-75cb428df4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:29.185740 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ac09c-75a9-4ae1-b08b-75cb428df4f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:29.195542 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ac09c-75a9-4ae1-b08b-75cb428df4f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:29.205327 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ac09c-75a9-4ae1-b08b-75cb428df4f2 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:29.238124 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-5f6ac09c-75a9-4ae1-b08b-75cb428df4f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:29.238124 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:29.238124 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:29.238124 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:29.238124 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:29.238124 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:29.238124 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:29.238124 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:29.238124 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:29.238124 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:29.238124 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:29.238124 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:29.238124 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:58:29.238124 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:58:29.238124 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:58:29.239079 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:58:29.239079 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:29.239079 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:29.239079 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:29.239079 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:29.239079 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:29.239079 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:29.239079 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:29.239079 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:29.239079 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:29.239079 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:29.239079 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:29.239079 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:29.239079 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:29.239079 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:29.239079 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:29.239079 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:29.239990 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:58:29.239990 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:58:29.239990 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:58:29.239990 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:58:29.239990 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:58:29.239990 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:58:29.239990 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:29.239990 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:29.239990 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 308/603] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:29.250258 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd53511a-c8ce-47b9-812b-e10bd7acfb6f None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:29.258360 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ac09c-75a9-4ae1-b08b-75cb428df4f2 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:29.267295 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:29.291737 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee22f2e-984e-48bc-b47a-36935dcdd172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:29.292762 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee22f2e-984e-48bc-b47a-36935dcdd172 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:29.293423 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee22f2e-984e-48bc-b47a-36935dcdd172 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:29.293923 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee22f2e-984e-48bc-b47a-36935dcdd172 None admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:29.295128 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee22f2e-984e-48bc-b47a-36935dcdd172 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:29.295656 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee22f2e-984e-48bc-b47a-36935dcdd172 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:29.297399 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee22f2e-984e-48bc-b47a-36935dcdd172 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:29.311148 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 296/604] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jun 20 05:58:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:29.317526 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee22f2e-984e-48bc-b47a-36935dcdd172 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:29.433603 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:29.441081 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee22f2e-984e-48bc-b47a-36935dcdd172 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:29.479827 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ac09c-75a9-4ae1-b08b-75cb428df4f2 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:29.480928 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d29bd7-32af-44d7-9b26-636f6e9cae4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:29.482047 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d29bd7-32af-44d7-9b26-636f6e9cae4e None admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:29.482552 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d29bd7-32af-44d7-9b26-636f6e9cae4e None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:29.483024 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d29bd7-32af-44d7-9b26-636f6e9cae4e None admin] PATH_INFO: `/v3/projects/b349043204b34d1794818184ffe6505c/users/b9cb22811a754357ab9d839b70d44261/roles/b7e86f43512c42bfa0d069e3e6fb97c5` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:29.503680 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d29bd7-32af-44d7-9b26-636f6e9cae4e None admin] RBAC: Authorizing `identity:create_grant(project_id=b349043204b34d1794818184ffe6505c, user_id=b9cb22811a754357ab9d839b70d44261, role_id=b7e86f43512c42bfa0d069e3e6fb97c5)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:29.505521 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d29bd7-32af-44d7-9b26-636f6e9cae4e None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:29.521292 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff6f6ca-4308-4ade-a87a-0fd35f3dd95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:29.522165 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6f6ca-4308-4ade-a87a-0fd35f3dd95c None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:29.522562 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6f6ca-4308-4ade-a87a-0fd35f3dd95c None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:29.522839 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6f6ca-4308-4ade-a87a-0fd35f3dd95c None admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:29.523770 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff6f6ca-4308-4ade-a87a-0fd35f3dd95c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:29.524133 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff6f6ca-4308-4ade-a87a-0fd35f3dd95c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:29.525781 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff6f6ca-4308-4ade-a87a-0fd35f3dd95c None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:29.527301 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 297/605] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jun 20 05:58:29 2022] PUT /identity/v3/projects/b349043204b34d1794818184ffe6505c/users/b9cb22811a754357ab9d839b70d44261/roles/b7e86f43512c42bfa0d069e3e6fb97c5 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 05:58:29.535134 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b37a96-7cc1-4ce8-87aa-1d7b513f3a24 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:29.535867 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b37a96-7cc1-4ce8-87aa-1d7b513f3a24 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:29.536362 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b37a96-7cc1-4ce8-87aa-1d7b513f3a24 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:29.538431 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 298/606] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:58:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:29.544790 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 309/607] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jun 20 05:58:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:58:29.551015 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80b2db-5d9e-49a5-99f9-4e678f2e4ac6 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:29.551309 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80b2db-5d9e-49a5-99f9-4e678f2e4ac6 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:29.551566 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80b2db-5d9e-49a5-99f9-4e678f2e4ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:29.553038 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff6f6ca-4308-4ade-a87a-0fd35f3dd95c None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:29.586923 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-fa80b2db-5d9e-49a5-99f9-4e678f2e4ac6 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:29.588501 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-fa80b2db-5d9e-49a5-99f9-4e678f2e4ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:29.625901 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:29.672308 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff6f6ca-4308-4ade-a87a-0fd35f3dd95c None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:29.714575 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab996b5-692d-4ed7-a45b-a7309136fedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:29.715946 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab996b5-692d-4ed7-a45b-a7309136fedb None admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:29.716472 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab996b5-692d-4ed7-a45b-a7309136fedb None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:29.716972 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab996b5-692d-4ed7-a45b-a7309136fedb None admin] PATH_INFO: `/v3/projects/b349043204b34d1794818184ffe6505c/users/83e77cb05c4546c7a98ada817573edf3/roles/b7e86f43512c42bfa0d069e3e6fb97c5` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:29.734015 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab996b5-692d-4ed7-a45b-a7309136fedb None admin] RBAC: Authorizing `identity:create_grant(project_id=b349043204b34d1794818184ffe6505c, user_id=83e77cb05c4546c7a98ada817573edf3, role_id=b7e86f43512c42bfa0d069e3e6fb97c5)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:29.735940 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab996b5-692d-4ed7-a45b-a7309136fedb None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:29.752835 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 299/608] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:58:29.757579 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 310/609] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jun 20 05:58:29 2022] PUT /identity/v3/projects/b349043204b34d1794818184ffe6505c/users/83e77cb05c4546c7a98ada817573edf3/roles/b7e86f43512c42bfa0d069e3e6fb97c5 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:58:29.779357 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa80b2db-5d9e-49a5-99f9-4e678f2e4ac6 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:29.882437 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:29.905940 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa80b2db-5d9e-49a5-99f9-4e678f2e4ac6 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:29.952586 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb2aed-f598-4994-8340-a8e21e1793c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:29.953420 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb2aed-f598-4994-8340-a8e21e1793c2 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:29.953702 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb2aed-f598-4994-8340-a8e21e1793c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:29.953980 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb2aed-f598-4994-8340-a8e21e1793c2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:29.966851 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb2aed-f598-4994-8340-a8e21e1793c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:29.975172 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-8dcb2aed-f598-4994-8340-a8e21e1793c2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:29.975172 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:29.975172 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:29.975172 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:29.975172 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:29.975172 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:29.975172 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:29.975172 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:29.975172 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:29.975172 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:29.975172 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:29.975172 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:29.975172 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:29.975172 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:29.975172 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:29.975172 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:29.976145 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:29.976145 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:29.976145 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:29.976145 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:29.976145 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:29.976145 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:29.976145 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:29.976145 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:29.976145 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:29.976145 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:29.976145 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:29.976145 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:29.976145 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:29.976145 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:29.976145 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:29.976145 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:29.977054 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:29.977054 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:29.977054 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:29.977054 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:29.977054 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:29.977054 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:29.977054 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:29.977054 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:29.977054 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:29.977054 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:29.977054 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:29.977054 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:29.983827 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 300/610] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jun 20 05:58:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:29.986116 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab996b5-692d-4ed7-a45b-a7309136fedb None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:30.025440 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6f6cf-6439-4c4f-9294-1264f21084cd None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:30.025875 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6f6cf-6439-4c4f-9294-1264f21084cd None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:30.026259 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6f6cf-6439-4c4f-9294-1264f21084cd None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:30.027822 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 301/611] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:58:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:58:30.032969 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c7009-7607-4950-8449-a2466eafaf9a None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:30.033385 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c7009-7607-4950-8449-a2466eafaf9a None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:30.033771 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c7009-7607-4950-8449-a2466eafaf9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:30.054636 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-934c7009-7607-4950-8449-a2466eafaf9a None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:30.056616 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-934c7009-7607-4950-8449-a2466eafaf9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:30.142145 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 302/612] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:58:30.145834 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab996b5-692d-4ed7-a45b-a7309136fedb None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:30.166551 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c7009-7607-4950-8449-a2466eafaf9a None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:30.171634 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:30.198004 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15092e6b-7123-45ee-b011-45bcd823a85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:30.198990 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15092e6b-7123-45ee-b011-45bcd823a85f None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:30.199452 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15092e6b-7123-45ee-b011-45bcd823a85f None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:30.199950 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15092e6b-7123-45ee-b011-45bcd823a85f None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:30.201210 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15092e6b-7123-45ee-b011-45bcd823a85f None admin] RBAC: Adding query filter params (name=service) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:30.201786 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15092e6b-7123-45ee-b011-45bcd823a85f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:30.203641 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15092e6b-7123-45ee-b011-45bcd823a85f None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:30.214608 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 311/613] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jun 20 05:58:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:30.222522 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15092e6b-7123-45ee-b011-45bcd823a85f None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:30.328359 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:30.379369 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c7009-7607-4950-8449-a2466eafaf9a None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:30.431973 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15092e6b-7123-45ee-b011-45bcd823a85f None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:30.450357 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f12df7e-cf03-4418-bc07-16234cf2d160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:30.451730 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12df7e-cf03-4418-bc07-16234cf2d160 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:30.452203 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12df7e-cf03-4418-bc07-16234cf2d160 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:30.452643 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12df7e-cf03-4418-bc07-16234cf2d160 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:30.480317 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3adcec8-dbd8-4979-894f-b398d2a239cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:30.481243 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3adcec8-dbd8-4979-894f-b398d2a239cd None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:30.481594 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3adcec8-dbd8-4979-894f-b398d2a239cd None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:30.481944 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3adcec8-dbd8-4979-894f-b398d2a239cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:30.482967 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f12df7e-cf03-4418-bc07-16234cf2d160 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:30.496770 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3adcec8-dbd8-4979-894f-b398d2a239cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:30.496770 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3adcec8-dbd8-4979-894f-b398d2a239cd None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:30.500962 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-1f12df7e-cf03-4418-bc07-16234cf2d160 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:30.500962 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:30.500962 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:30.500962 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:30.500962 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:30.500962 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:30.500962 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:30.500962 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:30.500962 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:30.500962 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:30.500962 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:30.500962 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:30.500962 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:30.500962 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:30.500962 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:30.500962 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:30.502004 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:30.502004 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:30.502004 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:30.502004 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:30.502004 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:30.502004 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:30.502004 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:30.502004 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:30.502004 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:30.502004 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:30.502004 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:30.502004 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:30.502004 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:30.502004 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:30.502004 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:30.502004 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:30.503503 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:30.503503 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:30.503503 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:30.503503 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:30.503503 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:30.503503 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:30.503503 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:30.503503 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:30.503503 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:30.503503 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:30.503503 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:30.503503 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:30.506189 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 303/614] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jun 20 05:58:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:58:30.513632 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f12df7e-cf03-4418-bc07-16234cf2d160 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:30.522435 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-f3adcec8-dbd8-4979-894f-b398d2a239cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:30.522435 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:30.522435 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:30.522435 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:30.522435 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:30.522435 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:30.522435 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:30.522435 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:30.522435 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:30.522435 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:30.522435 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:30.522435 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:30.522435 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:30.522435 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:30.522435 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:30.523388 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:30.523388 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:30.523388 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:30.523388 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:30.523388 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:30.523388 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:30.523388 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:30.523388 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:30.523388 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:30.523388 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:30.523388 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:30.523388 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:30.523388 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:30.523388 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:30.523388 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:30.523388 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:30.523388 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:30.524304 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:30.524304 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:30.524304 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:30.524304 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:30.533255 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 312/615] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:30.535017 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3adcec8-dbd8-4979-894f-b398d2a239cd None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:30.581055 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:30.708237 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3adcec8-dbd8-4979-894f-b398d2a239cd None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:30.745060 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07216c-f244-45dd-9954-1f1a27dc745f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:30.746005 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07216c-f244-45dd-9954-1f1a27dc745f None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:30.746386 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07216c-f244-45dd-9954-1f1a27dc745f None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:30.746764 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07216c-f244-45dd-9954-1f1a27dc745f None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:30.747612 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce07216c-f244-45dd-9954-1f1a27dc745f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:30.748019 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce07216c-f244-45dd-9954-1f1a27dc745f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:30.749636 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce07216c-f244-45dd-9954-1f1a27dc745f None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:30.755143 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f12df7e-cf03-4418-bc07-16234cf2d160 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:30.768822 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 313/616] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:30.771317 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07216c-f244-45dd-9954-1f1a27dc745f None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:30.855159 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:30.873054 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:30.879496 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07216c-f244-45dd-9954-1f1a27dc745f None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:30.881979 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b621e-40c3-4391-a55e-af9f7bcc2baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:30.882677 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b621e-40c3-4391-a55e-af9f7bcc2baf None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:30.882999 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b621e-40c3-4391-a55e-af9f7bcc2baf None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:30.883223 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b621e-40c3-4391-a55e-af9f7bcc2baf None admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:30.883985 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160b621e-40c3-4391-a55e-af9f7bcc2baf None admin] RBAC: Adding query filter params (name=service) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:30.884292 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160b621e-40c3-4391-a55e-af9f7bcc2baf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:30.885696 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160b621e-40c3-4391-a55e-af9f7bcc2baf None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:30.912879 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 304/617] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jun 20 05:58:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:30.917166 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c469742-456d-4d51-bcd1-41d2fa9b320b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:30.917941 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c469742-456d-4d51-bcd1-41d2fa9b320b None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:30.918220 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c469742-456d-4d51-bcd1-41d2fa9b320b None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:30.918493 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c469742-456d-4d51-bcd1-41d2fa9b320b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:30.921652 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b621e-40c3-4391-a55e-af9f7bcc2baf None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:30.926822 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c469742-456d-4d51-bcd1-41d2fa9b320b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:30.928549 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c469742-456d-4d51-bcd1-41d2fa9b320b None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:30.944743 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-8c469742-456d-4d51-bcd1-41d2fa9b320b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 20 05:58:30.944743 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:30.944743 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:30.944743 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:30.944743 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:30.944743 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:30.944743 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:30.944743 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:30.944743 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:30.944743 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:30.944743 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:30.944743 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:30.944743 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:58:30.944743 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:58:30.944743 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:58:30.944743 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:58:30.945722 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:30.945722 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:30.945722 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:58:30.945722 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:30.945722 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:58:30.945722 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:30.945722 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:30.945722 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:30.945722 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:30.945722 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:30.945722 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:30.945722 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:30.945722 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:30.945722 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:30.945722 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:30.945722 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:30.945722 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:30.945722 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:30.946647 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:30.946647 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:30.946647 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:58:30.946647 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:58:30.946647 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:58:30.946647 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:58:30.946647 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:58:30.946647 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:58:30.946647 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 20 05:58:30.946647 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:30.951161 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 314/618] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jun 20 05:58:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:58:30.952294 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c469742-456d-4d51-bcd1-41d2fa9b320b None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:31.075784 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c469742-456d-4d51-bcd1-41d2fa9b320b None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:31.132617 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e30782b-5fbc-4062-9031-35d5e4b69f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:31.133322 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30782b-5fbc-4062-9031-35d5e4b69f45 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:31.133587 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30782b-5fbc-4062-9031-35d5e4b69f45 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:31.133861 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30782b-5fbc-4062-9031-35d5e4b69f45 None admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:31.134706 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e30782b-5fbc-4062-9031-35d5e4b69f45 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:31.135010 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e30782b-5fbc-4062-9031-35d5e4b69f45 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:31.136728 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e30782b-5fbc-4062-9031-35d5e4b69f45 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:31.173533 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 315/619] 10.222.0.39 () {56 vars in 1135 bytes} [Mon Jun 20 05:58:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:58:31.182344 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e30782b-5fbc-4062-9031-35d5e4b69f45 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:31.186651 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b621e-40c3-4391-a55e-af9f7bcc2baf None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:31.196966 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:31.256842 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279bffe4-32ec-49ff-8da7-c78989d5bea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:31.257642 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279bffe4-32ec-49ff-8da7-c78989d5bea4 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:31.257921 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279bffe4-32ec-49ff-8da7-c78989d5bea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:31.258192 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279bffe4-32ec-49ff-8da7-c78989d5bea4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:31.270453 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279bffe4-32ec-49ff-8da7-c78989d5bea4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:31.271896 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279bffe4-32ec-49ff-8da7-c78989d5bea4 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:31.291330 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-279bffe4-32ec-49ff-8da7-c78989d5bea4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:31.291330 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:31.291330 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:31.291330 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:31.291330 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:31.291330 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:31.291330 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:31.291330 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:31.291330 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:31.291330 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:31.291330 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:31.291330 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:31.291330 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:31.291330 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:31.291330 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:31.292651 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:31.292651 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:31.292651 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:31.292651 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:31.292651 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:31.292651 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:31.292651 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:31.292651 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:31.292651 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:31.292651 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:31.292651 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:31.292651 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:31.292651 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:31.292651 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:31.292651 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:31.292651 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:31.292651 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:31.293702 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:31.293702 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:31.293702 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:31.293702 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:31.296916 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 305/620] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:31.298199 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16591d28-599c-448c-a97a-365357a66f6d None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:31.298484 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16591d28-599c-448c-a97a-365357a66f6d None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:31.298761 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16591d28-599c-448c-a97a-365357a66f6d None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:31.300949 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 306/621] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:58:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:31.305606 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16591d28-599c-448c-a97a-365357a66f6d None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:31.331969 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e30782b-5fbc-4062-9031-35d5e4b69f45 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:31.350464 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:31.372831 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42117362-5f70-47ac-a7d7-2419112fa429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:31.373628 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42117362-5f70-47ac-a7d7-2419112fa429 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:31.373908 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42117362-5f70-47ac-a7d7-2419112fa429 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:31.374182 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42117362-5f70-47ac-a7d7-2419112fa429 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:31.385562 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42117362-5f70-47ac-a7d7-2419112fa429 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:31.387055 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42117362-5f70-47ac-a7d7-2419112fa429 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:31.405757 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-42117362-5f70-47ac-a7d7-2419112fa429 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:31.405757 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:31.405757 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:31.405757 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:31.405757 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:31.405757 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:31.405757 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:31.405757 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:31.405757 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:31.405757 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:31.405757 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:31.405757 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:31.405757 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:31.405757 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:31.405757 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:31.406662 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:31.406662 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:31.406662 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:31.406662 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:31.406662 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:31.406662 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:31.406662 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:31.406662 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:31.406662 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:31.406662 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:31.406662 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:31.406662 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:31.406662 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:31.406662 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:31.406662 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:31.406662 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:31.406662 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:31.407562 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:31.407562 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:31.407562 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:31.407562 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:31.411609 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 316/622] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:58:31.412991 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3b469-0060-4575-bc99-6690876af7a7 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:31.413331 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3b469-0060-4575-bc99-6690876af7a7 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:31.413606 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3b469-0060-4575-bc99-6690876af7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:31.423100 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16591d28-599c-448c-a97a-365357a66f6d None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:31.431749 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-d2a3b469-0060-4575-bc99-6690876af7a7 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:31.432957 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-d2a3b469-0060-4575-bc99-6690876af7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:31.480389 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b2f9a-980b-441e-b883-b9616b826929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:31.481704 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b2f9a-980b-441e-b883-b9616b826929 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:31.482246 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b2f9a-980b-441e-b883-b9616b826929 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:31.483633 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b2f9a-980b-441e-b883-b9616b826929 None admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:31.484609 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199b2f9a-980b-441e-b883-b9616b826929 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:31.485156 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199b2f9a-980b-441e-b883-b9616b826929 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:31.486909 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199b2f9a-980b-441e-b883-b9616b826929 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:31.498878 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:31.506904 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 307/623] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:31.508079 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b2f9a-980b-441e-b883-b9616b826929 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:31.523635 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 317/624] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:58:31.524863 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a3b469-0060-4575-bc99-6690876af7a7 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:31.639991 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b2f9a-980b-441e-b883-b9616b826929 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:31.643842 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:31.656960 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a3b469-0060-4575-bc99-6690876af7a7 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:31.678668 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d53e77-9a74-46a5-86e0-c1028b04df9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:31.679429 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d53e77-9a74-46a5-86e0-c1028b04df9e None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:31.679778 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d53e77-9a74-46a5-86e0-c1028b04df9e None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:31.680118 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d53e77-9a74-46a5-86e0-c1028b04df9e None admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:31.681063 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d53e77-9a74-46a5-86e0-c1028b04df9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:31.681745 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d53e77-9a74-46a5-86e0-c1028b04df9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:31.682944 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d53e77-9a74-46a5-86e0-c1028b04df9e None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:31.697044 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ab200-eb73-4ccd-8e25-56d66903b724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:31.698209 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ab200-eb73-4ccd-8e25-56d66903b724 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:31.698716 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ab200-eb73-4ccd-8e25-56d66903b724 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:31.699194 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ab200-eb73-4ccd-8e25-56d66903b724 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:31.702293 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 308/625] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:31.703328 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d53e77-9a74-46a5-86e0-c1028b04df9e None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:31.708776 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733ab200-eb73-4ccd-8e25-56d66903b724 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:31.710916 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733ab200-eb73-4ccd-8e25-56d66903b724 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:31.726257 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-733ab200-eb73-4ccd-8e25-56d66903b724 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 05:58:31.726257 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:31.726257 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:31.726257 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:31.726257 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:31.726257 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:31.726257 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:31.726257 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:31.726257 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:31.726257 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:31.726257 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:31.726257 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:31.726257 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:58:31.726257 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:58:31.726257 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:58:31.726257 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:58:31.728092 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:31.728092 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:31.728092 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:58:31.728092 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:31.728092 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:58:31.728092 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:31.728092 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:31.728092 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:31.728092 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:31.728092 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:31.728092 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:31.728092 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:31.728092 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:31.728092 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:31.728092 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:31.728092 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:31.728092 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:31.728092 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:31.729526 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:31.729526 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:31.729526 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:58:31.729526 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:58:31.729526 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:58:31.729526 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:58:31.729526 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:58:31.729526 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:58:31.729526 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 05:58:31.729526 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:31.737027 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 318/626] 10.222.0.39 () {56 vars in 1093 bytes} [Mon Jun 20 05:58:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:31.738233 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ab200-eb73-4ccd-8e25-56d66903b724 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:31.788072 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:31.816728 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d53e77-9a74-46a5-86e0-c1028b04df9e None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:31.848224 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ab200-eb73-4ccd-8e25-56d66903b724 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:31.852076 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f703ec8-e2b4-475e-b787-f340febfb492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:31.852965 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f703ec8-e2b4-475e-b787-f340febfb492 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:31.853243 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f703ec8-e2b4-475e-b787-f340febfb492 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:31.853562 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f703ec8-e2b4-475e-b787-f340febfb492 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:31.864612 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f703ec8-e2b4-475e-b787-f340febfb492 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:31.872552 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-2f703ec8-e2b4-475e-b787-f340febfb492 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:31.872552 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:31.872552 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:31.872552 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:31.872552 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:31.872552 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:31.872552 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:31.872552 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:31.872552 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:31.872552 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:31.872552 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:31.872552 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:31.872552 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:31.872552 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:31.872552 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:31.872552 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:31.873526 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:31.873526 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:31.873526 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:31.873526 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:31.873526 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:31.873526 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:31.873526 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:31.873526 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:31.873526 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:31.873526 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:31.873526 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:31.873526 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:31.873526 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:31.873526 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:31.873526 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:31.873526 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:31.874372 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:31.874372 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:31.874372 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:31.874372 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:31.874372 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:31.874372 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:31.874372 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:31.874372 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:31.874372 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:31.874372 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:31.874372 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:31.874372 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:31.874372 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 309/627] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jun 20 05:58:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:31.875078 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f703ec8-e2b4-475e-b787-f340febfb492 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:31.890773 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940624af-3aa4-4885-96f6-498a6060b787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:31.891794 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940624af-3aa4-4885-96f6-498a6060b787 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:31.892237 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940624af-3aa4-4885-96f6-498a6060b787 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:31.892831 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940624af-3aa4-4885-96f6-498a6060b787 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:31.900499 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940624af-3aa4-4885-96f6-498a6060b787 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:31.902215 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940624af-3aa4-4885-96f6-498a6060b787 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:31.903100 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:31.917702 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-940624af-3aa4-4885-96f6-498a6060b787 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:31.917702 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:31.917702 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:31.917702 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:31.917702 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:31.917702 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:31.917702 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:31.917702 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:31.917702 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:31.917702 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:31.917702 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:31.917702 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:31.917702 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:58:31.917702 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:58:31.917702 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:58:31.918692 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:58:31.918692 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:31.918692 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:31.918692 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:31.918692 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:31.918692 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:31.918692 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:31.918692 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:31.918692 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:31.918692 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:31.918692 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:31.918692 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:31.918692 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:31.918692 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:31.918692 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:31.918692 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:31.918692 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:31.919580 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:58:31.919580 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:58:31.919580 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:58:31.919580 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:58:31.919580 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:58:31.919580 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:58:31.919580 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:31.919580 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:31.922099 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 319/628] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:31.923102 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940624af-3aa4-4885-96f6-498a6060b787 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:31.992583 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f703ec8-e2b4-475e-b787-f340febfb492 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:32.029176 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ce0377-5368-43fb-b08d-c165f9f2908a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:32.029930 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce0377-5368-43fb-b08d-c165f9f2908a None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:32.030209 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce0377-5368-43fb-b08d-c165f9f2908a None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:32.030481 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce0377-5368-43fb-b08d-c165f9f2908a None admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:32.031370 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ce0377-5368-43fb-b08d-c165f9f2908a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:32.031674 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ce0377-5368-43fb-b08d-c165f9f2908a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:32.033241 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ce0377-5368-43fb-b08d-c165f9f2908a None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:32.035379 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940624af-3aa4-4885-96f6-498a6060b787 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:32.043059 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:32.058065 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 310/629] 10.222.0.39 () {56 vars in 1133 bytes} [Mon Jun 20 05:58:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:32.058065 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ce0377-5368-43fb-b08d-c165f9f2908a None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:32.081808 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c236cc2-010c-45bc-b0ad-1ebff229cb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:32.082480 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c236cc2-010c-45bc-b0ad-1ebff229cb1e None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:32.082760 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c236cc2-010c-45bc-b0ad-1ebff229cb1e None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:32.083036 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c236cc2-010c-45bc-b0ad-1ebff229cb1e None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:32.083777 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c236cc2-010c-45bc-b0ad-1ebff229cb1e None admin] RBAC: Adding query filter params (name=service) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:32.084079 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c236cc2-010c-45bc-b0ad-1ebff229cb1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:32.085460 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c236cc2-010c-45bc-b0ad-1ebff229cb1e None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:32.093909 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 320/630] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jun 20 05:58:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:32.094601 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c236cc2-010c-45bc-b0ad-1ebff229cb1e None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:32.154082 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:32.174540 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ce0377-5368-43fb-b08d-c165f9f2908a None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:32.202080 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c236cc2-010c-45bc-b0ad-1ebff229cb1e None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:32.208856 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389c0d60-1eca-472f-903e-2690a0ea4196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:32.209517 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c0d60-1eca-472f-903e-2690a0ea4196 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:32.209793 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c0d60-1eca-472f-903e-2690a0ea4196 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:32.210059 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c0d60-1eca-472f-903e-2690a0ea4196 None admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:32.210864 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389c0d60-1eca-472f-903e-2690a0ea4196 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:32.211171 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389c0d60-1eca-472f-903e-2690a0ea4196 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:32.212602 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389c0d60-1eca-472f-903e-2690a0ea4196 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:32.224562 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 311/631] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jun 20 05:58:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:32.226084 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653914e1-cfa0-426d-82fc-483adc9f435a None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:32.226373 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653914e1-cfa0-426d-82fc-483adc9f435a None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:32.226652 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653914e1-cfa0-426d-82fc-483adc9f435a None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:32.227891 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 312/632] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:58:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:32.228589 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653914e1-cfa0-426d-82fc-483adc9f435a None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:32.244507 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e85dad-bfa0-4b61-8a71-6326e6a641ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:32.245190 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e85dad-bfa0-4b61-8a71-6326e6a641ab None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:32.245471 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e85dad-bfa0-4b61-8a71-6326e6a641ab None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:32.245742 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e85dad-bfa0-4b61-8a71-6326e6a641ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:32.280190 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:32.319291 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e85dad-bfa0-4b61-8a71-6326e6a641ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:32.320746 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e85dad-bfa0-4b61-8a71-6326e6a641ab None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:32.335140 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653914e1-cfa0-426d-82fc-483adc9f435a None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:32.368838 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e32dc3-3421-433a-8bbd-1159534291b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:32.369625 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e32dc3-3421-433a-8bbd-1159534291b5 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:32.369910 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e32dc3-3421-433a-8bbd-1159534291b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:32.370185 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e32dc3-3421-433a-8bbd-1159534291b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:32.380907 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e32dc3-3421-433a-8bbd-1159534291b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:32.382342 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e32dc3-3421-433a-8bbd-1159534291b5 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:32.384051 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:32.400824 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-a2e32dc3-3421-433a-8bbd-1159534291b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:32.400824 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:32.400824 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:32.400824 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:32.400824 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:32.400824 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:32.400824 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:32.400824 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:32.400824 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:32.400824 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:32.400824 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:32.400824 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:32.400824 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:32.400824 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:32.400824 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:32.401881 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:32.401881 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:32.401881 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:32.401881 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:32.401881 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:32.401881 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:32.401881 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:32.401881 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:32.401881 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:32.401881 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:32.401881 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:32.401881 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:32.401881 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:32.401881 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:32.401881 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:32.401881 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:32.401881 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:32.403067 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:32.403067 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:32.403067 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:32.403067 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:32.403067 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 313/633] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:32.403544 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2cef06-dc10-447a-9ac6-237479f6fc05 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:32.403829 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2cef06-dc10-447a-9ac6-237479f6fc05 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:32.404152 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2cef06-dc10-447a-9ac6-237479f6fc05 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:32.405385 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 314/634] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:58:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:32.406062 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2cef06-dc10-447a-9ac6-237479f6fc05 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:32.426018 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 321/635] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 05:58:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:58:32.427303 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb3705-c38e-4437-b6c5-6dd50216b993 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:32.427595 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb3705-c38e-4437-b6c5-6dd50216b993 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:32.427872 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb3705-c38e-4437-b6c5-6dd50216b993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:32.444600 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-9bdb3705-c38e-4437-b6c5-6dd50216b993 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:32.445836 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-9bdb3705-c38e-4437-b6c5-6dd50216b993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:32.510060 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:32.514549 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2cef06-dc10-447a-9ac6-237479f6fc05 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:32.516258 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 322/636] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:58:32.517099 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb3705-c38e-4437-b6c5-6dd50216b993 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:32.548286 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6924ef-c524-4e03-a999-c05d3cc5196f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:32.549867 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6924ef-c524-4e03-a999-c05d3cc5196f None admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:32.550215 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6924ef-c524-4e03-a999-c05d3cc5196f None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:32.550560 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6924ef-c524-4e03-a999-c05d3cc5196f None admin] PATH_INFO: `/v3/projects/b349043204b34d1794818184ffe6505c/users/b2b490cf71bc468da5ea2be04239e33f/roles/b7e86f43512c42bfa0d069e3e6fb97c5` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:32.565412 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6924ef-c524-4e03-a999-c05d3cc5196f None admin] RBAC: Authorizing `identity:create_grant(project_id=b349043204b34d1794818184ffe6505c, user_id=b2b490cf71bc468da5ea2be04239e33f, role_id=b7e86f43512c42bfa0d069e3e6fb97c5)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:32.567003 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6924ef-c524-4e03-a999-c05d3cc5196f None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:32.580174 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 315/637] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jun 20 05:58:32 2022] PUT /identity/v3/projects/b349043204b34d1794818184ffe6505c/users/b2b490cf71bc468da5ea2be04239e33f/roles/b7e86f43512c42bfa0d069e3e6fb97c5 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:58:32.581375 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7f442-a3d5-403a-850f-76d864f194bd None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:32.581662 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7f442-a3d5-403a-850f-76d864f194bd None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:32.581939 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7f442-a3d5-403a-850f-76d864f194bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:32.599866 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-4bb7f442-a3d5-403a-850f-76d864f194bd None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:32.601156 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-4bb7f442-a3d5-403a-850f-76d864f194bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:32.637893 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb3705-c38e-4437-b6c5-6dd50216b993 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:32.650699 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:32.677923 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca6b31-b739-4433-ba6d-c2ca8c9e2a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:32.678536 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca6b31-b739-4433-ba6d-c2ca8c9e2a91 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:32.678812 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca6b31-b739-4433-ba6d-c2ca8c9e2a91 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:32.679085 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca6b31-b739-4433-ba6d-c2ca8c9e2a91 None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:32.679812 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dca6b31-b739-4433-ba6d-c2ca8c9e2a91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:32.680123 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dca6b31-b739-4433-ba6d-c2ca8c9e2a91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:32.681518 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dca6b31-b739-4433-ba6d-c2ca8c9e2a91 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:32.692932 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 316/638] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:58:32.692932 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb7f442-a3d5-403a-850f-76d864f194bd None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:32.708888 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 323/639] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:32.709911 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca6b31-b739-4433-ba6d-c2ca8c9e2a91 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:32.778257 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:32.809587 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb7f442-a3d5-403a-850f-76d864f194bd None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:32.823987 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca6b31-b739-4433-ba6d-c2ca8c9e2a91 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:32.846906 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ffae4-5c5a-4f42-a793-03c91fa2a018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:32.847692 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ffae4-5c5a-4f42-a793-03c91fa2a018 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:32.847975 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ffae4-5c5a-4f42-a793-03c91fa2a018 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:32.848249 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ffae4-5c5a-4f42-a793-03c91fa2a018 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:32.858927 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655ffae4-5c5a-4f42-a793-03c91fa2a018 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:32.859849 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14a9cf-c831-4e64-975c-dd84299359ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:32.860398 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655ffae4-5c5a-4f42-a793-03c91fa2a018 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:32.860646 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14a9cf-c831-4e64-975c-dd84299359ae None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:32.860953 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14a9cf-c831-4e64-975c-dd84299359ae None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:32.861225 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14a9cf-c831-4e64-975c-dd84299359ae None admin] PATH_INFO: `/v3/roles/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:32.871973 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e14a9cf-c831-4e64-975c-dd84299359ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:32.878892 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-655ffae4-5c5a-4f42-a793-03c91fa2a018 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:32.878892 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:32.878892 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:32.878892 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:32.878892 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:32.878892 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:32.878892 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:32.878892 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:32.878892 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:32.878892 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:32.878892 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:32.878892 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:32.878892 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:32.878892 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:32.878892 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:32.880088 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:32.880088 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:32.880088 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:32.880088 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:32.880088 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:32.880088 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:32.880088 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:32.880088 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:32.880088 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:32.880088 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:32.880088 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:32.880088 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:32.880088 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:32.880088 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:32.880088 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:32.880088 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:32.880088 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:32.881103 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:32.881103 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:32.881103 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:32.881103 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:32.881320 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-3e14a9cf-c831-4e64-975c-dd84299359ae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:32.881320 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:32.881320 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:32.881320 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:32.881320 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:32.881320 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:32.881320 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:32.881320 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:32.881320 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:32.881320 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:32.881320 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:32.881320 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:32.881320 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:32.881320 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:32.881320 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:32.881320 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:32.882135 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:32.882135 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:32.882135 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:32.882135 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:32.882135 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:32.882135 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:32.882135 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:32.882135 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:32.882135 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:32.882135 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:32.882135 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:32.882135 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:32.882135 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:32.882135 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:32.882135 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:32.882135 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:32.882956 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:32.882956 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:32.882956 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:32.882956 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:32.882956 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:32.882956 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:32.882956 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:32.882956 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:32.882956 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:32.882956 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:32.882956 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:32.882956 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:32.882956 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 324/640] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jun 20 05:58:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:32.882956 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14a9cf-c831-4e64-975c-dd84299359ae None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:32.888757 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 317/641] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:32.888757 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ffae4-5c5a-4f42-a793-03c91fa2a018 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:32.918150 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:32.998317 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14a9cf-c831-4e64-975c-dd84299359ae None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:32.999803 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ffae4-5c5a-4f42-a793-03c91fa2a018 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:33.017182 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:33.038612 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3660e99-e687-4964-b78a-ab51df3a88cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:33.039420 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3660e99-e687-4964-b78a-ab51df3a88cc None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:33.039698 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3660e99-e687-4964-b78a-ab51df3a88cc None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:33.039978 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3660e99-e687-4964-b78a-ab51df3a88cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:33.040556 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c915dbe8-eeb9-4e92-9ed6-0fc42786378c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:33.041381 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915dbe8-eeb9-4e92-9ed6-0fc42786378c None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:33.041664 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915dbe8-eeb9-4e92-9ed6-0fc42786378c None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:33.042215 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915dbe8-eeb9-4e92-9ed6-0fc42786378c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:33.051286 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3660e99-e687-4964-b78a-ab51df3a88cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:33.051495 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c915dbe8-eeb9-4e92-9ed6-0fc42786378c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:33.053036 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c915dbe8-eeb9-4e92-9ed6-0fc42786378c None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:33.060122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-d3660e99-e687-4964-b78a-ab51df3a88cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:33.060122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:33.060122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:33.060122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:33.060122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:33.060122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:33.060122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:33.060122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:33.060122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:33.060122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:33.060122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:33.060122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:33.060122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:33.060122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:33.060122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:33.060122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:33.061339 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:33.061339 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:33.061339 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:33.061339 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:33.061339 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:33.061339 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:33.061339 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:33.061339 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:33.061339 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:33.061339 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:33.061339 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:33.061339 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:33.061339 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:33.061339 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:33.061339 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:33.061339 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:33.062447 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:33.062447 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:33.062447 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:33.062447 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:33.062447 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:33.062447 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:33.062447 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:33.062447 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:33.062447 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:33.062447 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:33.062447 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:33.062447 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:33.068397 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 325/642] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jun 20 05:58:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:33.068397 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3660e99-e687-4964-b78a-ab51df3a88cc None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:33.071202 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-c915dbe8-eeb9-4e92-9ed6-0fc42786378c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 05:58:33.071202 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:33.071202 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:33.071202 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:33.071202 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:33.071202 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:33.071202 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:33.071202 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:33.071202 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:33.071202 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:33.071202 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:33.071202 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:33.071202 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:58:33.071202 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:58:33.071202 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:58:33.071202 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:58:33.072477 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:33.072477 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:33.072477 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:58:33.072477 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:33.072477 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:58:33.072477 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:33.072477 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:33.072477 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:33.072477 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:33.072477 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:33.072477 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:33.072477 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:33.072477 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:33.072477 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:33.072477 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:33.072477 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:33.072477 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:33.072477 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:33.073739 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:33.073739 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:33.073739 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:58:33.073739 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:58:33.073739 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:58:33.073739 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:58:33.073739 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:58:33.073739 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:58:33.073739 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 05:58:33.073739 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:33.074758 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 318/643] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 05:58:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:33.076994 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c915dbe8-eeb9-4e92-9ed6-0fc42786378c None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:33.166855 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:33.179667 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3660e99-e687-4964-b78a-ab51df3a88cc None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:33.182909 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c915dbe8-eeb9-4e92-9ed6-0fc42786378c None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:33.215797 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcacae7c-78bf-4204-b08a-cf237b7534eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:33.216637 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcacae7c-78bf-4204-b08a-cf237b7534eb None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:33.216955 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcacae7c-78bf-4204-b08a-cf237b7534eb None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:33.217287 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcacae7c-78bf-4204-b08a-cf237b7534eb None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:33.217986 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcacae7c-78bf-4204-b08a-cf237b7534eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:33.218296 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcacae7c-78bf-4204-b08a-cf237b7534eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:33.218813 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb9224-3590-4e32-9f64-ee674f7163b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:33.219663 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcacae7c-78bf-4204-b08a-cf237b7534eb None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:33.219763 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb9224-3590-4e32-9f64-ee674f7163b6 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:33.220027 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb9224-3590-4e32-9f64-ee674f7163b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:33.220301 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb9224-3590-4e32-9f64-ee674f7163b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:33.221175 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddb9224-3590-4e32-9f64-ee674f7163b6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:33.221449 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddb9224-3590-4e32-9f64-ee674f7163b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:33.222790 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddb9224-3590-4e32-9f64-ee674f7163b6 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:33.239890 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 319/644] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jun 20 05:58:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:33.239890 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb9224-3590-4e32-9f64-ee674f7163b6 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:33.240160 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 326/645] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:33.240160 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcacae7c-78bf-4204-b08a-cf237b7534eb None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:33.278978 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:33.343515 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcacae7c-78bf-4204-b08a-cf237b7534eb None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:33.347237 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb9224-3590-4e32-9f64-ee674f7163b6 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:33.378645 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa70ea-1640-4c84-9c10-e44d748633fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:33.379446 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa70ea-1640-4c84-9c10-e44d748633fb None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:33.379805 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa70ea-1640-4c84-9c10-e44d748633fb None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:33.380152 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa70ea-1640-4c84-9c10-e44d748633fb None admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:33.381092 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aa70ea-1640-4c84-9c10-e44d748633fb None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:33.381247 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c81ce-f34c-4d12-9675-becd722f0849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:33.381553 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aa70ea-1640-4c84-9c10-e44d748633fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:33.382031 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c81ce-f34c-4d12-9675-becd722f0849 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:33.382378 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c81ce-f34c-4d12-9675-becd722f0849 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:33.382715 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c81ce-f34c-4d12-9675-becd722f0849 None admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:33.383222 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aa70ea-1640-4c84-9c10-e44d748633fb None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:33.383584 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c81ce-f34c-4d12-9675-becd722f0849 None admin] RBAC: Adding query filter params (name=service) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:33.383956 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c81ce-f34c-4d12-9675-becd722f0849 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:33.385382 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c81ce-f34c-4d12-9675-becd722f0849 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:33.398216 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 320/646] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jun 20 05:58:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:33.398216 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c81ce-f34c-4d12-9675-becd722f0849 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:33.402843 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 327/647] 10.222.0.39 () {56 vars in 1137 bytes} [Mon Jun 20 05:58:33 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:33.403534 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa70ea-1640-4c84-9c10-e44d748633fb None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:33.415629 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:33.507435 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:33.514355 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c81ce-f34c-4d12-9675-becd722f0849 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:33.514795 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa70ea-1640-4c84-9c10-e44d748633fb None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:33.552041 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db850db9-02da-4adf-9796-02979fd5f763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:33.552794 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db850db9-02da-4adf-9796-02979fd5f763 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:33.553086 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db850db9-02da-4adf-9796-02979fd5f763 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:33.553361 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db850db9-02da-4adf-9796-02979fd5f763 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:33.553655 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf187c-a7f4-4b7b-80a9-0f49bd332ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:33.554445 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf187c-a7f4-4b7b-80a9-0f49bd332ade None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:33.554730 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf187c-a7f4-4b7b-80a9-0f49bd332ade None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:33.555007 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf187c-a7f4-4b7b-80a9-0f49bd332ade None admin] PATH_INFO: `/v3/projects/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:33.561965 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbf187c-a7f4-4b7b-80a9-0f49bd332ade None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:33.563410 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbf187c-a7f4-4b7b-80a9-0f49bd332ade None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:33.565469 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db850db9-02da-4adf-9796-02979fd5f763 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:33.566937 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db850db9-02da-4adf-9796-02979fd5f763 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:33.578603 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-3dbf187c-a7f4-4b7b-80a9-0f49bd332ade None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:33.578603 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:33.578603 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:33.578603 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:33.578603 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:33.578603 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:33.578603 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:33.578603 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:33.578603 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:33.578603 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:33.578603 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:33.578603 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:33.578603 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:58:33.578603 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:58:33.578603 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:58:33.579469 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:58:33.579469 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:33.579469 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:33.579469 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:33.579469 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:33.579469 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:33.579469 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:33.579469 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:33.579469 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:33.579469 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:33.579469 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:33.579469 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:33.579469 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:33.579469 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:33.579469 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:33.579469 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:33.579469 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:33.581306 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:58:33.581306 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:58:33.581306 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:58:33.581306 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:58:33.581306 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:58:33.581306 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:58:33.581306 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:33.581306 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:33.584471 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-db850db9-02da-4adf-9796-02979fd5f763 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:33.584471 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:33.584471 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:33.584471 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:33.584471 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:33.584471 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:33.584471 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:33.584471 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:33.584471 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:33.584471 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:33.584471 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:33.584471 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:33.584471 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:33.584471 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:33.584471 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:33.585483 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:33.585483 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:33.585483 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:33.585483 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:33.585483 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:33.585483 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:33.585483 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:33.585483 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:33.585483 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:33.585483 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:33.585483 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:33.585483 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:33.585483 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:33.585483 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:33.585483 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:33.585483 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:33.585483 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:33.587783 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:33.587783 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:33.587783 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:33.587783 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:33.588278 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 328/648] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:33.588278 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf187c-a7f4-4b7b-80a9-0f49bd332ade None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:33.588552 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 321/649] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:33.588552 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db850db9-02da-4adf-9796-02979fd5f763 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:33.650149 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:33.695600 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db850db9-02da-4adf-9796-02979fd5f763 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:33.702725 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf187c-a7f4-4b7b-80a9-0f49bd332ade None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:33.733817 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8239ac41-0464-4474-bf3f-8d0e5585af08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:33.734608 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239ac41-0464-4474-bf3f-8d0e5585af08 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:33.734892 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239ac41-0464-4474-bf3f-8d0e5585af08 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:33.735174 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239ac41-0464-4474-bf3f-8d0e5585af08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:33.740557 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc10c08-d924-4f01-9923-22942088eac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:33.741391 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc10c08-d924-4f01-9923-22942088eac8 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:33.741675 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc10c08-d924-4f01-9923-22942088eac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:33.741952 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc10c08-d924-4f01-9923-22942088eac8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:33.753177 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc10c08-d924-4f01-9923-22942088eac8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:33.754640 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc10c08-d924-4f01-9923-22942088eac8 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:33.773276 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-6dc10c08-d924-4f01-9923-22942088eac8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:33.773276 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:33.773276 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:33.773276 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:33.773276 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:33.773276 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:33.773276 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:33.773276 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:33.773276 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:33.773276 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:33.773276 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:33.773276 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:33.773276 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:33.773276 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:33.773276 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:33.774231 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:33.774231 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:33.774231 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:33.774231 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:33.774231 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:33.774231 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:33.774231 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:33.774231 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:33.774231 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:33.774231 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:33.774231 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:33.774231 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:33.774231 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:33.774231 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:33.774231 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:33.774231 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:33.774231 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:33.775148 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:33.775148 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:33.775148 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:33.775148 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:33.775148 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 329/650] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:33.779764 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc10c08-d924-4f01-9923-22942088eac8 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:33.791730 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:33.812993 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8239ac41-0464-4474-bf3f-8d0e5585af08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:33.814588 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8239ac41-0464-4474-bf3f-8d0e5585af08 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:33.879005 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:33.890700 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc10c08-d924-4f01-9923-22942088eac8 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:33.921725 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 322/651] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 05:58:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:58:33.922555 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8239ac41-0464-4474-bf3f-8d0e5585af08 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:33.931077 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813122b5-f275-4413-b6c6-a165c1e8a5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:33.932240 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813122b5-f275-4413-b6c6-a165c1e8a5f2 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:33.932520 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813122b5-f275-4413-b6c6-a165c1e8a5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:33.932826 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813122b5-f275-4413-b6c6-a165c1e8a5f2 None admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:33.933964 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813122b5-f275-4413-b6c6-a165c1e8a5f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:33.934275 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813122b5-f275-4413-b6c6-a165c1e8a5f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:33.936001 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813122b5-f275-4413-b6c6-a165c1e8a5f2 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:33.948424 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 330/652] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jun 20 05:58:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:33.949322 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813122b5-f275-4413-b6c6-a165c1e8a5f2 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:34.021449 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:34.035086 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8239ac41-0464-4474-bf3f-8d0e5585af08 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:34.059620 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813122b5-f275-4413-b6c6-a165c1e8a5f2 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:34.073047 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ce579-cc1c-4074-b8a5-a4c77c863e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:34.073645 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ce579-cc1c-4074-b8a5-a4c77c863e96 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:34.073972 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ce579-cc1c-4074-b8a5-a4c77c863e96 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:34.074193 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ce579-cc1c-4074-b8a5-a4c77c863e96 None admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:34.075015 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741ce579-cc1c-4074-b8a5-a4c77c863e96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:34.075770 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741ce579-cc1c-4074-b8a5-a4c77c863e96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:34.076941 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741ce579-cc1c-4074-b8a5-a4c77c863e96 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:34.092317 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 323/653] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:34.092317 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ce579-cc1c-4074-b8a5-a4c77c863e96 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:34.103858 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123febfc-6ad9-4d4b-b89b-c87f044b5875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:34.104961 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123febfc-6ad9-4d4b-b89b-c87f044b5875 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:34.105339 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123febfc-6ad9-4d4b-b89b-c87f044b5875 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:34.105539 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123febfc-6ad9-4d4b-b89b-c87f044b5875 None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:34.106242 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123febfc-6ad9-4d4b-b89b-c87f044b5875 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:34.106554 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123febfc-6ad9-4d4b-b89b-c87f044b5875 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:34.107926 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123febfc-6ad9-4d4b-b89b-c87f044b5875 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:34.117923 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:34.124462 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 331/654] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:34.124462 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123febfc-6ad9-4d4b-b89b-c87f044b5875 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:34.207563 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ce579-cc1c-4074-b8a5-a4c77c863e96 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:34.229110 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123febfc-6ad9-4d4b-b89b-c87f044b5875 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:34.244467 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449612bb-e843-4ed4-a32e-9762b1846f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:34.245291 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449612bb-e843-4ed4-a32e-9762b1846f63 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:34.245576 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449612bb-e843-4ed4-a32e-9762b1846f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:34.245857 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449612bb-e843-4ed4-a32e-9762b1846f63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:34.256997 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449612bb-e843-4ed4-a32e-9762b1846f63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:34.258436 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449612bb-e843-4ed4-a32e-9762b1846f63 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:34.258745 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:34.268530 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1305af-db63-4ac4-9535-e506e98b6d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:34.269228 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1305af-db63-4ac4-9535-e506e98b6d98 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:34.269516 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1305af-db63-4ac4-9535-e506e98b6d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:34.269795 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1305af-db63-4ac4-9535-e506e98b6d98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:34.270630 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1305af-db63-4ac4-9535-e506e98b6d98 None admin] RBAC: Adding query filter params (role.id=b7e86f43512c42bfa0d069e3e6fb97c5, scope.project.id=b349043204b34d1794818184ffe6505c, user.id=3cee106502e54829ad802ee41c9165fa) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:34.270945 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1305af-db63-4ac4-9535-e506e98b6d98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:34.272379 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1305af-db63-4ac4-9535-e506e98b6d98 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:34.277015 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-449612bb-e843-4ed4-a32e-9762b1846f63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:34.277015 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:34.277015 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:34.277015 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:34.277015 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:34.277015 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:34.277015 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:34.277015 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:34.277015 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:34.277015 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:34.277015 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:34.277015 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:34.277015 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:34.277015 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:34.277015 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:34.277905 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:34.277905 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:34.277905 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:34.277905 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:34.277905 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:34.277905 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:34.277905 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:34.277905 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:34.277905 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:34.277905 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:34.277905 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:34.277905 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:34.277905 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:34.277905 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:34.277905 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:34.277905 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:34.277905 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:34.291139 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:34.291139 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:34.291139 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:34.291139 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:34.291452 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 332/655] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jun 20 05:58:34 2022] GET /identity/v3/role_assignments?user.id=3cee106502e54829ad802ee41c9165fa&scope.project.id=b349043204b34d1794818184ffe6505c&role.id=b7e86f43512c42bfa0d069e3e6fb97c5 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:34.291452 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1305af-db63-4ac4-9535-e506e98b6d98 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:34.291622 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 324/656] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:34.291622 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449612bb-e843-4ed4-a32e-9762b1846f63 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:34.377719 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:34.409414 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449612bb-e843-4ed4-a32e-9762b1846f63 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:34.447913 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1305af-db63-4ac4-9535-e506e98b6d98 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:34.460395 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db959c9-2e16-4d07-896d-921993329451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:34.461429 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db959c9-2e16-4d07-896d-921993329451 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:34.461813 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db959c9-2e16-4d07-896d-921993329451 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:34.462451 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db959c9-2e16-4d07-896d-921993329451 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:34.475150 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db959c9-2e16-4d07-896d-921993329451 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:34.476760 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db959c9-2e16-4d07-896d-921993329451 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:34.493346 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-0db959c9-2e16-4d07-896d-921993329451 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 20 05:58:34.493346 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:34.493346 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:34.493346 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:34.493346 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:34.493346 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:34.493346 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:34.493346 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:34.493346 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:34.493346 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:34.493346 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:34.493346 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:34.493346 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:58:34.493346 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:58:34.493346 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:58:34.493346 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:58:34.494336 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:34.494336 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:34.494336 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:58:34.494336 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:34.494336 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:58:34.494336 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:34.494336 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:34.494336 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:34.494336 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:34.494336 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:34.494336 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:34.494336 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:34.494336 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:34.494336 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:34.494336 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:34.494336 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:34.494336 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:34.494336 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:34.495910 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:34.495910 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:34.495910 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:58:34.495910 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:58:34.495910 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:58:34.495910 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:58:34.495910 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:58:34.495910 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:58:34.495910 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 20 05:58:34.495910 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:34.495910 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 325/657] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jun 20 05:58:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:34.495910 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db959c9-2e16-4d07-896d-921993329451 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:34.503507 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d013ca-e25e-4135-977d-6ff359d2b357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:34.504326 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d013ca-e25e-4135-977d-6ff359d2b357 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:34.504610 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d013ca-e25e-4135-977d-6ff359d2b357 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:34.504989 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d013ca-e25e-4135-977d-6ff359d2b357 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:34.514075 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d013ca-e25e-4135-977d-6ff359d2b357 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:34.516124 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d013ca-e25e-4135-977d-6ff359d2b357 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:34.534953 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-93d013ca-e25e-4135-977d-6ff359d2b357 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 20 05:58:34.534953 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:34.534953 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:34.534953 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:34.534953 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:34.534953 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:34.534953 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:34.534953 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:34.534953 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:34.534953 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:34.534953 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:34.534953 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:34.534953 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:58:34.534953 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:58:34.534953 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:58:34.534953 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:58:34.535942 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:34.535942 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:34.535942 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:58:34.535942 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:34.535942 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:58:34.535942 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:34.535942 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:34.535942 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:34.535942 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:34.535942 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:34.535942 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:34.535942 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:34.535942 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:34.535942 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:34.535942 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:34.535942 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:34.535942 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:34.535942 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:34.536929 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:34.536929 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:34.536929 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:58:34.536929 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:58:34.536929 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:58:34.536929 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:58:34.536929 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:58:34.536929 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:58:34.536929 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 20 05:58:34.536929 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:34.537479 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 333/658] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 05:58:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:34.538150 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d013ca-e25e-4135-977d-6ff359d2b357 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:34.606517 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:34.638649 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db959c9-2e16-4d07-896d-921993329451 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:34.667846 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d013ca-e25e-4135-977d-6ff359d2b357 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:34.679679 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7963955-7f46-404e-9e8a-eff960728c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:34.680344 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7963955-7f46-404e-9e8a-eff960728c15 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:34.680623 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7963955-7f46-404e-9e8a-eff960728c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:34.680927 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7963955-7f46-404e-9e8a-eff960728c15 None admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:34.681711 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7963955-7f46-404e-9e8a-eff960728c15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:34.681955 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7963955-7f46-404e-9e8a-eff960728c15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:34.683344 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7963955-7f46-404e-9e8a-eff960728c15 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:34.685015 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:34.698906 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 326/659] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:34.704015 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7963955-7f46-404e-9e8a-eff960728c15 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:34.704732 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad42ce0-cbe1-4442-863a-bd8161ae175a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:34.705828 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad42ce0-cbe1-4442-863a-bd8161ae175a None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:34.706142 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad42ce0-cbe1-4442-863a-bd8161ae175a None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:34.706584 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad42ce0-cbe1-4442-863a-bd8161ae175a None admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:34.707432 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad42ce0-cbe1-4442-863a-bd8161ae175a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:34.707745 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad42ce0-cbe1-4442-863a-bd8161ae175a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:34.709209 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad42ce0-cbe1-4442-863a-bd8161ae175a None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:34.726701 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 334/660] 10.222.0.39 () {56 vars in 1139 bytes} [Mon Jun 20 05:58:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:34.727992 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce24c4e-a072-49c8-b295-94d64a1d6195 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:34.728282 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce24c4e-a072-49c8-b295-94d64a1d6195 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:34.728561 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce24c4e-a072-49c8-b295-94d64a1d6195 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:34.730125 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 335/661] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:34.730833 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce24c4e-a072-49c8-b295-94d64a1d6195 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:34.830686 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7963955-7f46-404e-9e8a-eff960728c15 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:34.854774 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce24c4e-a072-49c8-b295-94d64a1d6195 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:34.866258 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad7fa3-6634-4cf7-a058-d214ca6cb282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:34.866838 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:34.866980 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad7fa3-6634-4cf7-a058-d214ca6cb282 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:34.867472 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad7fa3-6634-4cf7-a058-d214ca6cb282 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:34.867472 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad7fa3-6634-4cf7-a058-d214ca6cb282 None admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:34.868307 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ad7fa3-6634-4cf7-a058-d214ca6cb282 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:34.868755 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ad7fa3-6634-4cf7-a058-d214ca6cb282 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:34.870230 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ad7fa3-6634-4cf7-a058-d214ca6cb282 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:34.888500 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 327/662] 10.222.0.39 () {56 vars in 1137 bytes} [Mon Jun 20 05:58:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:34.889506 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad7fa3-6634-4cf7-a058-d214ca6cb282 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:34.899158 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed191002-8efc-4111-9974-9f67ea10dd05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:34.899957 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed191002-8efc-4111-9974-9f67ea10dd05 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:34.900242 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed191002-8efc-4111-9974-9f67ea10dd05 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:34.900518 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed191002-8efc-4111-9974-9f67ea10dd05 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:34.907721 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed191002-8efc-4111-9974-9f67ea10dd05 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:34.909606 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed191002-8efc-4111-9974-9f67ea10dd05 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:34.924254 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-ed191002-8efc-4111-9974-9f67ea10dd05 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:34.924254 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:34.924254 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:34.924254 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:34.924254 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:34.924254 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:34.924254 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:34.924254 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:34.924254 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:34.924254 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:34.924254 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:34.924254 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:34.924254 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:58:34.924254 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:58:34.924254 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:58:34.925540 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:58:34.925540 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:34.925540 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:34.925540 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:34.925540 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:34.925540 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:34.925540 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:34.925540 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:34.925540 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:34.925540 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:34.925540 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:34.925540 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:34.925540 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:34.925540 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:34.925540 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:34.925540 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:34.925540 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:34.926506 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:58:34.926506 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:58:34.926506 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:58:34.926506 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:58:34.926506 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:58:34.926506 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:58:34.926506 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:34.926506 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:34.926506 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 336/663] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:34.927570 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44925ce9-881a-474b-b458-fdbcfae5e212 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:34.927860 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44925ce9-881a-474b-b458-fdbcfae5e212 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:34.928141 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44925ce9-881a-474b-b458-fdbcfae5e212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:34.949060 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-44925ce9-881a-474b-b458-fdbcfae5e212 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:34.950272 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-44925ce9-881a-474b-b458-fdbcfae5e212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:34.958671 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:35.006906 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad7fa3-6634-4cf7-a058-d214ca6cb282 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:35.022895 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 337/664] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:58:35.029630 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44925ce9-881a-474b-b458-fdbcfae5e212 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:35.045840 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cfaab1-d873-4604-b702-5e1dcce21956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:35.046819 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cfaab1-d873-4604-b702-5e1dcce21956 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:35.046998 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cfaab1-d873-4604-b702-5e1dcce21956 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:35.047341 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cfaab1-d873-4604-b702-5e1dcce21956 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:35.120897 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cfaab1-d873-4604-b702-5e1dcce21956 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:35.122338 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cfaab1-d873-4604-b702-5e1dcce21956 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:35.161677 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:35.166092 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44925ce9-881a-474b-b458-fdbcfae5e212 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:35.178126 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:35.211412 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0c8fa-9b5f-48bd-9be7-305c1e688e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:35.212327 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0c8fa-9b5f-48bd-9be7-305c1e688e2d None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:35.212614 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0c8fa-9b5f-48bd-9be7-305c1e688e2d None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:35.212930 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0c8fa-9b5f-48bd-9be7-305c1e688e2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:35.230598 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 328/665] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 05:58:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:58:35.235922 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cfaab1-d873-4604-b702-5e1dcce21956 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:35.289765 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba0c8fa-9b5f-48bd-9be7-305c1e688e2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:35.291216 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba0c8fa-9b5f-48bd-9be7-305c1e688e2d None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:35.339690 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cfaab1-d873-4604-b702-5e1dcce21956 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:35.381162 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e740c-4e0d-4697-92be-31cce3672c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:35.381888 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e740c-4e0d-4697-92be-31cce3672c61 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:35.382172 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e740c-4e0d-4697-92be-31cce3672c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:35.382472 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e740c-4e0d-4697-92be-31cce3672c61 None admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:35.383693 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056e740c-4e0d-4697-92be-31cce3672c61 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:35.384011 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056e740c-4e0d-4697-92be-31cce3672c61 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:35.385643 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056e740c-4e0d-4697-92be-31cce3672c61 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:35.393639 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:35.402616 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 329/666] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jun 20 05:58:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:35.402616 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e740c-4e0d-4697-92be-31cce3672c61 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:35.402845 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 338/667] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 05:58:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:58:35.402845 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0c8fa-9b5f-48bd-9be7-305c1e688e2d None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:35.419397 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:35.516746 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0c8fa-9b5f-48bd-9be7-305c1e688e2d None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:35.532262 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e740c-4e0d-4697-92be-31cce3672c61 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:35.554742 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36602913-52bc-4081-8169-ceefcfd904a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:35.555564 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36602913-52bc-4081-8169-ceefcfd904a9 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:35.555842 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36602913-52bc-4081-8169-ceefcfd904a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:35.556112 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36602913-52bc-4081-8169-ceefcfd904a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:35.568144 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36602913-52bc-4081-8169-ceefcfd904a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:35.569616 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36602913-52bc-4081-8169-ceefcfd904a9 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:35.581667 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada42215-37bc-4512-94cd-76bce32a37fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:35.582569 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada42215-37bc-4512-94cd-76bce32a37fc None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:35.582925 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada42215-37bc-4512-94cd-76bce32a37fc None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:35.583273 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada42215-37bc-4512-94cd-76bce32a37fc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:35.589377 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-36602913-52bc-4081-8169-ceefcfd904a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:35.589377 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:35.589377 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:35.589377 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:35.589377 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:35.589377 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:35.589377 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:35.589377 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:35.589377 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:35.589377 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:35.589377 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:35.589377 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:35.589377 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:35.589377 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:35.589377 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:35.590246 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:35.590246 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:35.590246 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:35.590246 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:35.590246 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:35.590246 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:35.590246 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:35.590246 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:35.590246 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:35.590246 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:35.590246 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:35.590246 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:35.590246 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:35.590246 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:35.590246 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:35.590246 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:35.590246 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:35.591146 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:35.591146 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:35.591146 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:35.591146 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:35.591146 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 339/668] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:35.591418 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36602913-52bc-4081-8169-ceefcfd904a9 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:35.597889 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada42215-37bc-4512-94cd-76bce32a37fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:35.605577 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-ada42215-37bc-4512-94cd-76bce32a37fc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:35.605577 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:35.605577 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:35.605577 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:35.605577 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:35.605577 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:35.605577 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:35.605577 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:35.605577 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:35.605577 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:35.605577 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:35.605577 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:35.605577 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:35.605577 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:35.605577 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:35.605577 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:35.606733 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:35.606733 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:35.606733 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:35.606733 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:35.606733 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:35.606733 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:35.606733 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:35.606733 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:35.606733 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:35.606733 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:35.606733 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:35.606733 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:35.606733 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:35.606733 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:35.606733 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:35.606733 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:35.607809 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:35.607809 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:35.607809 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:35.607809 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:35.607809 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:35.607809 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:35.607809 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:35.607809 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:35.607809 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:35.607809 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:35.607809 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:35.607809 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:35.607809 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 330/669] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jun 20 05:58:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:35.607809 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada42215-37bc-4512-94cd-76bce32a37fc None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:35.659369 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:35.684800 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:35.711667 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36602913-52bc-4081-8169-ceefcfd904a9 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:35.719518 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada42215-37bc-4512-94cd-76bce32a37fc None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:35.749521 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65f42f-aa04-4b3b-88e5-ef487ef35f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:35.750315 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65f42f-aa04-4b3b-88e5-ef487ef35f03 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:35.750598 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65f42f-aa04-4b3b-88e5-ef487ef35f03 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:35.750875 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65f42f-aa04-4b3b-88e5-ef487ef35f03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:35.757460 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee4d75-86d7-46e1-a4b3-6ace096f2183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:35.758211 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee4d75-86d7-46e1-a4b3-6ace096f2183 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:35.758493 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee4d75-86d7-46e1-a4b3-6ace096f2183 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:35.758764 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee4d75-86d7-46e1-a4b3-6ace096f2183 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:35.759708 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ee4d75-86d7-46e1-a4b3-6ace096f2183 None admin] RBAC: Adding query filter params (role.id=b7e86f43512c42bfa0d069e3e6fb97c5, scope.project.id=b349043204b34d1794818184ffe6505c, user.id=19bd2ac77c5d48d49b58712f4025e279) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:35.760075 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ee4d75-86d7-46e1-a4b3-6ace096f2183 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:35.761021 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d65f42f-aa04-4b3b-88e5-ef487ef35f03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:35.761443 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ee4d75-86d7-46e1-a4b3-6ace096f2183 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:35.762435 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d65f42f-aa04-4b3b-88e5-ef487ef35f03 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:35.776982 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 331/670] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jun 20 05:58:35 2022] GET /identity/v3/role_assignments?user.id=19bd2ac77c5d48d49b58712f4025e279&scope.project.id=b349043204b34d1794818184ffe6505c&role.id=b7e86f43512c42bfa0d069e3e6fb97c5 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:35.776982 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee4d75-86d7-46e1-a4b3-6ace096f2183 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:35.790447 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-7d65f42f-aa04-4b3b-88e5-ef487ef35f03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:35.790447 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:35.790447 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:35.790447 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:35.790447 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:35.790447 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:35.790447 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:35.790447 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:35.790447 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:35.790447 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:35.790447 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:35.790447 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:35.790447 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:35.790447 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:35.790447 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:35.791618 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:35.791618 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:35.791618 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:35.791618 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:35.791618 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:35.791618 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:35.791618 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:35.791618 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:35.791618 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:35.791618 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:35.791618 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:35.791618 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:35.791618 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:35.791618 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:35.791618 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:35.791618 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:35.791618 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:35.792692 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:35.792692 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:35.792692 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:35.792692 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:35.793537 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 340/671] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:35.794402 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65f42f-aa04-4b3b-88e5-ef487ef35f03 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:35.909476 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee4d75-86d7-46e1-a4b3-6ace096f2183 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:35.910025 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65f42f-aa04-4b3b-88e5-ef487ef35f03 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:35.913374 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:35.961553 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4365a272-7434-4999-91f2-cbfc4cffe129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:35.962319 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4365a272-7434-4999-91f2-cbfc4cffe129 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:35.962604 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54126a-469c-49d8-b52d-305b04cf72fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:35.962731 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4365a272-7434-4999-91f2-cbfc4cffe129 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:35.963055 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4365a272-7434-4999-91f2-cbfc4cffe129 None admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:35.963712 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54126a-469c-49d8-b52d-305b04cf72fa None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:35.963978 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4365a272-7434-4999-91f2-cbfc4cffe129 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:35.964297 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54126a-469c-49d8-b52d-305b04cf72fa None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:35.964441 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4365a272-7434-4999-91f2-cbfc4cffe129 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:35.964969 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54126a-469c-49d8-b52d-305b04cf72fa None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:35.965871 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf54126a-469c-49d8-b52d-305b04cf72fa None admin] RBAC: Adding query filter params (name=service) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:35.966233 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4365a272-7434-4999-91f2-cbfc4cffe129 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:35.966474 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf54126a-469c-49d8-b52d-305b04cf72fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:35.968298 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf54126a-469c-49d8-b52d-305b04cf72fa None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:35.969692 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:35.981712 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 341/672] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jun 20 05:58:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:35.982570 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54126a-469c-49d8-b52d-305b04cf72fa None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:35.984936 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 332/673] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:35.989050 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4365a272-7434-4999-91f2-cbfc4cffe129 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:36.116767 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54126a-469c-49d8-b52d-305b04cf72fa None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:36.125571 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4365a272-7434-4999-91f2-cbfc4cffe129 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:36.162065 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff508614-acc0-4dda-9d09-1f5ec8e582a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:36.163091 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff508614-acc0-4dda-9d09-1f5ec8e582a4 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:36.163444 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff508614-acc0-4dda-9d09-1f5ec8e582a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:36.163801 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff508614-acc0-4dda-9d09-1f5ec8e582a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:36.164576 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff508614-acc0-4dda-9d09-1f5ec8e582a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:36.164973 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff508614-acc0-4dda-9d09-1f5ec8e582a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:36.166414 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff508614-acc0-4dda-9d09-1f5ec8e582a4 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:36.167914 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c9c71e-ff2b-483a-b05f-d8abed8e004a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:36.168943 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9c71e-ff2b-483a-b05f-d8abed8e004a None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:36.169435 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9c71e-ff2b-483a-b05f-d8abed8e004a None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:36.169910 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9c71e-ff2b-483a-b05f-d8abed8e004a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:36.181703 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c9c71e-ff2b-483a-b05f-d8abed8e004a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:36.183865 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c9c71e-ff2b-483a-b05f-d8abed8e004a None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:36.185488 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 342/674] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:36.186307 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff508614-acc0-4dda-9d09-1f5ec8e582a4 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:36.207597 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-44c9c71e-ff2b-483a-b05f-d8abed8e004a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:36.207597 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:36.207597 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:36.207597 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:36.207597 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:36.207597 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:36.207597 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:36.207597 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:36.207597 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:36.207597 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:36.207597 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:36.207597 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:36.207597 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:36.207597 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:36.207597 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:36.208575 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:36.208575 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:36.208575 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:36.208575 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:36.208575 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:36.208575 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:36.208575 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:36.208575 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:36.208575 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:36.208575 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:36.208575 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:36.208575 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:36.208575 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:36.208575 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:36.208575 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:36.208575 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:36.208575 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:36.209513 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:36.209513 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:36.209513 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:36.209513 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:36.211861 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 333/675] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:58:36.212974 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c9c71e-ff2b-483a-b05f-d8abed8e004a None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:36.219972 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:36.270649 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:36.321751 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff508614-acc0-4dda-9d09-1f5ec8e582a4 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:36.348565 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c9c71e-ff2b-483a-b05f-d8abed8e004a None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:36.365009 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c865f784-5376-4a1d-9283-ab395a3bca8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:36.366174 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865f784-5376-4a1d-9283-ab395a3bca8b None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:36.366678 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865f784-5376-4a1d-9283-ab395a3bca8b None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:36.367151 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865f784-5376-4a1d-9283-ab395a3bca8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:36.375777 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c865f784-5376-4a1d-9283-ab395a3bca8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:36.379792 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c865f784-5376-4a1d-9283-ab395a3bca8b None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:36.391511 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c4c3d-ba4b-4c36-8342-7168e976a8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:36.392434 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c4c3d-ba4b-4c36-8342-7168e976a8ed None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:36.393111 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c4c3d-ba4b-4c36-8342-7168e976a8ed None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:36.393292 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c4c3d-ba4b-4c36-8342-7168e976a8ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:36.399218 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-c865f784-5376-4a1d-9283-ab395a3bca8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:36.399218 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:36.399218 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:36.399218 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:36.399218 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:36.399218 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:36.399218 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:36.399218 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:36.399218 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:36.399218 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:36.399218 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:36.399218 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:36.399218 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:58:36.399218 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:58:36.399218 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:58:36.400139 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:58:36.400139 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:36.400139 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:36.400139 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:36.400139 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:36.400139 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:36.400139 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:36.400139 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:36.400139 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:36.400139 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:36.400139 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:36.400139 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:36.400139 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:36.400139 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:36.400139 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:36.400139 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:36.400139 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:36.401081 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:58:36.401081 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:58:36.401081 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:58:36.401081 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:58:36.401081 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:58:36.401081 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:58:36.401081 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:36.401081 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:36.406656 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 343/676] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:36.406656 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c865f784-5376-4a1d-9283-ab395a3bca8b None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:36.407444 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c4c3d-ba4b-4c36-8342-7168e976a8ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:36.409126 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c4c3d-ba4b-4c36-8342-7168e976a8ed None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:36.425757 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-662c4c3d-ba4b-4c36-8342-7168e976a8ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:36.425757 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:36.425757 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:36.425757 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:36.425757 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:36.425757 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:36.425757 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:36.425757 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:36.425757 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:36.425757 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:36.425757 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:36.425757 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:36.425757 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:58:36.425757 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:58:36.425757 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:58:36.426722 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:58:36.426722 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:36.426722 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:36.426722 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:36.426722 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:36.426722 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:36.426722 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:36.426722 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:36.426722 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:36.426722 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:36.426722 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:36.426722 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:36.426722 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:36.426722 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:36.426722 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:36.426722 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:36.426722 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:36.428058 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:58:36.428058 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:58:36.428058 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:58:36.428058 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:58:36.428058 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:58:36.428058 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:58:36.428058 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:36.428058 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:36.428058 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 334/677] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:36.428058 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c4c3d-ba4b-4c36-8342-7168e976a8ed None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:36.533014 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:36.549815 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c4c3d-ba4b-4c36-8342-7168e976a8ed None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:36.551130 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c865f784-5376-4a1d-9283-ab395a3bca8b None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:36.559430 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:36.587088 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324daa3-6066-45c0-b466-0e3dc0cc69c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:36.587743 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324daa3-6066-45c0-b466-0e3dc0cc69c8 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:36.588022 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324daa3-6066-45c0-b466-0e3dc0cc69c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:36.588292 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324daa3-6066-45c0-b466-0e3dc0cc69c8 None admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:36.589097 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5324daa3-6066-45c0-b466-0e3dc0cc69c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:36.589405 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5324daa3-6066-45c0-b466-0e3dc0cc69c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:36.590824 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5324daa3-6066-45c0-b466-0e3dc0cc69c8 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:36.593856 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66def01a-3b93-4332-841f-88b10a82a3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:36.594375 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66def01a-3b93-4332-841f-88b10a82a3d0 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:36.594375 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66def01a-3b93-4332-841f-88b10a82a3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:36.594629 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66def01a-3b93-4332-841f-88b10a82a3d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:36.595847 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66def01a-3b93-4332-841f-88b10a82a3d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:36.596726 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66def01a-3b93-4332-841f-88b10a82a3d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:36.598116 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66def01a-3b93-4332-841f-88b10a82a3d0 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:36.609790 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 335/678] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jun 20 05:58:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:36.609790 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324daa3-6066-45c0-b466-0e3dc0cc69c8 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:36.617055 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 344/679] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:36.621769 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953265ac-305b-4ff0-918a-f8001c95d46a None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:36.621769 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953265ac-305b-4ff0-918a-f8001c95d46a None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:36.621769 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953265ac-305b-4ff0-918a-f8001c95d46a None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:36.621769 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 345/680] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:58:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:36.621769 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953265ac-305b-4ff0-918a-f8001c95d46a None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:36.716600 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324daa3-6066-45c0-b466-0e3dc0cc69c8 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:36.735717 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953265ac-305b-4ff0-918a-f8001c95d46a None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:36.750761 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50960b6-5f51-4cf9-8fc6-67b6bc923a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:36.751417 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50960b6-5f51-4cf9-8fc6-67b6bc923a7b None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:36.752241 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50960b6-5f51-4cf9-8fc6-67b6bc923a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:36.752544 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50960b6-5f51-4cf9-8fc6-67b6bc923a7b None admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:36.753330 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50960b6-5f51-4cf9-8fc6-67b6bc923a7b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:36.753637 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50960b6-5f51-4cf9-8fc6-67b6bc923a7b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:36.755055 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50960b6-5f51-4cf9-8fc6-67b6bc923a7b None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:36.771637 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 336/681] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jun 20 05:58:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:36.771637 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50960b6-5f51-4cf9-8fc6-67b6bc923a7b None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:36.777888 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e108174-9e71-48d1-90be-3a8aa0ecb0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:36.778565 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e108174-9e71-48d1-90be-3a8aa0ecb0c4 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:36.778922 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e108174-9e71-48d1-90be-3a8aa0ecb0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:36.779137 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e108174-9e71-48d1-90be-3a8aa0ecb0c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:36.779970 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e108174-9e71-48d1-90be-3a8aa0ecb0c4 None admin] RBAC: Adding query filter params (role.id=b7e86f43512c42bfa0d069e3e6fb97c5, scope.project.id=b349043204b34d1794818184ffe6505c, user.id=83e77cb05c4546c7a98ada817573edf3) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:36.780285 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e108174-9e71-48d1-90be-3a8aa0ecb0c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:36.781751 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e108174-9e71-48d1-90be-3a8aa0ecb0c4 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:36.795113 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 346/682] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jun 20 05:58:36 2022] GET /identity/v3/role_assignments?user.id=83e77cb05c4546c7a98ada817573edf3&scope.project.id=b349043204b34d1794818184ffe6505c&role.id=b7e86f43512c42bfa0d069e3e6fb97c5 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:36.795113 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1067b01b-20fd-45a8-b133-d00abf8d4a3d None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:36.795113 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1067b01b-20fd-45a8-b133-d00abf8d4a3d None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:36.795113 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1067b01b-20fd-45a8-b133-d00abf8d4a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:36.813885 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-1067b01b-20fd-45a8-b133-d00abf8d4a3d None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:36.815986 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-1067b01b-20fd-45a8-b133-d00abf8d4a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:36.816222 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:36.832544 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:36.911847 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50960b6-5f51-4cf9-8fc6-67b6bc923a7b None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:36.919018 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 347/683] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:58:36.920031 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1067b01b-20fd-45a8-b133-d00abf8d4a3d None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:36.969104 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c0467a-59d5-47ea-8a1e-d443f9123fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:36.969905 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0467a-59d5-47ea-8a1e-d443f9123fc5 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:36.972207 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0467a-59d5-47ea-8a1e-d443f9123fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:36.972207 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0467a-59d5-47ea-8a1e-d443f9123fc5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:36.980643 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c0467a-59d5-47ea-8a1e-d443f9123fc5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:36.982200 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c0467a-59d5-47ea-8a1e-d443f9123fc5 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:37.000329 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-19c0467a-59d5-47ea-8a1e-d443f9123fc5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 20 05:58:37.000329 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:37.000329 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:37.000329 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:37.000329 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:37.000329 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:37.000329 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:37.000329 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:37.000329 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:37.000329 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:37.000329 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:37.000329 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:37.000329 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:58:37.000329 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:58:37.000329 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:58:37.000329 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:58:37.001470 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:37.001470 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:37.001470 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:58:37.001470 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:37.001470 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:58:37.001470 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:37.001470 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:37.001470 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:37.001470 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:37.001470 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:37.001470 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:37.001470 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:37.001470 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:37.001470 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:37.001470 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:37.001470 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:37.001470 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:37.001470 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:37.002480 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:37.002480 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:37.002480 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:58:37.002480 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:58:37.002480 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:58:37.002480 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:58:37.002480 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:58:37.002480 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:58:37.002480 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 20 05:58:37.002480 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:37.002480 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 337/684] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jun 20 05:58:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:37.003114 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c0467a-59d5-47ea-8a1e-d443f9123fc5 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:37.068116 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1067b01b-20fd-45a8-b133-d00abf8d4a3d None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:37.109221 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcee37d-3316-49c4-a8ad-1f8d0b7283b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:37.110054 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcee37d-3316-49c4-a8ad-1f8d0b7283b1 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:37.110343 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcee37d-3316-49c4-a8ad-1f8d0b7283b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:37.110621 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcee37d-3316-49c4-a8ad-1f8d0b7283b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:37.112510 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcee37d-3316-49c4-a8ad-1f8d0b7283b1 None admin] RBAC: Adding query filter params (role.id=b7e86f43512c42bfa0d069e3e6fb97c5, scope.project.id=b349043204b34d1794818184ffe6505c, user.id=b9cb22811a754357ab9d839b70d44261) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:37.112858 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcee37d-3316-49c4-a8ad-1f8d0b7283b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:37.114481 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcee37d-3316-49c4-a8ad-1f8d0b7283b1 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:37.123112 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 348/685] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jun 20 05:58:36 2022] GET /identity/v3/role_assignments?user.id=b9cb22811a754357ab9d839b70d44261&scope.project.id=b349043204b34d1794818184ffe6505c&role.id=b7e86f43512c42bfa0d069e3e6fb97c5 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:37.123947 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcee37d-3316-49c4-a8ad-1f8d0b7283b1 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:37.131621 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:37.164456 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:37.186373 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c0467a-59d5-47ea-8a1e-d443f9123fc5 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:37.231833 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb4ba05-bcfc-44bd-956a-5a084c117b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:37.232726 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4ba05-bcfc-44bd-956a-5a084c117b2d None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:37.233014 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4ba05-bcfc-44bd-956a-5a084c117b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:37.233292 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4ba05-bcfc-44bd-956a-5a084c117b2d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:37.253724 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb4ba05-bcfc-44bd-956a-5a084c117b2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:37.262102 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-ebb4ba05-bcfc-44bd-956a-5a084c117b2d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:58:37.262102 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:37.262102 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:37.262102 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:37.262102 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:37.262102 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:37.262102 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:37.262102 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:37.262102 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:37.262102 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:37.262102 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:37.262102 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:37.262102 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:37.262102 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:37.262102 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:37.262102 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:37.263077 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:37.263077 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:37.263077 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:37.263077 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:37.263077 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:37.263077 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:37.263077 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:37.263077 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:37.263077 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:37.263077 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:37.263077 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:37.263077 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:37.263077 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:37.263077 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:37.263077 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:37.263077 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:37.263923 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:37.263923 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:37.263923 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:37.263923 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:37.263923 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:37.263923 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:37.263923 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:37.263923 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:37.263923 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:37.263923 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:37.263923 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:58:37.263923 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:37.263923 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 338/686] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jun 20 05:58:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:37.269103 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb4ba05-bcfc-44bd-956a-5a084c117b2d None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:37.362113 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcee37d-3316-49c4-a8ad-1f8d0b7283b1 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:37.406370 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb4ba05-bcfc-44bd-956a-5a084c117b2d None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:37.410964 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d7739-7099-4cc1-836e-5858e071a4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:37.411825 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d7739-7099-4cc1-836e-5858e071a4c5 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:37.412253 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d7739-7099-4cc1-836e-5858e071a4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:37.412714 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d7739-7099-4cc1-836e-5858e071a4c5 None admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:37.413697 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d7739-7099-4cc1-836e-5858e071a4c5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:37.414166 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d7739-7099-4cc1-836e-5858e071a4c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:37.416411 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d7739-7099-4cc1-836e-5858e071a4c5 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:37.444349 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 349/687] 10.222.0.39 () {56 vars in 1135 bytes} [Mon Jun 20 05:58:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:37.450468 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d7739-7099-4cc1-836e-5858e071a4c5 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:37.465883 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4d29c-f66e-4a0e-a137-1b6f31dd1e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:37.466760 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4d29c-f66e-4a0e-a137-1b6f31dd1e30 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:37.468892 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4d29c-f66e-4a0e-a137-1b6f31dd1e30 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:37.469321 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4d29c-f66e-4a0e-a137-1b6f31dd1e30 None admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:37.470779 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a4d29c-f66e-4a0e-a137-1b6f31dd1e30 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:37.471094 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a4d29c-f66e-4a0e-a137-1b6f31dd1e30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:37.472565 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a4d29c-f66e-4a0e-a137-1b6f31dd1e30 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:37.485681 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 339/688] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 05:58:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:37.491197 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4d29c-f66e-4a0e-a137-1b6f31dd1e30 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:37.507800 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:37.547180 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:37.602495 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d7739-7099-4cc1-836e-5858e071a4c5 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:37.620478 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4d29c-f66e-4a0e-a137-1b6f31dd1e30 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:37.660977 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5fe0d8-8571-4002-96dc-91157307e393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:37.661636 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5fe0d8-8571-4002-96dc-91157307e393 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:37.661914 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5fe0d8-8571-4002-96dc-91157307e393 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:37.662185 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5fe0d8-8571-4002-96dc-91157307e393 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:37.671261 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e7250-941a-4a15-a7c0-9594e4e868c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:37.672176 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e7250-941a-4a15-a7c0-9594e4e868c8 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:37.672501 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e7250-941a-4a15-a7c0-9594e4e868c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:37.674547 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e7250-941a-4a15-a7c0-9594e4e868c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:37.690225 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0e7250-941a-4a15-a7c0-9594e4e868c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:37.691832 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0e7250-941a-4a15-a7c0-9594e4e868c8 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:37.711218 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-0c0e7250-941a-4a15-a7c0-9594e4e868c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:37.711218 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:37.711218 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:37.711218 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:37.711218 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:37.711218 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:37.711218 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:37.711218 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:37.711218 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:37.711218 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:37.711218 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:37.711218 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:37.711218 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:37.711218 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:37.711218 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:37.712187 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:37.712187 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:37.712187 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:37.712187 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:37.712187 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:37.712187 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:37.712187 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:37.712187 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:37.712187 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:37.712187 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:37.712187 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:37.712187 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:37.712187 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:37.712187 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:37.712187 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:37.712187 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:37.712187 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:37.713130 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:37.713130 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:37.713130 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:37.713130 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:37.716511 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 340/689] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:37.718312 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e7250-941a-4a15-a7c0-9594e4e868c8 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:37.758037 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5fe0d8-8571-4002-96dc-91157307e393 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:37.759896 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5fe0d8-8571-4002-96dc-91157307e393 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:37.783565 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:37.840495 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:37.890171 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 350/690] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 05:58:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 20 05:58:37.890887 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e7250-941a-4a15-a7c0-9594e4e868c8 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:37.899635 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5fe0d8-8571-4002-96dc-91157307e393 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:37.960767 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec26f1-9691-4002-88c6-e84472a90fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:37.961477 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec26f1-9691-4002-88c6-e84472a90fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:37.961722 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec26f1-9691-4002-88c6-e84472a90fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:37.961996 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec26f1-9691-4002-88c6-e84472a90fc6 None admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:37.962723 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faec26f1-9691-4002-88c6-e84472a90fc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:37.963033 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faec26f1-9691-4002-88c6-e84472a90fc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:37.964415 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faec26f1-9691-4002-88c6-e84472a90fc6 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:37.999076 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 341/691] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:58:38.018807 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec26f1-9691-4002-88c6-e84472a90fc6 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:38.073141 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5fe0d8-8571-4002-96dc-91157307e393 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:38.148432 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b7c18c-ce9d-46f2-b4b7-9391a093930f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:38.149186 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7c18c-ce9d-46f2-b4b7-9391a093930f None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:38.149471 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7c18c-ce9d-46f2-b4b7-9391a093930f None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:38.149750 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7c18c-ce9d-46f2-b4b7-9391a093930f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:38.160543 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b7c18c-ce9d-46f2-b4b7-9391a093930f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:38.162036 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b7c18c-ce9d-46f2-b4b7-9391a093930f None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:38.175788 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec26f1-9691-4002-88c6-e84472a90fc6 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:38.185200 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-16b7c18c-ce9d-46f2-b4b7-9391a093930f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:38.185200 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:38.185200 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:38.185200 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:38.185200 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:38.185200 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:38.185200 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:38.185200 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:38.185200 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:38.185200 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:38.185200 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:38.185200 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:38.185200 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:38.185200 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:38.185200 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:38.186406 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:38.186406 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:38.186406 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:38.186406 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:38.186406 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:38.186406 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:38.186406 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:38.186406 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:38.186406 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:38.186406 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:38.186406 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:38.186406 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:38.186406 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:38.186406 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:38.186406 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:38.186406 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:38.186406 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:38.187775 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:38.187775 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:38.187775 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:38.187775 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:38.187775 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 351/692] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:38.189150 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f6c92-f136-4be6-8e80-9f36a3500dea None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:38.189735 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f6c92-f136-4be6-8e80-9f36a3500dea None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:38.190108 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f6c92-f136-4be6-8e80-9f36a3500dea None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:38.195676 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 352/693] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:58:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:38.195676 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50f6c92-f136-4be6-8e80-9f36a3500dea None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:38.212552 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:38.225116 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:38.231207 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df7edc5-19a4-4762-b27f-700aaefbb043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:38.232277 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7edc5-19a4-4762-b27f-700aaefbb043 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:38.232934 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7edc5-19a4-4762-b27f-700aaefbb043 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:38.234444 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7edc5-19a4-4762-b27f-700aaefbb043 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:38.243995 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df7edc5-19a4-4762-b27f-700aaefbb043 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:38.246019 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df7edc5-19a4-4762-b27f-700aaefbb043 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:38.263442 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-5df7edc5-19a4-4762-b27f-700aaefbb043 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 05:58:38.263442 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:38.263442 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:38.263442 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:38.263442 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:38.263442 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:38.263442 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:38.263442 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:38.263442 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:38.263442 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:38.263442 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:38.263442 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:38.263442 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:58:38.263442 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:58:38.263442 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:58:38.263442 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:58:38.264429 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:38.264429 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:38.264429 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:58:38.264429 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:38.264429 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:58:38.264429 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:38.264429 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:38.264429 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:38.264429 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:38.264429 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:38.264429 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:38.264429 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:38.264429 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:38.264429 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:38.264429 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:38.264429 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:38.264429 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:38.264429 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:38.265406 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:38.265406 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:38.265406 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:58:38.265406 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:58:38.265406 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:58:38.265406 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:58:38.265406 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:58:38.265406 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:58:38.265406 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 05:58:38.265406 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:38.265406 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 342/694] 10.222.0.39 () {56 vars in 1093 bytes} [Mon Jun 20 05:58:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:38.267050 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b4505-b63a-482e-96be-c6013b7982f1 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:38.267719 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b4505-b63a-482e-96be-c6013b7982f1 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:38.268094 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b4505-b63a-482e-96be-c6013b7982f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:38.288197 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-0f7b4505-b63a-482e-96be-c6013b7982f1 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:38.289548 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-0f7b4505-b63a-482e-96be-c6013b7982f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:38.322253 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50f6c92-f136-4be6-8e80-9f36a3500dea None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:38.366196 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e3a119-269e-4dbf-a04e-1c80d30f8fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:38.367027 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3a119-269e-4dbf-a04e-1c80d30f8fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:38.367573 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3a119-269e-4dbf-a04e-1c80d30f8fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:38.367759 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3a119-269e-4dbf-a04e-1c80d30f8fc0 None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:38.368586 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e3a119-269e-4dbf-a04e-1c80d30f8fc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:38.369003 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e3a119-269e-4dbf-a04e-1c80d30f8fc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:38.370498 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e3a119-269e-4dbf-a04e-1c80d30f8fc0 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:38.379634 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 343/695] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:58:38.380766 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7b4505-b63a-482e-96be-c6013b7982f1 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:38.385072 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 353/696] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:38.389923 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e3a119-269e-4dbf-a04e-1c80d30f8fc0 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:38.489795 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:38.504995 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7b4505-b63a-482e-96be-c6013b7982f1 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:38.519884 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e3a119-269e-4dbf-a04e-1c80d30f8fc0 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:38.520594 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:38.543838 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd8457-1b6e-41ee-b176-89dcb21a8b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:38.544774 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd8457-1b6e-41ee-b176-89dcb21a8b5d None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:38.545206 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd8457-1b6e-41ee-b176-89dcb21a8b5d None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:38.545627 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd8457-1b6e-41ee-b176-89dcb21a8b5d None admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:38.546637 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecd8457-1b6e-41ee-b176-89dcb21a8b5d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:38.547098 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecd8457-1b6e-41ee-b176-89dcb21a8b5d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:38.548737 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecd8457-1b6e-41ee-b176-89dcb21a8b5d None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:38.561799 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad7b5a-46f3-4ded-acd9-b7bda8f35911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:38.562727 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad7b5a-46f3-4ded-acd9-b7bda8f35911 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:38.563129 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad7b5a-46f3-4ded-acd9-b7bda8f35911 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:38.563504 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad7b5a-46f3-4ded-acd9-b7bda8f35911 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:38.568373 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 344/697] 10.222.0.39 () {56 vars in 1133 bytes} [Mon Jun 20 05:58:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:38.569424 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd8457-1b6e-41ee-b176-89dcb21a8b5d None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:38.572307 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ad7b5a-46f3-4ded-acd9-b7bda8f35911 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:38.574096 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ad7b5a-46f3-4ded-acd9-b7bda8f35911 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:38.591625 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-48ad7b5a-46f3-4ded-acd9-b7bda8f35911 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:38.591625 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:38.591625 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:38.591625 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:38.591625 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:38.591625 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:38.591625 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:38.591625 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:38.591625 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:38.591625 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:38.591625 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:38.591625 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:38.591625 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:58:38.591625 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:58:38.591625 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:58:38.592615 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:58:38.592615 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:38.592615 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:38.592615 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:38.592615 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:38.592615 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:38.592615 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:38.592615 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:38.592615 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:38.592615 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:38.592615 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:38.592615 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:38.592615 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:38.592615 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:38.592615 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:38.592615 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:38.592615 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:38.593552 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:58:38.593552 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:58:38.593552 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:58:38.593552 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:58:38.593552 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:58:38.593552 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:58:38.593552 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:38.593552 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:38.593552 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 354/698] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:38.594440 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad7b5a-46f3-4ded-acd9-b7bda8f35911 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:38.678097 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd8457-1b6e-41ee-b176-89dcb21a8b5d None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:38.710099 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad7b5a-46f3-4ded-acd9-b7bda8f35911 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:38.715517 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b15140-5151-48f5-9332-7aa1ebff35fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:38.716598 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b15140-5151-48f5-9332-7aa1ebff35fa None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:38.717118 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b15140-5151-48f5-9332-7aa1ebff35fa None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:38.717597 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b15140-5151-48f5-9332-7aa1ebff35fa None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:38.718461 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b15140-5151-48f5-9332-7aa1ebff35fa None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:38.720136 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b15140-5151-48f5-9332-7aa1ebff35fa None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:38.735498 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-32b15140-5151-48f5-9332-7aa1ebff35fa None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 05:58:38.735498 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:38.735498 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:58:38.735498 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:58:38.735498 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:58:38.735498 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:58:38.735498 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:58:38.735498 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:58:38.735498 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 05:58:38.735498 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:38.735498 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:58:38.735498 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:38.735498 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:38.735498 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:38.735498 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:38.735498 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:38.737192 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:38.737192 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:38.737192 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:38.737192 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:38.737192 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:38.737192 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:38.737192 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:38.737192 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:58:38.737192 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:58:38.737192 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:58:38.737192 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:58:38.737192 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:38.737192 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:38.737192 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:38.737192 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:38.737192 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:38.738237 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:38.738237 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:38.738237 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:38.738237 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:38.738237 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:38.738237 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:38.738237 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:38.738237 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:38.738237 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:38.738237 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:38.738237 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:38.738237 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:58:38.738237 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:58:38.738237 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 05:58:38.738237 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:38.746075 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 345/699] 10.222.0.39 () {56 vars in 1129 bytes} [Mon Jun 20 05:58:38 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:38.747352 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b15140-5151-48f5-9332-7aa1ebff35fa None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:38.753263 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee8fd3-d4a0-4319-b42b-4f189fcdd956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:38.753263 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee8fd3-d4a0-4319-b42b-4f189fcdd956 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:38.753509 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee8fd3-d4a0-4319-b42b-4f189fcdd956 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:38.753739 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee8fd3-d4a0-4319-b42b-4f189fcdd956 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:38.756557 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:38.785902 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:38.839388 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee8fd3-d4a0-4319-b42b-4f189fcdd956 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:38.841697 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee8fd3-d4a0-4319-b42b-4f189fcdd956 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:38.865443 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b15140-5151-48f5-9332-7aa1ebff35fa None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:38.902245 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e5f8e-2ee0-4853-969b-7a14c04f9efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:38.903295 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e5f8e-2ee0-4853-969b-7a14c04f9efa None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:38.903811 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e5f8e-2ee0-4853-969b-7a14c04f9efa None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:38.904301 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e5f8e-2ee0-4853-969b-7a14c04f9efa None admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:38.905399 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721e5f8e-2ee0-4853-969b-7a14c04f9efa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:38.905916 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721e5f8e-2ee0-4853-969b-7a14c04f9efa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:38.907567 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721e5f8e-2ee0-4853-969b-7a14c04f9efa None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:38.920232 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 346/700] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jun 20 05:58:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:38.921390 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e5f8e-2ee0-4853-969b-7a14c04f9efa None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:38.982250 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 355/701] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 05:58:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:58:38.983145 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee8fd3-d4a0-4319-b42b-4f189fcdd956 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:39.021490 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:39.041734 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:39.051203 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e5f8e-2ee0-4853-969b-7a14c04f9efa None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:39.090653 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee8fd3-d4a0-4319-b42b-4f189fcdd956 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:39.096123 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac4580-9bae-44c1-8082-24c6ffd3b0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:39.096834 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac4580-9bae-44c1-8082-24c6ffd3b0d7 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:39.097121 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac4580-9bae-44c1-8082-24c6ffd3b0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:39.097401 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac4580-9bae-44c1-8082-24c6ffd3b0d7 None admin] PATH_INFO: `/v3/services` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:39.098114 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcac4580-9bae-44c1-8082-24c6ffd3b0d7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:39.098809 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcac4580-9bae-44c1-8082-24c6ffd3b0d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:39.100235 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcac4580-9bae-44c1-8082-24c6ffd3b0d7 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:39.110896 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 347/702] 10.222.0.39 () {56 vars in 1124 bytes} [Mon Jun 20 05:58:38 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:39.110896 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac4580-9bae-44c1-8082-24c6ffd3b0d7 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:39.124872 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09100e0e-6f80-4638-ac76-3a58b94a6458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:39.125534 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09100e0e-6f80-4638-ac76-3a58b94a6458 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:39.125811 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09100e0e-6f80-4638-ac76-3a58b94a6458 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:39.126083 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09100e0e-6f80-4638-ac76-3a58b94a6458 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:39.127481 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09100e0e-6f80-4638-ac76-3a58b94a6458 None admin] RBAC: Adding query filter params (role.id=b7e86f43512c42bfa0d069e3e6fb97c5, scope.project.id=b349043204b34d1794818184ffe6505c, user.id=b2b490cf71bc468da5ea2be04239e33f) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:39.127792 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09100e0e-6f80-4638-ac76-3a58b94a6458 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:39.129238 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09100e0e-6f80-4638-ac76-3a58b94a6458 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:39.135361 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 356/703] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jun 20 05:58:38 2022] GET /identity/v3/role_assignments?user.id=b2b490cf71bc468da5ea2be04239e33f&scope.project.id=b349043204b34d1794818184ffe6505c&role.id=b7e86f43512c42bfa0d069e3e6fb97c5 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:39.136604 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce814b0-548d-4824-b757-1eef67b6778f None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:39.136933 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce814b0-548d-4824-b757-1eef67b6778f None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:39.137211 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce814b0-548d-4824-b757-1eef67b6778f None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:39.138636 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 357/704] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:58:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:39.139160 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce814b0-548d-4824-b757-1eef67b6778f None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:39.280258 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac4580-9bae-44c1-8082-24c6ffd3b0d7 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:39.280762 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:39.289568 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce814b0-548d-4824-b757-1eef67b6778f None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:39.320106 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ed2e7-4c73-4282-bbae-1d169955f5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:39.323059 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ed2e7-4c73-4282-bbae-1d169955f5e6 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:39.323501 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ed2e7-4c73-4282-bbae-1d169955f5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:39.323774 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ed2e7-4c73-4282-bbae-1d169955f5e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:39.336731 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a04507-e18f-401d-8a1f-68e4e7c22b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:39.337445 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a04507-e18f-401d-8a1f-68e4e7c22b8c None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:39.337725 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a04507-e18f-401d-8a1f-68e4e7c22b8c None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:39.337997 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a04507-e18f-401d-8a1f-68e4e7c22b8c None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:39.338127 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ed2e7-4c73-4282-bbae-1d169955f5e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:39.339401 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a04507-e18f-401d-8a1f-68e4e7c22b8c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:39.339520 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ed2e7-4c73-4282-bbae-1d169955f5e6 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:39.339713 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a04507-e18f-401d-8a1f-68e4e7c22b8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:39.341266 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a04507-e18f-401d-8a1f-68e4e7c22b8c None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:39.348322 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 358/705] 10.222.0.39 () {56 vars in 1124 bytes} [Mon Jun 20 05:58:39 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:39.349722 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e75f3-f66b-4589-a38d-64c516492bc3 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:39.350011 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e75f3-f66b-4589-a38d-64c516492bc3 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:39.350285 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e75f3-f66b-4589-a38d-64c516492bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:39.359133 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-5b8ed2e7-4c73-4282-bbae-1d169955f5e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:39.359133 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:39.359133 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:39.359133 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:39.359133 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:39.359133 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:39.359133 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:39.359133 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:39.359133 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:39.359133 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:39.359133 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:39.359133 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:39.359133 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:39.359133 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:39.359133 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:39.360106 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:39.360106 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:39.360106 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:39.360106 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:39.360106 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:39.360106 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:39.360106 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:39.360106 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:39.360106 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:39.360106 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:39.360106 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:39.360106 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:39.360106 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:39.360106 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:39.360106 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:39.360106 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:39.360106 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:39.361103 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:39.361103 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:39.361103 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:39.361103 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:39.361103 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 348/706] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:39.366468 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ed2e7-4c73-4282-bbae-1d169955f5e6 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:39.369284 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-7f7e75f3-f66b-4589-a38d-64c516492bc3 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:39.370565 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-7f7e75f3-f66b-4589-a38d-64c516492bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:39.387901 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:39.462514 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 359/707] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:58:39.485370 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e75f3-f66b-4589-a38d-64c516492bc3 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:39.514528 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ed2e7-4c73-4282-bbae-1d169955f5e6 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:39.554944 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7876da2b-827a-4c31-a976-240aa9e86a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:39.555542 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876da2b-827a-4c31-a976-240aa9e86a4d None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:39.555820 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876da2b-827a-4c31-a976-240aa9e86a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:39.556095 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876da2b-827a-4c31-a976-240aa9e86a4d None admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:39.556861 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7876da2b-827a-4c31-a976-240aa9e86a4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:39.557165 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7876da2b-827a-4c31-a976-240aa9e86a4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:39.558804 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7876da2b-827a-4c31-a976-240aa9e86a4d None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:39.574240 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 349/708] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:39.581340 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7876da2b-827a-4c31-a976-240aa9e86a4d None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:39.590522 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:39.604369 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e75f3-f66b-4589-a38d-64c516492bc3 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:39.659851 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9496d2-4ac4-4535-aef4-c073e2ff9fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:39.661280 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9496d2-4ac4-4535-aef4-c073e2ff9fca None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:39.662004 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9496d2-4ac4-4535-aef4-c073e2ff9fca None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:39.662865 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9496d2-4ac4-4535-aef4-c073e2ff9fca None admin] PATH_INFO: `/v3/services/network` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:39.664029 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9496d2-4ac4-4535-aef4-c073e2ff9fca None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:39.665611 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9496d2-4ac4-4535-aef4-c073e2ff9fca None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:39.671001 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:39.690049 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-0a9496d2-4ac4-4535-aef4-c073e2ff9fca None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 05:58:39.690049 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:39.690049 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:58:39.690049 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:58:39.690049 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:58:39.690049 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:58:39.690049 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:58:39.690049 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:58:39.690049 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 05:58:39.690049 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:39.690049 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:58:39.690049 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:39.690049 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:39.690049 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:39.690049 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:39.690049 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:39.690049 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:39.691180 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:39.691180 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:39.691180 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:39.691180 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:39.691180 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:39.691180 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:39.691180 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:58:39.691180 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:58:39.691180 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:58:39.691180 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:58:39.691180 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:39.691180 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:39.691180 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:39.691180 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:39.691180 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:39.691180 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:39.692059 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:39.692059 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:39.692059 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:39.692059 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:39.692059 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:39.692059 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:39.692059 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:39.692059 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:39.692059 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:39.692059 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:39.692059 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:58:39.692059 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:58:39.692059 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 05:58:39.692059 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:39.695317 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 360/709] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:39 2022] GET /identity/v3/services/network => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:58:39.701422 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9496d2-4ac4-4535-aef4-c073e2ff9fca None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:39.715732 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7876da2b-827a-4c31-a976-240aa9e86a4d None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:39.752382 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa9159-92ac-464c-8e61-8b9f292b61a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:39.753236 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa9159-92ac-464c-8e61-8b9f292b61a0 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:39.753516 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa9159-92ac-464c-8e61-8b9f292b61a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:39.753783 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa9159-92ac-464c-8e61-8b9f292b61a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:39.761864 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafa9159-92ac-464c-8e61-8b9f292b61a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:39.764834 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafa9159-92ac-464c-8e61-8b9f292b61a0 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:39.785921 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-cafa9159-92ac-464c-8e61-8b9f292b61a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:39.785921 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:39.785921 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:39.785921 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:39.785921 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:39.785921 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:39.785921 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:39.785921 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:39.785921 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:39.785921 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:39.785921 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:39.785921 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:39.785921 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:58:39.785921 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:58:39.785921 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:58:39.787030 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:58:39.787030 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:39.787030 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:39.787030 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:39.787030 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:39.787030 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:39.787030 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:39.787030 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:39.787030 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:39.787030 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:39.787030 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:39.787030 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:39.787030 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:39.787030 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:39.787030 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:39.787030 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:39.787030 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:39.788171 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:58:39.788171 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:58:39.788171 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:58:39.788171 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:58:39.788171 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:58:39.788171 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:58:39.788171 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:39.788171 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:39.790200 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 350/710] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:58:39.795025 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56740cf4-fb23-4af6-a378-ee664e148adb None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:39.795025 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56740cf4-fb23-4af6-a378-ee664e148adb None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:39.795025 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56740cf4-fb23-4af6-a378-ee664e148adb None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:39.795025 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 351/711] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:58:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:39.797604 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56740cf4-fb23-4af6-a378-ee664e148adb None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:39.842514 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9496d2-4ac4-4535-aef4-c073e2ff9fca None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:39.889065 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326397a3-341b-478a-b5cb-d85cc4c52105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:39.889847 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326397a3-341b-478a-b5cb-d85cc4c52105 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:39.890051 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326397a3-341b-478a-b5cb-d85cc4c52105 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:39.890302 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326397a3-341b-478a-b5cb-d85cc4c52105 None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:39.891031 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326397a3-341b-478a-b5cb-d85cc4c52105 None admin] RBAC: Adding query filter params (name=network) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:39.891366 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326397a3-341b-478a-b5cb-d85cc4c52105 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:39.898370 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326397a3-341b-478a-b5cb-d85cc4c52105 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:39.903922 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 361/712] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Jun 20 05:58:39 2022] GET /identity/v3/services?name=network => generated 124 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:58:39.905148 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f38bfe-482a-4248-b064-1f26b2125212 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:39.905433 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f38bfe-482a-4248-b064-1f26b2125212 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:39.905711 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f38bfe-482a-4248-b064-1f26b2125212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:39.924245 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-b8f38bfe-482a-4248-b064-1f26b2125212 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:39.925484 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-b8f38bfe-482a-4248-b064-1f26b2125212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:39.942240 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:39.942806 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56740cf4-fb23-4af6-a378-ee664e148adb None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:39.985083 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:39.993023 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2fba64-0caa-4abe-beda-45e61898f8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:39.994472 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2fba64-0caa-4abe-beda-45e61898f8f9 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:39.995056 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2fba64-0caa-4abe-beda-45e61898f8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:39.995507 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2fba64-0caa-4abe-beda-45e61898f8f9 None admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:39.997165 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2fba64-0caa-4abe-beda-45e61898f8f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:39.997664 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2fba64-0caa-4abe-beda-45e61898f8f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:39.999776 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2fba64-0caa-4abe-beda-45e61898f8f9 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:40.011605 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 362/713] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:58:40.012616 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f38bfe-482a-4248-b064-1f26b2125212 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:40.019226 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 352/714] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jun 20 05:58:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:40.021331 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2fba64-0caa-4abe-beda-45e61898f8f9 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:40.134654 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f38bfe-482a-4248-b064-1f26b2125212 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:40.162604 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2fba64-0caa-4abe-beda-45e61898f8f9 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:40.172261 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e6277-2fe9-424b-ac1d-fa7dfb191690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:40.173042 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e6277-2fe9-424b-ac1d-fa7dfb191690 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:40.174542 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e6277-2fe9-424b-ac1d-fa7dfb191690 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:40.174728 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e6277-2fe9-424b-ac1d-fa7dfb191690 None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:40.175669 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86e6277-2fe9-424b-ac1d-fa7dfb191690 None admin] RBAC: Adding query filter params (type=network) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:40.176045 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86e6277-2fe9-424b-ac1d-fa7dfb191690 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:40.177564 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86e6277-2fe9-424b-ac1d-fa7dfb191690 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:40.182608 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 363/715] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Jun 20 05:58:40 2022] GET /identity/v3/services?type=network => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:40.183735 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e6277-2fe9-424b-ac1d-fa7dfb191690 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:40.203448 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:40.215673 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c19982-81f8-4cf5-b122-e328f13b56ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:40.216351 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c19982-81f8-4cf5-b122-e328f13b56ad None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:40.216634 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c19982-81f8-4cf5-b122-e328f13b56ad None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:40.216935 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c19982-81f8-4cf5-b122-e328f13b56ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:40.217782 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c19982-81f8-4cf5-b122-e328f13b56ad None admin] RBAC: Adding query filter params (role.id=5a64bd8372704de98e75436ff69e46b3, scope.project.id=b349043204b34d1794818184ffe6505c, user.id=3cee106502e54829ad802ee41c9165fa) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:40.218097 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c19982-81f8-4cf5-b122-e328f13b56ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:40.219543 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c19982-81f8-4cf5-b122-e328f13b56ad None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:40.232746 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 353/716] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jun 20 05:58:40 2022] GET /identity/v3/role_assignments?user.id=3cee106502e54829ad802ee41c9165fa&scope.project.id=b349043204b34d1794818184ffe6505c&role.id=5a64bd8372704de98e75436ff69e46b3 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:40.324785 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e6277-2fe9-424b-ac1d-fa7dfb191690 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:40.372430 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ea0c3-8543-4d4f-9889-619e15db9c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:40.373282 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ea0c3-8543-4d4f-9889-619e15db9c87 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:40.373568 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ea0c3-8543-4d4f-9889-619e15db9c87 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:40.373846 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ea0c3-8543-4d4f-9889-619e15db9c87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:40.386996 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8ea0c3-8543-4d4f-9889-619e15db9c87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:40.388385 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8ea0c3-8543-4d4f-9889-619e15db9c87 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:40.412977 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-9c8ea0c3-8543-4d4f-9889-619e15db9c87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:40.412977 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:40.412977 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:40.412977 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:40.412977 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:40.412977 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:40.412977 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:40.412977 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:40.412977 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:40.412977 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:40.412977 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:40.412977 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:40.412977 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:40.412977 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:40.412977 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:40.413943 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:40.413943 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:40.413943 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:40.413943 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:40.413943 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:40.413943 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:40.413943 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:40.413943 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:40.413943 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:40.413943 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:40.413943 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:40.413943 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:40.413943 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:40.413943 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:40.413943 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:40.413943 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:40.413943 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:40.414842 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:40.414842 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:40.414842 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:40.414842 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:40.414842 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 364/717] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:40.420055 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c19982-81f8-4cf5-b122-e328f13b56ad None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:40.524518 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:40.577167 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c19982-81f8-4cf5-b122-e328f13b56ad None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:40.618994 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17589c27-d41a-4b1f-88b9-cf06672c3d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:40.619668 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17589c27-d41a-4b1f-88b9-cf06672c3d57 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:40.619950 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17589c27-d41a-4b1f-88b9-cf06672c3d57 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:40.620277 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17589c27-d41a-4b1f-88b9-cf06672c3d57 None admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:40.621072 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17589c27-d41a-4b1f-88b9-cf06672c3d57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:40.621381 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17589c27-d41a-4b1f-88b9-cf06672c3d57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:40.622773 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17589c27-d41a-4b1f-88b9-cf06672c3d57 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:40.636902 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 354/718] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:40.642645 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ea0c3-8543-4d4f-9889-619e15db9c87 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:40.752323 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:40.800250 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ea0c3-8543-4d4f-9889-619e15db9c87 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:40.848321 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6ebe0-06c8-42fd-aceb-2fa7b1dbb34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:40.849357 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6ebe0-06c8-42fd-aceb-2fa7b1dbb34d None admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:40.849827 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6ebe0-06c8-42fd-aceb-2fa7b1dbb34d None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:40.850335 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6ebe0-06c8-42fd-aceb-2fa7b1dbb34d None admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:40.851264 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be6ebe0-06c8-42fd-aceb-2fa7b1dbb34d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:40.852908 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be6ebe0-06c8-42fd-aceb-2fa7b1dbb34d None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:40.887820 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 365/719] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Jun 20 05:58:40 2022] POST /identity/v3/users => generated 254 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:58:41.856729 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a299a-1534-4f1e-9722-5bad02c5379a None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:41.857228 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a299a-1534-4f1e-9722-5bad02c5379a None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:41.857228 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a299a-1534-4f1e-9722-5bad02c5379a None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:41.858803 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 355/720] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:58:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:41.863894 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f519e-80d6-4b55-ae7f-55d22f0b5186 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:41.864305 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f519e-80d6-4b55-ae7f-55d22f0b5186 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:41.864475 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f519e-80d6-4b55-ae7f-55d22f0b5186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:41.885393 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-d86f519e-80d6-4b55-ae7f-55d22f0b5186 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:41.886577 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-d86f519e-80d6-4b55-ae7f-55d22f0b5186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:41.963645 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48be3d-e0f0-4264-94a6-cd06c67eae6e None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:41.964274 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48be3d-e0f0-4264-94a6-cd06c67eae6e None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:41.964787 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48be3d-e0f0-4264-94a6-cd06c67eae6e None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:41.967681 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 356/721] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:58:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:41.972271 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc47a9-121b-494b-b646-aab868bc59c3 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:41.972563 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc47a9-121b-494b-b646-aab868bc59c3 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:41.972878 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc47a9-121b-494b-b646-aab868bc59c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:41.975267 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 366/722] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:58:41.997767 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-e6fc47a9-121b-494b-b646-aab868bc59c3 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:41.998950 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-e6fc47a9-121b-494b-b646-aab868bc59c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:42.012769 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f519e-80d6-4b55-ae7f-55d22f0b5186 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:42.105064 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:42.117546 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 357/723] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:58:42.156837 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc47a9-121b-494b-b646-aab868bc59c3 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:42.193244 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f519e-80d6-4b55-ae7f-55d22f0b5186 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:42.240453 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:42.246872 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30983f0-380e-490f-9364-1110bc78b434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:42.247547 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30983f0-380e-490f-9364-1110bc78b434 None admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:42.247830 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30983f0-380e-490f-9364-1110bc78b434 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:42.248102 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30983f0-380e-490f-9364-1110bc78b434 None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:42.248905 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30983f0-380e-490f-9364-1110bc78b434 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:42.250282 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30983f0-380e-490f-9364-1110bc78b434 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:42.283772 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 367/724] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Jun 20 05:58:42 2022] POST /identity/v3/services => generated 251 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 05:58:42.321479 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc47a9-121b-494b-b646-aab868bc59c3 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:42.368593 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a1f55e-fb3a-402c-a616-684e17a81b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:42.369342 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1f55e-fb3a-402c-a616-684e17a81b8a None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:42.369627 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1f55e-fb3a-402c-a616-684e17a81b8a None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:42.369958 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1f55e-fb3a-402c-a616-684e17a81b8a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:42.382697 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a1f55e-fb3a-402c-a616-684e17a81b8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:42.390550 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-b6a1f55e-fb3a-402c-a616-684e17a81b8a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:58:42.390550 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:42.390550 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:42.390550 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:42.390550 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:42.390550 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:42.390550 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:42.390550 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:42.390550 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:42.390550 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:42.390550 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:42.390550 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:42.390550 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:42.390550 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:42.390550 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:42.390550 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:42.391499 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:42.391499 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:42.391499 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:42.391499 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:42.391499 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:42.391499 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:42.391499 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:42.391499 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:42.391499 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:42.391499 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:42.391499 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:42.391499 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:42.391499 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:42.391499 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:42.391499 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:42.391499 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:42.393392 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:42.393392 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:42.393392 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:42.393392 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:42.393392 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:42.393392 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:42.393392 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:42.393392 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:42.393392 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:42.393392 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:42.393392 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:58:42.393392 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:42.396219 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 358/725] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jun 20 05:58:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:58:42.399447 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30983f0-380e-490f-9364-1110bc78b434 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:42.561781 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30983f0-380e-490f-9364-1110bc78b434 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:42.580255 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:42.582198 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09986f9e-5688-48ff-82ac-3eed28a7dc24 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:42.582832 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09986f9e-5688-48ff-82ac-3eed28a7dc24 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:42.583309 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09986f9e-5688-48ff-82ac-3eed28a7dc24 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:42.586439 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 359/726] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:58:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:58:42.591009 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599c707-2b53-4b91-8729-4adb74236c1b None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:42.591297 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599c707-2b53-4b91-8729-4adb74236c1b None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:42.591577 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599c707-2b53-4b91-8729-4adb74236c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:42.603067 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a069ea6-2da2-4841-b25b-e91e12081f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:42.604050 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a069ea6-2da2-4841-b25b-e91e12081f4a None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:42.604502 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a069ea6-2da2-4841-b25b-e91e12081f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:42.605439 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a069ea6-2da2-4841-b25b-e91e12081f4a None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:42.606653 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a069ea6-2da2-4841-b25b-e91e12081f4a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:42.607165 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a069ea6-2da2-4841-b25b-e91e12081f4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:42.608896 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a069ea6-2da2-4841-b25b-e91e12081f4a None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:42.613875 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-4599c707-2b53-4b91-8729-4adb74236c1b None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:42.615126 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-4599c707-2b53-4b91-8729-4adb74236c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:42.621700 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 368/727] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 05:58:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:42.629769 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a069ea6-2da2-4841-b25b-e91e12081f4a None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:42.719551 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 360/728] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:42 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:58:42.755185 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599c707-2b53-4b91-8729-4adb74236c1b None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:42.769381 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a069ea6-2da2-4841-b25b-e91e12081f4a None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:42.809046 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:42.838931 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2354ab12-5d3b-45d9-955b-e6bf5c887227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:42.839732 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354ab12-5d3b-45d9-955b-e6bf5c887227 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:42.840010 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354ab12-5d3b-45d9-955b-e6bf5c887227 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:42.840281 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354ab12-5d3b-45d9-955b-e6bf5c887227 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:42.861693 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2354ab12-5d3b-45d9-955b-e6bf5c887227 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:42.863148 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2354ab12-5d3b-45d9-955b-e6bf5c887227 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:42.898876 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-2354ab12-5d3b-45d9-955b-e6bf5c887227 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:42.898876 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:42.898876 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:42.898876 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:42.898876 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:42.898876 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:42.898876 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:42.898876 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:42.898876 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:42.898876 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:42.898876 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:42.898876 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:42.898876 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:42.898876 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:42.898876 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:42.900247 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:42.900247 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:42.900247 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:42.900247 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:42.900247 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:42.900247 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:42.900247 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:42.900247 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:42.900247 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:42.900247 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:42.900247 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:42.900247 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:42.900247 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:42.900247 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:42.900247 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:42.900247 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:42.900247 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:42.901144 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:42.901144 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:42.901144 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:42.901144 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:42.901144 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 369/729] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:42.911367 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2354ab12-5d3b-45d9-955b-e6bf5c887227 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:42.942495 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599c707-2b53-4b91-8729-4adb74236c1b None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:42.973813 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:43.004907 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98b4e6-3b85-43ad-ad8f-58e948eeb7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:43.005717 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98b4e6-3b85-43ad-ad8f-58e948eeb7e3 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:43.006004 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98b4e6-3b85-43ad-ad8f-58e948eeb7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:43.006281 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98b4e6-3b85-43ad-ad8f-58e948eeb7e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:43.018268 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d98b4e6-3b85-43ad-ad8f-58e948eeb7e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:43.026430 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-8d98b4e6-3b85-43ad-ad8f-58e948eeb7e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:58:43.026430 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:43.026430 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:43.026430 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:43.026430 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:43.026430 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:43.026430 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:43.026430 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:43.026430 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:43.026430 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:43.026430 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:43.026430 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:43.026430 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:43.026430 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:43.026430 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:43.026430 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:43.027373 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:43.027373 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:43.027373 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:43.027373 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:43.027373 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:43.027373 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:43.027373 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:43.027373 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:43.027373 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:43.027373 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:43.027373 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:43.027373 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:43.027373 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:43.027373 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:43.027373 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:43.027373 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:43.028212 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:43.028212 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:43.028212 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:43.028212 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:43.028212 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:43.028212 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:43.028212 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:43.028212 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:43.028212 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:43.028212 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:43.028212 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:58:43.028212 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:43.028212 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 361/730] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jun 20 05:58:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:43.029431 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4eb9b-a3f5-4d34-ad5c-a62402ecb13e None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:43.029593 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4eb9b-a3f5-4d34-ad5c-a62402ecb13e None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:43.031767 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4eb9b-a3f5-4d34-ad5c-a62402ecb13e None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:43.031767 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 362/731] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:58:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:43.036873 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d35598-4f1a-4465-a20c-85d2f69c16e8 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:43.037162 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d35598-4f1a-4465-a20c-85d2f69c16e8 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:43.037446 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d35598-4f1a-4465-a20c-85d2f69c16e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:43.058230 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-d4d35598-4f1a-4465-a20c-85d2f69c16e8 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:43.060351 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-d4d35598-4f1a-4465-a20c-85d2f69c16e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:43.063017 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2354ab12-5d3b-45d9-955b-e6bf5c887227 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:43.099403 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a766b-1ba3-4d1e-9d95-19b446afb7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:43.100075 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a766b-1ba3-4d1e-9d95-19b446afb7c9 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:43.100355 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a766b-1ba3-4d1e-9d95-19b446afb7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:43.100628 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a766b-1ba3-4d1e-9d95-19b446afb7c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:43.101381 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201a766b-1ba3-4d1e-9d95-19b446afb7c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:43.101684 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201a766b-1ba3-4d1e-9d95-19b446afb7c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:43.103055 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201a766b-1ba3-4d1e-9d95-19b446afb7c9 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:43.115935 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 370/732] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:43.116886 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a766b-1ba3-4d1e-9d95-19b446afb7c9 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:43.138133 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 363/733] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:43 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:58:43.138997 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d35598-4f1a-4465-a20c-85d2f69c16e8 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:43.185421 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:43.206046 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:43.222827 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a766b-1ba3-4d1e-9d95-19b446afb7c9 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:43.257570 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c299662-aaec-44fc-9601-ac19484571a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:43.258337 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c299662-aaec-44fc-9601-ac19484571a4 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:43.258684 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c299662-aaec-44fc-9601-ac19484571a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:43.259025 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c299662-aaec-44fc-9601-ac19484571a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:43.259843 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c299662-aaec-44fc-9601-ac19484571a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:43.260231 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c299662-aaec-44fc-9601-ac19484571a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:43.261702 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c299662-aaec-44fc-9601-ac19484571a4 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:43.275150 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d35598-4f1a-4465-a20c-85d2f69c16e8 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:43.275478 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 371/734] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 05:58:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:43.276375 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c299662-aaec-44fc-9601-ac19484571a4 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:43.316352 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fdd48f-dbff-4bbc-a7cc-742ab9dc45f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:43.317214 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdd48f-dbff-4bbc-a7cc-742ab9dc45f8 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:43.317500 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdd48f-dbff-4bbc-a7cc-742ab9dc45f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:43.317779 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdd48f-dbff-4bbc-a7cc-742ab9dc45f8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:43.327275 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fdd48f-dbff-4bbc-a7cc-742ab9dc45f8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:43.328773 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fdd48f-dbff-4bbc-a7cc-742ab9dc45f8 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:43.345497 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-61fdd48f-dbff-4bbc-a7cc-742ab9dc45f8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 20 05:58:43.345497 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:43.345497 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:43.345497 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:43.345497 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:43.345497 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:43.345497 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:43.345497 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:43.345497 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:43.345497 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:43.345497 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:43.345497 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:43.345497 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:58:43.345497 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:58:43.345497 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:58:43.345497 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:58:43.347607 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:43.347607 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:43.347607 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:58:43.347607 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:43.347607 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:58:43.347607 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:43.347607 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:43.347607 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:43.347607 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:43.347607 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:43.347607 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:43.347607 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:43.347607 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:43.347607 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:43.347607 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:43.347607 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:43.347607 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:43.347607 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:43.349869 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:43.349869 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:43.349869 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:58:43.349869 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:58:43.349869 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:58:43.349869 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:58:43.349869 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:58:43.349869 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:58:43.349869 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 20 05:58:43.349869 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:43.349869 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 364/735] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jun 20 05:58:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:43.349869 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fdd48f-dbff-4bbc-a7cc-742ab9dc45f8 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:43.387068 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c299662-aaec-44fc-9601-ac19484571a4 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:43.421100 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc3d13-e919-431f-9179-c592756155b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:43.421764 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc3d13-e919-431f-9179-c592756155b5 None admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:43.422044 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc3d13-e919-431f-9179-c592756155b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:43.422320 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc3d13-e919-431f-9179-c592756155b5 None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:43.423800 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc3d13-e919-431f-9179-c592756155b5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:43.425679 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc3d13-e919-431f-9179-c592756155b5 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:43.438331 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:43.442853 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 372/736] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Jun 20 05:58:43 2022] POST /identity/v3/services => generated 240 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:58:43.448294 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc3d13-e919-431f-9179-c592756155b5 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:43.469087 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:43.479500 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fdd48f-dbff-4bbc-a7cc-742ab9dc45f8 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:43.562732 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84273c66-e7e2-4cd5-91a8-3a27af3ae1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:43.564533 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84273c66-e7e2-4cd5-91a8-3a27af3ae1a9 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:43.564853 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84273c66-e7e2-4cd5-91a8-3a27af3ae1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:43.565132 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84273c66-e7e2-4cd5-91a8-3a27af3ae1a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:43.577732 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc3d13-e919-431f-9179-c592756155b5 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:43.586263 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84273c66-e7e2-4cd5-91a8-3a27af3ae1a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:43.587747 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84273c66-e7e2-4cd5-91a8-3a27af3ae1a9 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:43.622079 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-84273c66-e7e2-4cd5-91a8-3a27af3ae1a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:43.622079 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:43.622079 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:43.622079 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:43.622079 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:43.622079 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:43.622079 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:43.622079 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:43.622079 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:43.622079 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:43.622079 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:43.622079 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:43.622079 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:43.622079 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:43.622079 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:43.623295 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:43.623295 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:43.623295 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:43.623295 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:43.623295 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:43.623295 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:43.623295 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:43.623295 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:43.623295 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:43.623295 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:43.623295 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:43.623295 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:43.623295 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:43.623295 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:43.623295 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:43.623295 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:43.623295 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:43.624339 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:43.624339 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:43.624339 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:43.624339 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:43.630186 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 365/737] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:43.634405 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec63922-fb06-4888-b93f-e1a31ee7e2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:43.635362 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec63922-fb06-4888-b93f-e1a31ee7e2d6 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:43.635696 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84273c66-e7e2-4cd5-91a8-3a27af3ae1a9 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:43.636051 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec63922-fb06-4888-b93f-e1a31ee7e2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:43.636468 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec63922-fb06-4888-b93f-e1a31ee7e2d6 None admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:43.637564 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec63922-fb06-4888-b93f-e1a31ee7e2d6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:43.638069 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec63922-fb06-4888-b93f-e1a31ee7e2d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:43.639817 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec63922-fb06-4888-b93f-e1a31ee7e2d6 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:43.664850 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 373/738] 10.222.0.39 () {56 vars in 1135 bytes} [Mon Jun 20 05:58:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:43.666710 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb53c6b-bd9d-40c6-a551-3e6191990ae5 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:43.667273 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb53c6b-bd9d-40c6-a551-3e6191990ae5 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:43.667746 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb53c6b-bd9d-40c6-a551-3e6191990ae5 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:43.669808 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 374/739] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:58:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:43.670808 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb53c6b-bd9d-40c6-a551-3e6191990ae5 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:43.757542 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:43.765884 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84273c66-e7e2-4cd5-91a8-3a27af3ae1a9 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:43.799763 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:43.802851 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb53c6b-bd9d-40c6-a551-3e6191990ae5 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:43.808366 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ecf3b-7aaa-476a-8833-7f39d183006a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:43.809145 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ecf3b-7aaa-476a-8833-7f39d183006a None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:43.809494 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ecf3b-7aaa-476a-8833-7f39d183006a None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:43.809833 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ecf3b-7aaa-476a-8833-7f39d183006a None admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:43.810627 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ecf3b-7aaa-476a-8833-7f39d183006a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:43.810999 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ecf3b-7aaa-476a-8833-7f39d183006a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:43.812437 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ecf3b-7aaa-476a-8833-7f39d183006a None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:43.831011 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 366/740] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:43.831011 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f78bdf-74a3-460a-ae04-78e3642aeb1a None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:43.831011 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f78bdf-74a3-460a-ae04-78e3642aeb1a None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:43.831011 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f78bdf-74a3-460a-ae04-78e3642aeb1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:43.847981 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b57381-449a-4477-98df-7a7cbbccef49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:43.848676 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b57381-449a-4477-98df-7a7cbbccef49 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:43.848999 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b57381-449a-4477-98df-7a7cbbccef49 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:43.849270 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b57381-449a-4477-98df-7a7cbbccef49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:43.850148 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-f7f78bdf-74a3-460a-ae04-78e3642aeb1a None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:43.851572 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-f7f78bdf-74a3-460a-ae04-78e3642aeb1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:43.930676 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 367/741] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:58:43.931981 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f78bdf-74a3-460a-ae04-78e3642aeb1a None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:43.951219 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b57381-449a-4477-98df-7a7cbbccef49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:43.955560 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b57381-449a-4477-98df-7a7cbbccef49 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:44.030540 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:44.072849 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f78bdf-74a3-460a-ae04-78e3642aeb1a None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:44.078267 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 375/742] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 05:58:43 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 05:58:44.080485 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b57381-449a-4477-98df-7a7cbbccef49 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:44.092731 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:44.111989 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c5077-4444-43ab-81e2-99e791e0a976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:44.112871 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c5077-4444-43ab-81e2-99e791e0a976 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:44.113151 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c5077-4444-43ab-81e2-99e791e0a976 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:44.113423 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c5077-4444-43ab-81e2-99e791e0a976 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:44.121132 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71c5077-4444-43ab-81e2-99e791e0a976 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:44.122539 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71c5077-4444-43ab-81e2-99e791e0a976 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:44.138469 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-c71c5077-4444-43ab-81e2-99e791e0a976 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 05:58:44.138469 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:44.138469 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:44.138469 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:44.138469 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:44.138469 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:44.138469 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:44.138469 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:44.138469 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:44.138469 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:44.138469 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:44.138469 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:44.138469 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:58:44.138469 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:58:44.138469 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:58:44.138469 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:58:44.139467 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:44.139467 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:44.139467 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:58:44.139467 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:44.139467 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:58:44.139467 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:44.139467 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:44.139467 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:44.139467 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:44.139467 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:44.139467 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:44.139467 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:44.139467 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:44.139467 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:44.139467 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:44.139467 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:44.139467 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:44.139467 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:44.140419 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:44.140419 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:44.140419 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:58:44.140419 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:58:44.140419 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:58:44.140419 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:58:44.140419 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:58:44.140419 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:58:44.140419 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 05:58:44.140419 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:44.144985 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 368/743] 10.222.0.39 () {56 vars in 1093 bytes} [Mon Jun 20 05:58:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:44.145848 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c5077-4444-43ab-81e2-99e791e0a976 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:44.221082 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b57381-449a-4477-98df-7a7cbbccef49 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:44.253428 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c5077-4444-43ab-81e2-99e791e0a976 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:44.269526 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b91978-7a80-4630-a1be-db2458ab2410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:44.270912 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b91978-7a80-4630-a1be-db2458ab2410 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:44.271380 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b91978-7a80-4630-a1be-db2458ab2410 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:44.271993 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b91978-7a80-4630-a1be-db2458ab2410 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:44.289852 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b91978-7a80-4630-a1be-db2458ab2410 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:44.292158 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c0eb1-774d-47b2-8dbb-2af507907772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:44.293125 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c0eb1-774d-47b2-8dbb-2af507907772 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:44.293503 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c0eb1-774d-47b2-8dbb-2af507907772 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:44.293870 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c0eb1-774d-47b2-8dbb-2af507907772 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:44.300437 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-e7b91978-7a80-4630-a1be-db2458ab2410 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:44.300437 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:44.300437 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:44.300437 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:44.300437 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:44.300437 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:44.300437 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:44.300437 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:44.300437 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:44.300437 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:44.300437 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:44.300437 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:44.300437 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:44.300437 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:44.300437 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:44.300437 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:44.301601 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:44.301601 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:44.301601 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:44.301601 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:44.301601 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:44.301601 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:44.301601 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:44.301601 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:44.301601 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:44.301601 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:44.301601 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:44.301601 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:44.301601 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:44.301601 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:44.301601 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:44.301601 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:44.302647 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:44.302647 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:44.302647 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:44.302647 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:44.302647 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:44.302647 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:44.302647 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:44.302647 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:44.302647 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:44.302647 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:44.302647 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:44.302647 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:44.305560 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 376/744] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jun 20 05:58:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:44.306573 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b91978-7a80-4630-a1be-db2458ab2410 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:44.312874 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262c0eb1-774d-47b2-8dbb-2af507907772 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:44.314710 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262c0eb1-774d-47b2-8dbb-2af507907772 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:44.334765 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-262c0eb1-774d-47b2-8dbb-2af507907772 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:44.334765 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:44.334765 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:44.334765 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:44.334765 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:44.334765 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:44.334765 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:44.334765 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:44.334765 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:44.334765 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:44.334765 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:44.334765 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:44.334765 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:44.334765 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:44.334765 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:44.336756 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:44.336756 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:44.336756 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:44.336756 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:44.336756 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:44.336756 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:44.336756 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:44.336756 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:44.336756 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:44.336756 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:44.336756 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:44.336756 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:44.336756 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:44.336756 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:44.336756 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:44.336756 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:44.336756 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:44.337885 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:44.337885 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:44.337885 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:44.337885 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:44.339017 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 369/745] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:44.339975 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c0eb1-774d-47b2-8dbb-2af507907772 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:44.348924 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:44.375809 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:44.434497 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b91978-7a80-4630-a1be-db2458ab2410 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:44.457519 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c0eb1-774d-47b2-8dbb-2af507907772 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:44.482409 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf68a97-afa4-49f1-ac28-90085d0a2d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:44.483432 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf68a97-afa4-49f1-ac28-90085d0a2d98 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:44.483921 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf68a97-afa4-49f1-ac28-90085d0a2d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:44.484404 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf68a97-afa4-49f1-ac28-90085d0a2d98 None admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:44.485986 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf68a97-afa4-49f1-ac28-90085d0a2d98 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:44.486541 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf68a97-afa4-49f1-ac28-90085d0a2d98 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:44.488242 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf68a97-afa4-49f1-ac28-90085d0a2d98 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:44.496050 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b26ea7d-059d-40e8-8bbe-8169609ed0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:44.496758 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26ea7d-059d-40e8-8bbe-8169609ed0a2 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:44.497047 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26ea7d-059d-40e8-8bbe-8169609ed0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:44.497323 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26ea7d-059d-40e8-8bbe-8169609ed0a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:44.498072 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b26ea7d-059d-40e8-8bbe-8169609ed0a2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:44.498377 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b26ea7d-059d-40e8-8bbe-8169609ed0a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:44.500498 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b26ea7d-059d-40e8-8bbe-8169609ed0a2 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:44.509112 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 377/746] 10.222.0.39 () {56 vars in 1133 bytes} [Mon Jun 20 05:58:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:44.510382 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf68a97-afa4-49f1-ac28-90085d0a2d98 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:44.514679 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 370/747] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jun 20 05:58:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:44.514902 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b26ea7d-059d-40e8-8bbe-8169609ed0a2 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:44.608859 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:44.633326 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf68a97-afa4-49f1-ac28-90085d0a2d98 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:44.639026 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:44.650617 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b26ea7d-059d-40e8-8bbe-8169609ed0a2 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:44.680259 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f0cf8a-1821-4d66-a6b7-847460a6f587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:44.681228 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0cf8a-1821-4d66-a6b7-847460a6f587 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:44.681513 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0cf8a-1821-4d66-a6b7-847460a6f587 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:44.681794 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0cf8a-1821-4d66-a6b7-847460a6f587 None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:44.682527 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f0cf8a-1821-4d66-a6b7-847460a6f587 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:44.682839 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f0cf8a-1821-4d66-a6b7-847460a6f587 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:44.684213 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f0cf8a-1821-4d66-a6b7-847460a6f587 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:44.687778 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0972143-ad0e-46dd-8e0e-f5cf837e74e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:44.689181 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0972143-ad0e-46dd-8e0e-f5cf837e74e6 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:44.689465 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0972143-ad0e-46dd-8e0e-f5cf837e74e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:44.689738 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0972143-ad0e-46dd-8e0e-f5cf837e74e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:44.697092 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 378/748] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:44.697914 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f0cf8a-1821-4d66-a6b7-847460a6f587 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:44.705325 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0972143-ad0e-46dd-8e0e-f5cf837e74e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:44.706762 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0972143-ad0e-46dd-8e0e-f5cf837e74e6 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:44.724246 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-d0972143-ad0e-46dd-8e0e-f5cf837e74e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:44.724246 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:44.724246 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:44.724246 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:44.724246 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:44.724246 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:44.724246 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:44.724246 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:44.724246 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:44.724246 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:44.724246 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:44.724246 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:44.724246 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:44.724246 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:44.724246 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:44.725228 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:44.725228 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:44.725228 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:44.725228 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:44.725228 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:44.725228 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:44.725228 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:44.725228 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:44.725228 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:44.725228 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:44.725228 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:44.725228 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:44.725228 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:44.725228 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:44.725228 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:44.725228 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:44.725228 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:44.726116 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:44.726116 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:44.726116 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:44.726116 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:44.726116 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 371/749] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:44.727120 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0829535-e39a-4c58-bf7a-60a66c088d26 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:44.727402 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0829535-e39a-4c58-bf7a-60a66c088d26 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:44.727675 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0829535-e39a-4c58-bf7a-60a66c088d26 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:44.729145 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 372/750] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:58:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:44.729760 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0829535-e39a-4c58-bf7a-60a66c088d26 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:44.815329 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f0cf8a-1821-4d66-a6b7-847460a6f587 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:44.841357 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0829535-e39a-4c58-bf7a-60a66c088d26 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:44.850290 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c92a47d-b341-47e4-8358-f387c992b062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:44.851123 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92a47d-b341-47e4-8358-f387c992b062 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:44.851412 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92a47d-b341-47e4-8358-f387c992b062 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:44.851686 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92a47d-b341-47e4-8358-f387c992b062 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:44.863537 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c92a47d-b341-47e4-8358-f387c992b062 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:44.864960 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c92a47d-b341-47e4-8358-f387c992b062 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:44.867772 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:44.877788 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb78ef-252a-4126-a9b5-a5b681140250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:44.878680 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb78ef-252a-4126-a9b5-a5b681140250 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:44.879023 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb78ef-252a-4126-a9b5-a5b681140250 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:44.879357 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb78ef-252a-4126-a9b5-a5b681140250 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:44.883798 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-0c92a47d-b341-47e4-8358-f387c992b062 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:44.883798 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:44.883798 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:44.883798 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:44.883798 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:44.883798 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:44.883798 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:44.883798 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:44.883798 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:44.883798 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:44.883798 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:44.883798 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:44.883798 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:44.883798 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:44.883798 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:44.884965 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:44.884965 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:44.884965 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:44.884965 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:44.884965 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:44.884965 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:44.884965 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:44.884965 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:44.884965 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:44.884965 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:44.884965 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:44.884965 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:44.884965 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:44.884965 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:44.884965 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:44.884965 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:44.884965 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:44.885871 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:44.885871 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:44.885871 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:44.885871 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:44.885871 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 379/751] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:44.886227 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c92a47d-b341-47e4-8358-f387c992b062 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:44.891569 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adb78ef-252a-4126-a9b5-a5b681140250 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:44.893057 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adb78ef-252a-4126-a9b5-a5b681140250 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:44.908189 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-7adb78ef-252a-4126-a9b5-a5b681140250 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:44.908189 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:44.908189 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:44.908189 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:44.908189 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:44.908189 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:44.908189 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:44.908189 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:44.908189 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:44.908189 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:44.908189 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:44.908189 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:44.908189 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:58:44.908189 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:58:44.908189 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:58:44.909091 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:58:44.909091 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:44.909091 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:44.909091 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:44.909091 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:44.909091 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:44.909091 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:44.909091 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:44.909091 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:44.909091 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:44.909091 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:44.909091 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:44.909091 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:44.909091 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:44.909091 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:44.909091 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:44.909091 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:44.909985 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:58:44.909985 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:58:44.909985 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:58:44.909985 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:58:44.909985 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:58:44.909985 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:58:44.909985 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:44.909985 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:44.914220 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 373/752] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:44.915393 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b7535-9803-4863-8e1b-1dcea04376d0 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:44.915680 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b7535-9803-4863-8e1b-1dcea04376d0 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:44.916105 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b7535-9803-4863-8e1b-1dcea04376d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:44.926031 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:44.937834 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-329b7535-9803-4863-8e1b-1dcea04376d0 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:44.939787 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-329b7535-9803-4863-8e1b-1dcea04376d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:44.998489 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c92a47d-b341-47e4-8358-f387c992b062 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:45.013366 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 374/753] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:58:45.014379 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329b7535-9803-4863-8e1b-1dcea04376d0 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:45.039081 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d5e649-9be7-48c0-87d9-113b8165daab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:45.039748 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5e649-9be7-48c0-87d9-113b8165daab None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:45.040036 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5e649-9be7-48c0-87d9-113b8165daab None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:45.040311 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5e649-9be7-48c0-87d9-113b8165daab None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:45.041170 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d5e649-9be7-48c0-87d9-113b8165daab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:45.041475 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d5e649-9be7-48c0-87d9-113b8165daab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:45.042826 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d5e649-9be7-48c0-87d9-113b8165daab None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:45.056485 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 380/754] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:45.056485 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d5e649-9be7-48c0-87d9-113b8165daab None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:45.114998 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:45.130239 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329b7535-9803-4863-8e1b-1dcea04376d0 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:45.165990 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d5e649-9be7-48c0-87d9-113b8165daab None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:45.171389 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9cbc1-fc5e-43f5-b8e8-534fe4218457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:45.172052 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9cbc1-fc5e-43f5-b8e8-534fe4218457 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:45.172330 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9cbc1-fc5e-43f5-b8e8-534fe4218457 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:45.172597 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9cbc1-fc5e-43f5-b8e8-534fe4218457 None admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:45.174080 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9cbc1-fc5e-43f5-b8e8-534fe4218457 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:45.174203 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9cbc1-fc5e-43f5-b8e8-534fe4218457 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:45.175561 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9cbc1-fc5e-43f5-b8e8-534fe4218457 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:45.177086 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:45.189274 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 375/755] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:45.190306 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9cbc1-fc5e-43f5-b8e8-534fe4218457 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:45.208968 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa09b7-0e89-4ea9-8c98-ad09be27a336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:45.209933 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa09b7-0e89-4ea9-8c98-ad09be27a336 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:45.209933 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa09b7-0e89-4ea9-8c98-ad09be27a336 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:45.210175 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa09b7-0e89-4ea9-8c98-ad09be27a336 None admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:45.210963 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfa09b7-0e89-4ea9-8c98-ad09be27a336 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:45.211271 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfa09b7-0e89-4ea9-8c98-ad09be27a336 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:45.212688 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfa09b7-0e89-4ea9-8c98-ad09be27a336 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:45.231105 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 381/756] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jun 20 05:58:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:45.231105 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa09b7-0e89-4ea9-8c98-ad09be27a336 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:45.309545 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9cbc1-fc5e-43f5-b8e8-534fe4218457 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:45.347717 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa09b7-0e89-4ea9-8c98-ad09be27a336 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:45.349232 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbac628-84a7-470d-ba02-4bf32fcd851f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:45.350049 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbac628-84a7-470d-ba02-4bf32fcd851f None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:45.350332 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbac628-84a7-470d-ba02-4bf32fcd851f None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:45.350606 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbac628-84a7-470d-ba02-4bf32fcd851f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:45.351257 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbac628-84a7-470d-ba02-4bf32fcd851f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:45.352627 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbac628-84a7-470d-ba02-4bf32fcd851f None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:45.364820 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:45.365624 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-9dbac628-84a7-470d-ba02-4bf32fcd851f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 05:58:45.365624 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:45.365624 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:58:45.365624 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:58:45.365624 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:58:45.365624 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:58:45.365624 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:58:45.365624 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:58:45.365624 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 05:58:45.365624 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:45.365624 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:58:45.365624 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:45.365624 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:45.365624 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:45.365624 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:45.365624 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:45.366540 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:45.366540 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:45.366540 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:45.366540 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:45.366540 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:45.366540 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:45.366540 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:45.366540 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:58:45.366540 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:58:45.366540 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:58:45.366540 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:58:45.366540 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:45.366540 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:45.366540 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:45.366540 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:45.366540 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:45.367375 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:45.367375 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:45.367375 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:45.367375 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:45.367375 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:45.367375 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:45.367375 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:45.367375 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:45.367375 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:45.367375 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:45.367375 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:45.367375 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:58:45.367375 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:58:45.367375 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 05:58:45.367375 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:45.367375 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 376/757] 10.222.0.39 () {56 vars in 1129 bytes} [Mon Jun 20 05:58:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:45.368940 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbac628-84a7-470d-ba02-4bf32fcd851f None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:45.390652 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8a4f9-087e-4ce0-a8cb-e791803a8804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:45.391984 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8a4f9-087e-4ce0-a8cb-e791803a8804 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:45.392332 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8a4f9-087e-4ce0-a8cb-e791803a8804 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:45.392605 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8a4f9-087e-4ce0-a8cb-e791803a8804 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:45.399388 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d8a4f9-087e-4ce0-a8cb-e791803a8804 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:45.400859 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d8a4f9-087e-4ce0-a8cb-e791803a8804 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:45.415452 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-c6d8a4f9-087e-4ce0-a8cb-e791803a8804 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:45.415452 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:45.415452 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:45.415452 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:45.415452 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:45.415452 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:45.415452 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:45.415452 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:45.415452 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:45.415452 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:45.415452 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:45.415452 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:45.415452 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:58:45.415452 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:58:45.415452 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:58:45.416541 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:58:45.416541 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:45.416541 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:45.416541 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:45.416541 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:45.416541 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:45.416541 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:45.416541 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:45.416541 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:45.416541 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:45.416541 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:45.416541 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:45.416541 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:45.416541 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:45.416541 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:45.416541 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:45.416541 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:45.417538 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:58:45.417538 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:58:45.417538 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:58:45.417538 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:58:45.417538 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:58:45.417538 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:58:45.417538 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:45.417538 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:45.417538 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 382/758] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:45.418023 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8a4f9-087e-4ce0-a8cb-e791803a8804 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:45.437760 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:45.489851 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbac628-84a7-470d-ba02-4bf32fcd851f None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:45.529492 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8a4f9-087e-4ce0-a8cb-e791803a8804 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:45.531254 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1251969-7415-44e8-8d06-e210410a27b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:45.533265 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1251969-7415-44e8-8d06-e210410a27b1 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:45.533265 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1251969-7415-44e8-8d06-e210410a27b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:45.533265 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1251969-7415-44e8-8d06-e210410a27b1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:45.541494 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1251969-7415-44e8-8d06-e210410a27b1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:45.543284 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1251969-7415-44e8-8d06-e210410a27b1 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:45.559193 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-c1251969-7415-44e8-8d06-e210410a27b1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 05:58:45.559193 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:45.559193 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:45.559193 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:45.559193 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:45.559193 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:45.559193 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:45.559193 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:45.559193 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:45.559193 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:45.559193 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:45.559193 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:45.559193 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:58:45.559193 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:58:45.559193 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:58:45.559193 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:58:45.560152 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:45.560152 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:45.560152 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:58:45.560152 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:45.560152 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:58:45.560152 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:45.560152 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:45.560152 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:45.560152 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:45.560152 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:45.560152 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:45.560152 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:45.560152 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:45.560152 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:45.560152 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:45.560152 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:45.560152 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:45.560152 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:45.561500 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:45.561500 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:45.561500 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:58:45.561500 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:58:45.561500 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:58:45.561500 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:58:45.561500 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:58:45.561500 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:58:45.561500 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 05:58:45.561500 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:45.561500 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 377/759] 10.222.0.39 () {56 vars in 1117 bytes} [Mon Jun 20 05:58:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:45.561500 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1251969-7415-44e8-8d06-e210410a27b1 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:45.573636 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24054ff-3383-414a-ac99-b5e524fd3887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:45.574296 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24054ff-3383-414a-ac99-b5e524fd3887 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:45.574719 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24054ff-3383-414a-ac99-b5e524fd3887 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:45.575255 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24054ff-3383-414a-ac99-b5e524fd3887 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:45.576224 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24054ff-3383-414a-ac99-b5e524fd3887 None admin] RBAC: Adding query filter params (role.id=5a64bd8372704de98e75436ff69e46b3, scope.project.id=b349043204b34d1794818184ffe6505c, user.id=b2b490cf71bc468da5ea2be04239e33f) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:45.576541 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24054ff-3383-414a-ac99-b5e524fd3887 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:45.577998 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24054ff-3383-414a-ac99-b5e524fd3887 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:45.584994 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 383/760] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jun 20 05:58:45 2022] GET /identity/v3/role_assignments?user.id=b2b490cf71bc468da5ea2be04239e33f&scope.project.id=b349043204b34d1794818184ffe6505c&role.id=5a64bd8372704de98e75436ff69e46b3 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:45.585717 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24054ff-3383-414a-ac99-b5e524fd3887 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:45.640217 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:45.713305 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24054ff-3383-414a-ac99-b5e524fd3887 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:45.722773 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1251969-7415-44e8-8d06-e210410a27b1 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:45.740832 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:45.755829 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5830a505-1473-4f69-8221-7733491f4755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:45.756503 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5830a505-1473-4f69-8221-7733491f4755 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:45.756883 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5830a505-1473-4f69-8221-7733491f4755 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:45.757156 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5830a505-1473-4f69-8221-7733491f4755 None admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:45.757952 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5830a505-1473-4f69-8221-7733491f4755 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:45.758261 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5830a505-1473-4f69-8221-7733491f4755 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:45.759694 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5830a505-1473-4f69-8221-7733491f4755 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:45.760893 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6df952-c1c4-4533-b693-8d3860d77d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:45.761680 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6df952-c1c4-4533-b693-8d3860d77d0c None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:45.762068 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6df952-c1c4-4533-b693-8d3860d77d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:45.762449 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6df952-c1c4-4533-b693-8d3860d77d0c None admin] PATH_INFO: `/v3/services` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:45.763262 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6df952-c1c4-4533-b693-8d3860d77d0c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:45.763672 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6df952-c1c4-4533-b693-8d3860d77d0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:45.765229 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6df952-c1c4-4533-b693-8d3860d77d0c None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:45.771029 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 378/761] 10.222.0.39 () {56 vars in 1124 bytes} [Mon Jun 20 05:58:45 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:45.772027 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6df952-c1c4-4533-b693-8d3860d77d0c None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:45.772881 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 384/762] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jun 20 05:58:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:45.774410 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4ae86-352f-4340-9e43-85a609559406 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:45.774799 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4ae86-352f-4340-9e43-85a609559406 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:45.775182 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4ae86-352f-4340-9e43-85a609559406 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:45.781440 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 385/763] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:58:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:45.781440 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4ae86-352f-4340-9e43-85a609559406 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:45.888127 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6df952-c1c4-4533-b693-8d3860d77d0c None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:45.889275 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:45.895377 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4ae86-352f-4340-9e43-85a609559406 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:45.930191 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e913580-e6cd-47e7-b352-af38cd72e03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:45.931997 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e913580-e6cd-47e7-b352-af38cd72e03a None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:45.932800 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e913580-e6cd-47e7-b352-af38cd72e03a None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:45.933034 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babcc723-bef6-4161-933a-e70c4411fb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:45.933513 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babcc723-bef6-4161-933a-e70c4411fb09 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:45.933797 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babcc723-bef6-4161-933a-e70c4411fb09 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:45.934080 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babcc723-bef6-4161-933a-e70c4411fb09 None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:45.934462 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e913580-e6cd-47e7-b352-af38cd72e03a None admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:45.934785 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babcc723-bef6-4161-933a-e70c4411fb09 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:45.935093 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babcc723-bef6-4161-933a-e70c4411fb09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:45.936462 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babcc723-bef6-4161-933a-e70c4411fb09 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:45.936803 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e913580-e6cd-47e7-b352-af38cd72e03a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:45.937274 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e913580-e6cd-47e7-b352-af38cd72e03a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:45.939760 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e913580-e6cd-47e7-b352-af38cd72e03a None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:45.942922 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 386/764] 10.222.0.39 () {56 vars in 1124 bytes} [Mon Jun 20 05:58:45 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:45.943884 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babcc723-bef6-4161-933a-e70c4411fb09 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:45.965673 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 379/765] 10.222.0.39 () {56 vars in 1149 bytes} [Mon Jun 20 05:58:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:45.967299 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c20daf-d00a-45b6-8a1e-419ecfc13055 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:45.967583 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c20daf-d00a-45b6-8a1e-419ecfc13055 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:45.967861 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c20daf-d00a-45b6-8a1e-419ecfc13055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:45.985938 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-14c20daf-d00a-45b6-8a1e-419ecfc13055 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:45.987149 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-14c20daf-d00a-45b6-8a1e-419ecfc13055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:46.021113 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:46.056767 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 380/766] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:58:46.056767 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c20daf-d00a-45b6-8a1e-419ecfc13055 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:46.068992 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babcc723-bef6-4161-933a-e70c4411fb09 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:46.106938 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060962b7-6895-411a-858d-5fa67ed24d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:46.108213 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060962b7-6895-411a-858d-5fa67ed24d25 None admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:46.108674 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060962b7-6895-411a-858d-5fa67ed24d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:46.109130 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060962b7-6895-411a-858d-5fa67ed24d25 None admin] PATH_INFO: `/v3/projects/b349043204b34d1794818184ffe6505c/users/3cee106502e54829ad802ee41c9165fa/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:46.112194 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060962b7-6895-411a-858d-5fa67ed24d25 None admin] RBAC: Authorizing `identity:create_grant(project_id=b349043204b34d1794818184ffe6505c, user_id=3cee106502e54829ad802ee41c9165fa, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:46.113931 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060962b7-6895-411a-858d-5fa67ed24d25 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:46.128788 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 387/767] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jun 20 05:58:45 2022] PUT /identity/v3/projects/b349043204b34d1794818184ffe6505c/users/3cee106502e54829ad802ee41c9165fa/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:58:46.129872 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060962b7-6895-411a-858d-5fa67ed24d25 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:46.167761 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:46.188192 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c20daf-d00a-45b6-8a1e-419ecfc13055 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:46.240666 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a4d3f-7849-41d5-827f-ecf185f38543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:46.241919 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a4d3f-7849-41d5-827f-ecf185f38543 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:46.242382 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a4d3f-7849-41d5-827f-ecf185f38543 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:46.242809 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a4d3f-7849-41d5-827f-ecf185f38543 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:46.244413 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a4d3f-7849-41d5-827f-ecf185f38543 None admin] RBAC: Adding query filter params (interface=public, service_id=b6431ec6de0940a4a83d9a3811bb4a7a, region_id=RegionOne) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:46.244934 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a4d3f-7849-41d5-827f-ecf185f38543 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:46.246589 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a4d3f-7849-41d5-827f-ecf185f38543 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:46.260534 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 381/768] 10.222.0.39 () {56 vars in 1251 bytes} [Mon Jun 20 05:58:46 2022] GET /identity/v3/endpoints?service_id=b6431ec6de0940a4a83d9a3811bb4a7a&interface=public®ion_id=RegionOne => generated 194 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:46.261741 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a4d3f-7849-41d5-827f-ecf185f38543 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:46.262424 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060962b7-6895-411a-858d-5fa67ed24d25 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:46.302766 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e90790-5ebe-470e-82b1-3979339539ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:46.303464 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e90790-5ebe-470e-82b1-3979339539ca None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:46.303755 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e90790-5ebe-470e-82b1-3979339539ca None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:46.304034 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e90790-5ebe-470e-82b1-3979339539ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:46.311025 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:46.397256 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e90790-5ebe-470e-82b1-3979339539ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:46.399090 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e90790-5ebe-470e-82b1-3979339539ca None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:46.400815 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a4d3f-7849-41d5-827f-ecf185f38543 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:46.424815 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:46.439625 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bada5dfd-08c7-4e14-bcbf-6ed2e3a6172d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:46.440596 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada5dfd-08c7-4e14-bcbf-6ed2e3a6172d None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:46.440996 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada5dfd-08c7-4e14-bcbf-6ed2e3a6172d None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:46.441363 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada5dfd-08c7-4e14-bcbf-6ed2e3a6172d None admin] PATH_INFO: `/v3/services/network` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:46.442113 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bada5dfd-08c7-4e14-bcbf-6ed2e3a6172d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:46.444744 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bada5dfd-08c7-4e14-bcbf-6ed2e3a6172d None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:46.460033 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-bada5dfd-08c7-4e14-bcbf-6ed2e3a6172d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 05:58:46.460033 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:46.460033 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:58:46.460033 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:58:46.460033 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:58:46.460033 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:58:46.460033 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:58:46.460033 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:58:46.460033 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 05:58:46.460033 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:46.460033 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:58:46.460033 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:46.460033 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:46.460033 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:46.460033 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:46.460033 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:46.460033 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:46.461079 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:46.461079 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:46.461079 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:46.461079 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:46.461079 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:46.461079 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:46.461079 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:58:46.461079 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:58:46.461079 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:58:46.461079 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:58:46.461079 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:46.461079 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:46.461079 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:46.461079 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:46.461079 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:46.461079 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:46.462352 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:46.462352 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:46.462352 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:46.462352 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:46.462352 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:46.462352 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:46.462352 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:46.462352 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:46.462352 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:46.462352 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:46.462352 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:58:46.462352 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:58:46.462352 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 05:58:46.462352 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:46.462352 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 382/769] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:46 2022] GET /identity/v3/services/network => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:46.463165 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bada5dfd-08c7-4e14-bcbf-6ed2e3a6172d None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:46.536888 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 388/770] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 05:58:46 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 05:58:46.537809 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e90790-5ebe-470e-82b1-3979339539ca None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:46.592479 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:46.599930 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bada5dfd-08c7-4e14-bcbf-6ed2e3a6172d None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:46.646482 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e90790-5ebe-470e-82b1-3979339539ca None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:46.648570 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9050af0a-f6a9-4fb0-813b-5cd221e9d56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:46.650368 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050af0a-f6a9-4fb0-813b-5cd221e9d56e None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:46.650895 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050af0a-f6a9-4fb0-813b-5cd221e9d56e None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:46.651398 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050af0a-f6a9-4fb0-813b-5cd221e9d56e None admin] PATH_INFO: `/v3/services` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:46.652313 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9050af0a-f6a9-4fb0-813b-5cd221e9d56e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:46.653734 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9050af0a-f6a9-4fb0-813b-5cd221e9d56e None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:46.662032 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 383/771] 10.222.0.39 () {56 vars in 1087 bytes} [Mon Jun 20 05:58:46 2022] GET /identity/v3/services => generated 772 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:46.662758 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9050af0a-f6a9-4fb0-813b-5cd221e9d56e None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:46.691444 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:46.717829 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a9295a-5f3d-4193-9908-21e2ca32fd9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:46.719120 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9295a-5f3d-4193-9908-21e2ca32fd9e None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:46.722092 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9295a-5f3d-4193-9908-21e2ca32fd9e None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:46.722758 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9295a-5f3d-4193-9908-21e2ca32fd9e None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:46.723766 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a9295a-5f3d-4193-9908-21e2ca32fd9e None admin] RBAC: Adding query filter params (name=network) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:46.724602 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a9295a-5f3d-4193-9908-21e2ca32fd9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:46.727139 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a9295a-5f3d-4193-9908-21e2ca32fd9e None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:46.740324 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 389/772] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Jun 20 05:58:46 2022] GET /identity/v3/services?name=network => generated 124 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:46.746518 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a9295a-5f3d-4193-9908-21e2ca32fd9e None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:46.852686 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9050af0a-f6a9-4fb0-813b-5cd221e9d56e None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:46.902274 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c71d077-ab21-451b-8a89-2a9f1a751f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:46.903076 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71d077-ab21-451b-8a89-2a9f1a751f3a None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:46.903388 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71d077-ab21-451b-8a89-2a9f1a751f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:46.903897 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71d077-ab21-451b-8a89-2a9f1a751f3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:46.916817 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a9295a-5f3d-4193-9908-21e2ca32fd9e None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:46.918353 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c71d077-ab21-451b-8a89-2a9f1a751f3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:46.919963 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c71d077-ab21-451b-8a89-2a9f1a751f3a None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:46.943884 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-0c71d077-ab21-451b-8a89-2a9f1a751f3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:46.943884 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:46.943884 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:46.943884 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:46.943884 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:46.943884 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:46.943884 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:46.943884 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:46.943884 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:46.943884 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:46.943884 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:46.943884 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:46.943884 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:46.943884 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:46.943884 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:46.945152 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:46.945152 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:46.945152 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:46.945152 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:46.945152 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:46.945152 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:46.945152 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:46.945152 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:46.945152 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:46.945152 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:46.945152 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:46.945152 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:46.945152 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:46.945152 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:46.945152 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:46.945152 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:46.945152 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:46.946060 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:46.946060 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:46.946060 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:46.946060 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:46.946060 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 384/773] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:46.951233 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c71d077-ab21-451b-8a89-2a9f1a751f3a None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:46.967617 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a23df-af0a-488e-8680-e7ba15af921e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:46.968124 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a23df-af0a-488e-8680-e7ba15af921e None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:46.968408 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a23df-af0a-488e-8680-e7ba15af921e None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:46.968679 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a23df-af0a-488e-8680-e7ba15af921e None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:46.969456 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a23df-af0a-488e-8680-e7ba15af921e None admin] RBAC: Adding query filter params (type=network) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:46.970317 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a23df-af0a-488e-8680-e7ba15af921e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:46.976210 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a23df-af0a-488e-8680-e7ba15af921e None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:46.980667 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:46.987181 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 390/774] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Jun 20 05:58:46 2022] GET /identity/v3/services?type=network => generated 350 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:58:46.993030 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a23df-af0a-488e-8680-e7ba15af921e None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:47.065452 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:47.112889 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a23df-af0a-488e-8680-e7ba15af921e None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:47.148831 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d365a26b-07f7-49be-b8c6-07effe6e0799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:47.149388 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365a26b-07f7-49be-b8c6-07effe6e0799 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:47.149667 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365a26b-07f7-49be-b8c6-07effe6e0799 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:47.149939 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365a26b-07f7-49be-b8c6-07effe6e0799 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:47.150733 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d365a26b-07f7-49be-b8c6-07effe6e0799 None admin] RBAC: Adding query filter params (interface=public, service_id=0d24386dc95f4e879594bbb8785de963, region_id=RegionOne) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:47.151043 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d365a26b-07f7-49be-b8c6-07effe6e0799 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:47.152404 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d365a26b-07f7-49be-b8c6-07effe6e0799 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:47.161410 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 391/775] 10.222.0.39 () {56 vars in 1251 bytes} [Mon Jun 20 05:58:46 2022] GET /identity/v3/endpoints?service_id=0d24386dc95f4e879594bbb8785de963&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:47.167094 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d365a26b-07f7-49be-b8c6-07effe6e0799 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:47.186072 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c71d077-ab21-451b-8a89-2a9f1a751f3a None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:47.286814 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffcfbd6-74c9-4314-9e4c-78bae28dcd49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:47.287487 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffcfbd6-74c9-4314-9e4c-78bae28dcd49 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:47.287757 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffcfbd6-74c9-4314-9e4c-78bae28dcd49 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:47.288029 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffcfbd6-74c9-4314-9e4c-78bae28dcd49 None admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:47.288795 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffcfbd6-74c9-4314-9e4c-78bae28dcd49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:47.289107 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffcfbd6-74c9-4314-9e4c-78bae28dcd49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:47.290180 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d365a26b-07f7-49be-b8c6-07effe6e0799 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:47.290485 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffcfbd6-74c9-4314-9e4c-78bae28dcd49 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:47.308556 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:47.322463 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 385/776] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:47.327813 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffcfbd6-74c9-4314-9e4c-78bae28dcd49 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:47.336272 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d6b503-5441-4d68-b7b6-86f2aa5d871e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:47.342157 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6b503-5441-4d68-b7b6-86f2aa5d871e None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:47.342602 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6b503-5441-4d68-b7b6-86f2aa5d871e None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:47.343028 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6b503-5441-4d68-b7b6-86f2aa5d871e None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:47.343882 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d6b503-5441-4d68-b7b6-86f2aa5d871e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:47.346410 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d6b503-5441-4d68-b7b6-86f2aa5d871e None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:47.357483 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 392/777] 10.222.0.39 () {56 vars in 1087 bytes} [Mon Jun 20 05:58:47 2022] GET /identity/v3/services => generated 772 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:47.430493 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:47.460527 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffcfbd6-74c9-4314-9e4c-78bae28dcd49 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:47.517915 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672168a-c6f8-4ffe-9a2c-633b9a7dbb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:47.519144 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672168a-c6f8-4ffe-9a2c-633b9a7dbb72 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:47.519633 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672168a-c6f8-4ffe-9a2c-633b9a7dbb72 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:47.520120 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672168a-c6f8-4ffe-9a2c-633b9a7dbb72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:47.532293 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8672168a-c6f8-4ffe-9a2c-633b9a7dbb72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:47.534250 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8672168a-c6f8-4ffe-9a2c-633b9a7dbb72 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:47.557210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-8672168a-c6f8-4ffe-9a2c-633b9a7dbb72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:47.557210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:47.557210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:47.557210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:47.557210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:47.557210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:47.557210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:47.557210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:47.557210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:47.557210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:47.557210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:47.557210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:47.557210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:58:47.557210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:58:47.557210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:58:47.558131 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:58:47.558131 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:47.558131 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:47.558131 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:47.558131 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:47.558131 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:47.558131 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:47.558131 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:47.558131 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:47.558131 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:47.558131 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:47.558131 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:47.558131 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:47.558131 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:47.558131 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:47.558131 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:47.558131 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:47.559026 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:58:47.559026 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:58:47.559026 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:58:47.559026 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:58:47.559026 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:58:47.559026 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:58:47.559026 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:47.559026 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:47.561551 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 386/778] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:58:47.568312 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d6b503-5441-4d68-b7b6-86f2aa5d871e None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:47.678364 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d6b503-5441-4d68-b7b6-86f2aa5d871e None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:47.713549 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b6176-2c52-4c8a-9fdb-74c041285dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:47.714221 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b6176-2c52-4c8a-9fdb-74c041285dc8 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:47.714505 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b6176-2c52-4c8a-9fdb-74c041285dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:47.714783 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b6176-2c52-4c8a-9fdb-74c041285dc8 None admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:47.715573 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b6176-2c52-4c8a-9fdb-74c041285dc8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:47.715885 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b6176-2c52-4c8a-9fdb-74c041285dc8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:47.717343 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b6176-2c52-4c8a-9fdb-74c041285dc8 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:47.729984 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 393/779] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jun 20 05:58:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:47.736421 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672168a-c6f8-4ffe-9a2c-633b9a7dbb72 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:47.862205 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672168a-c6f8-4ffe-9a2c-633b9a7dbb72 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:47.909422 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1400f5f8-df3b-45d3-aad6-e02130ae7df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:47.910092 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400f5f8-df3b-45d3-aad6-e02130ae7df3 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:47.910381 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400f5f8-df3b-45d3-aad6-e02130ae7df3 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:47.910662 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400f5f8-df3b-45d3-aad6-e02130ae7df3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:47.911504 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1400f5f8-df3b-45d3-aad6-e02130ae7df3 None admin] RBAC: Adding query filter params (role.id=b7e86f43512c42bfa0d069e3e6fb97c5, scope.project.id=b349043204b34d1794818184ffe6505c, user.id=8c0f131484cb48d289cae1f473ec2fbc) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:47.911820 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1400f5f8-df3b-45d3-aad6-e02130ae7df3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:47.913286 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1400f5f8-df3b-45d3-aad6-e02130ae7df3 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:47.915215 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:47.919883 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 387/780] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jun 20 05:58:47 2022] GET /identity/v3/role_assignments?user.id=8c0f131484cb48d289cae1f473ec2fbc&scope.project.id=b349043204b34d1794818184ffe6505c&role.id=b7e86f43512c42bfa0d069e3e6fb97c5 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:47.994663 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c2614-1581-4053-a2ff-298ef2ab110b None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:47.994996 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c2614-1581-4053-a2ff-298ef2ab110b None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:47.995233 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c2614-1581-4053-a2ff-298ef2ab110b None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:47.996833 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 394/781] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:58:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:48.003427 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c07959-059c-4a30-bbd1-dea760a279e0 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:48.004033 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c07959-059c-4a30-bbd1-dea760a279e0 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:48.004513 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c07959-059c-4a30-bbd1-dea760a279e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:48.022808 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-c1c07959-059c-4a30-bbd1-dea760a279e0 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:48.024503 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-c1c07959-059c-4a30-bbd1-dea760a279e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:48.124008 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 388/782] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:58:48.162730 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c2614-1581-4053-a2ff-298ef2ab110b None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:48.222706 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:48.298920 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c2614-1581-4053-a2ff-298ef2ab110b None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:48.343255 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c48d515-a827-4f84-b3d9-0bbf697ba28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:48.344053 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48d515-a827-4f84-b3d9-0bbf697ba28c None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:48.345322 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48d515-a827-4f84-b3d9-0bbf697ba28c None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:48.345888 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48d515-a827-4f84-b3d9-0bbf697ba28c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:48.365807 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c48d515-a827-4f84-b3d9-0bbf697ba28c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:48.373795 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-1c48d515-a827-4f84-b3d9-0bbf697ba28c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:58:48.373795 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:48.373795 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:48.373795 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:48.373795 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:48.373795 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:48.373795 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:48.373795 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:48.373795 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:48.373795 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:48.373795 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:48.373795 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:48.373795 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:48.373795 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:48.373795 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:48.373795 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:48.374781 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:48.374781 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:48.374781 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:48.374781 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:48.374781 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:48.374781 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:48.374781 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:48.374781 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:48.374781 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:48.374781 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:48.374781 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:48.374781 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:48.374781 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:48.374781 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:48.374781 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:48.374781 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:48.375805 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:48.375805 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:48.375805 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:48.375805 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:48.375805 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:48.375805 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:48.375805 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:48.375805 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:48.375805 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:48.375805 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:48.375805 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:58:48.375805 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:48.375805 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 395/783] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jun 20 05:58:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:48.381658 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c07959-059c-4a30-bbd1-dea760a279e0 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:48.555966 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c07959-059c-4a30-bbd1-dea760a279e0 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:48.593163 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:48.609058 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b86c96-eb9a-4209-9eb7-497c60331296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:48.609759 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b86c96-eb9a-4209-9eb7-497c60331296 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:48.610482 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b86c96-eb9a-4209-9eb7-497c60331296 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:48.611087 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b86c96-eb9a-4209-9eb7-497c60331296 None admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:48.612265 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b86c96-eb9a-4209-9eb7-497c60331296 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:48.612591 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b86c96-eb9a-4209-9eb7-497c60331296 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:48.614037 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b86c96-eb9a-4209-9eb7-497c60331296 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:48.623133 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 389/784] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 05:58:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:48.633887 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c48d515-a827-4f84-b3d9-0bbf697ba28c None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:48.634710 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa625ff-13e1-4226-8250-fbf24fe03c57 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:48.635194 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa625ff-13e1-4226-8250-fbf24fe03c57 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:48.635664 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa625ff-13e1-4226-8250-fbf24fe03c57 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:48.637470 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 390/785] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:58:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:48.643048 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219c600-d89f-48ef-b9c5-ef8262faaeb4 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:48.643582 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219c600-d89f-48ef-b9c5-ef8262faaeb4 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:48.644068 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219c600-d89f-48ef-b9c5-ef8262faaeb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:48.661662 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-e219c600-d89f-48ef-b9c5-ef8262faaeb4 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:48.663158 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-e219c600-d89f-48ef-b9c5-ef8262faaeb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:48.767318 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 391/786] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 05:58:48.797061 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:48.803484 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c48d515-a827-4f84-b3d9-0bbf697ba28c None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:48.809601 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e219c600-d89f-48ef-b9c5-ef8262faaeb4 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:48.885117 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e4e15-0564-49d1-be72-68ce552b6fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:48.886266 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e4e15-0564-49d1-be72-68ce552b6fdb None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:48.886555 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e4e15-0564-49d1-be72-68ce552b6fdb None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:48.887122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e4e15-0564-49d1-be72-68ce552b6fdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:48.911866 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e4e15-0564-49d1-be72-68ce552b6fdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:48.913366 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e4e15-0564-49d1-be72-68ce552b6fdb None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:48.952774 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-ad8e4e15-0564-49d1-be72-68ce552b6fdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:48.952774 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:48.952774 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:48.952774 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:48.952774 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:48.952774 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:48.952774 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:48.952774 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:48.952774 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:48.952774 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:48.952774 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:48.952774 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:48.952774 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:48.952774 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:48.952774 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:48.954338 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:48.954338 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:48.954338 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:48.954338 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:48.954338 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:48.954338 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:48.954338 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:48.954338 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:48.954338 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:48.954338 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:48.954338 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:48.954338 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:48.954338 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:48.954338 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:48.954338 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:48.954338 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:48.954338 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:48.955222 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:48.955222 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:48.955222 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:48.955222 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:48.955222 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 396/787] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:48.961647 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e4e15-0564-49d1-be72-68ce552b6fdb None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:48.977370 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e219c600-d89f-48ef-b9c5-ef8262faaeb4 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:49.014703 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:49.046378 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce339b-fa7b-42fd-82ab-f4fe8789813d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:49.048054 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce339b-fa7b-42fd-82ab-f4fe8789813d None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:49.048626 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce339b-fa7b-42fd-82ab-f4fe8789813d None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:49.049116 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce339b-fa7b-42fd-82ab-f4fe8789813d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:49.069799 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce339b-fa7b-42fd-82ab-f4fe8789813d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:49.077946 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-27ce339b-fa7b-42fd-82ab-f4fe8789813d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:58:49.077946 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:49.077946 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:49.077946 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:49.077946 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:49.077946 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:49.077946 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:49.077946 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:49.077946 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:49.077946 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:49.077946 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:49.077946 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:49.077946 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:49.077946 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:49.077946 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:49.077946 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:49.078877 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:49.078877 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:49.078877 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:49.078877 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:49.078877 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:49.078877 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:49.078877 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:49.078877 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:49.078877 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:49.078877 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:49.078877 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:49.078877 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:49.078877 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:49.078877 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:49.078877 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:49.078877 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:49.079845 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:49.079845 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:49.079845 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:49.079845 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:49.079845 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:49.079845 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:49.079845 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:49.079845 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:49.079845 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:49.079845 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:49.079845 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:58:49.079845 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:49.089150 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 392/788] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jun 20 05:58:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:58:49.097668 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce339b-fa7b-42fd-82ab-f4fe8789813d None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:49.128724 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e4e15-0564-49d1-be72-68ce552b6fdb None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:49.161965 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc0ae7-bc2a-47ca-9d33-3ff30d55f5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:49.162557 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc0ae7-bc2a-47ca-9d33-3ff30d55f5cb None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:49.162842 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc0ae7-bc2a-47ca-9d33-3ff30d55f5cb None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:49.163371 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc0ae7-bc2a-47ca-9d33-3ff30d55f5cb None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:49.163821 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fc0ae7-bc2a-47ca-9d33-3ff30d55f5cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:49.164128 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fc0ae7-bc2a-47ca-9d33-3ff30d55f5cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:49.165522 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fc0ae7-bc2a-47ca-9d33-3ff30d55f5cb None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:49.178568 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 397/789] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:49.179841 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7fdf80-e83a-4b0d-91b2-433218b93539 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:49.180127 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7fdf80-e83a-4b0d-91b2-433218b93539 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:49.180406 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7fdf80-e83a-4b0d-91b2-433218b93539 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:49.181901 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 398/790] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:58:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:49.185048 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7fdf80-e83a-4b0d-91b2-433218b93539 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:49.205378 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:49.233929 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce339b-fa7b-42fd-82ab-f4fe8789813d None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:49.278450 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8c2d8f-e021-46f3-9ec0-8bc2a1881916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:49.279220 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c2d8f-e021-46f3-9ec0-8bc2a1881916 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:49.279577 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c2d8f-e021-46f3-9ec0-8bc2a1881916 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:49.279971 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c2d8f-e021-46f3-9ec0-8bc2a1881916 None admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:49.281311 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8c2d8f-e021-46f3-9ec0-8bc2a1881916 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:49.282401 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8c2d8f-e021-46f3-9ec0-8bc2a1881916 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:49.285234 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8c2d8f-e021-46f3-9ec0-8bc2a1881916 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:49.301514 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 393/791] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 05:58:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:49.303453 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9df92a-a516-4c7b-909f-baaeb83e6062 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:49.303814 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9df92a-a516-4c7b-909f-baaeb83e6062 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:49.304165 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9df92a-a516-4c7b-909f-baaeb83e6062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:49.307161 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7fdf80-e83a-4b0d-91b2-433218b93539 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:49.323011 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-8b9df92a-a516-4c7b-909f-baaeb83e6062 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:49.324302 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-8b9df92a-a516-4c7b-909f-baaeb83e6062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:49.349099 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d01ab33-38f9-46c4-bad2-55d92344d6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:49.349908 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d01ab33-38f9-46c4-bad2-55d92344d6eb None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:49.350194 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d01ab33-38f9-46c4-bad2-55d92344d6eb None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:49.350474 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d01ab33-38f9-46c4-bad2-55d92344d6eb None admin] PATH_INFO: `/v3/users/swift` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:49.358685 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d01ab33-38f9-46c4-bad2-55d92344d6eb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:49.360949 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d01ab33-38f9-46c4-bad2-55d92344d6eb None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:49.365817 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:49.379843 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-0d01ab33-38f9-46c4-bad2-55d92344d6eb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 20 05:58:49.379843 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:49.379843 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:49.379843 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:49.379843 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:49.379843 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:49.379843 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:49.379843 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:49.379843 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:49.379843 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:49.379843 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:49.379843 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:49.379843 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:58:49.379843 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:58:49.379843 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:58:49.379843 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:58:49.382029 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:49.382029 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:49.382029 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:58:49.382029 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:49.382029 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:58:49.382029 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:49.382029 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:49.382029 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:49.382029 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:49.382029 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:49.382029 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:49.382029 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:49.382029 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:49.382029 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:49.382029 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:49.382029 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:49.382029 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:49.382029 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:49.384202 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:49.384202 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:49.384202 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:58:49.384202 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:58:49.384202 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:58:49.384202 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:58:49.384202 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:58:49.384202 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:58:49.384202 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 20 05:58:49.384202 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:49.392738 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 399/792] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jun 20 05:58:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:49.392738 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d01ab33-38f9-46c4-bad2-55d92344d6eb None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:49.401065 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 394/793] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:58:49.401924 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9df92a-a516-4c7b-909f-baaeb83e6062 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:49.477061 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:49.509249 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d01ab33-38f9-46c4-bad2-55d92344d6eb None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:49.524349 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9df92a-a516-4c7b-909f-baaeb83e6062 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:49.546233 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb99906-ca73-4b4f-8b19-4257c6fafadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:49.547033 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb99906-ca73-4b4f-8b19-4257c6fafadd None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:49.547344 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb99906-ca73-4b4f-8b19-4257c6fafadd None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:49.547678 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb99906-ca73-4b4f-8b19-4257c6fafadd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:49.558466 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb99906-ca73-4b4f-8b19-4257c6fafadd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:49.559943 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb99906-ca73-4b4f-8b19-4257c6fafadd None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:49.565595 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eef93f9-4273-4631-bb3c-70c81ed26358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:49.566282 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef93f9-4273-4631-bb3c-70c81ed26358 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:49.566566 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef93f9-4273-4631-bb3c-70c81ed26358 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:49.566896 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef93f9-4273-4631-bb3c-70c81ed26358 None admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:49.567906 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eef93f9-4273-4631-bb3c-70c81ed26358 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:49.568220 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eef93f9-4273-4631-bb3c-70c81ed26358 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:49.569826 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eef93f9-4273-4631-bb3c-70c81ed26358 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:49.580347 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-7bb99906-ca73-4b4f-8b19-4257c6fafadd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:49.580347 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:49.580347 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:49.580347 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:49.580347 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:49.580347 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:49.580347 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:49.580347 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:49.580347 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:49.580347 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:49.580347 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:49.580347 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:49.580347 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:49.580347 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:49.580347 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:49.582324 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:49.582324 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:49.582324 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:49.582324 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:49.582324 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:49.582324 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:49.582324 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:49.582324 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:49.582324 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:49.582324 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:49.582324 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:49.582324 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:49.582324 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:49.582324 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:49.582324 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:49.582324 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:49.582324 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:49.584374 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:49.584374 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:49.584374 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:49.584374 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:49.584374 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 400/794] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:49.584374 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb99906-ca73-4b4f-8b19-4257c6fafadd None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:49.596423 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 395/795] 10.222.0.39 () {56 vars in 1135 bytes} [Mon Jun 20 05:58:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:49.597316 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eef93f9-4273-4631-bb3c-70c81ed26358 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:49.631265 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:49.694364 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb99906-ca73-4b4f-8b19-4257c6fafadd None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:49.712559 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eef93f9-4273-4631-bb3c-70c81ed26358 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:49.720129 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:49.732989 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea12b26f-df46-42bf-9fdb-066b72eb9037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:49.733984 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12b26f-df46-42bf-9fdb-066b72eb9037 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:49.734278 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12b26f-df46-42bf-9fdb-066b72eb9037 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:49.734556 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12b26f-df46-42bf-9fdb-066b72eb9037 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:49.736048 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea12b26f-df46-42bf-9fdb-066b72eb9037 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:49.737171 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea12b26f-df46-42bf-9fdb-066b72eb9037 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:49.749847 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-ea12b26f-df46-42bf-9fdb-066b72eb9037 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 05:58:49.749847 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:49.749847 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:58:49.749847 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:58:49.749847 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:58:49.749847 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:58:49.749847 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:58:49.749847 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:58:49.749847 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 05:58:49.749847 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:49.749847 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:58:49.749847 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:49.749847 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:49.749847 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:49.749847 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:49.749847 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:49.752118 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:49.752118 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:49.752118 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:49.752118 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:49.752118 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:49.752118 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:49.752118 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:49.752118 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:58:49.752118 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:58:49.752118 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:58:49.752118 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:58:49.752118 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:49.752118 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:49.752118 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:49.752118 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:49.752118 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:49.753086 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:49.753086 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:49.753086 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:49.753086 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:49.753086 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:49.753086 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:49.753086 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:49.753086 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:49.753086 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:49.753086 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:49.753086 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:49.753086 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:58:49.753086 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:58:49.753086 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 05:58:49.753086 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:49.753086 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 401/796] 10.222.0.39 () {56 vars in 1129 bytes} [Mon Jun 20 05:58:49 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:49.753932 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea12b26f-df46-42bf-9fdb-066b72eb9037 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:49.759897 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd47625-c58b-427e-a024-dd0a15956ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:49.760775 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd47625-c58b-427e-a024-dd0a15956ac4 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:49.761204 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd47625-c58b-427e-a024-dd0a15956ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:49.761624 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd47625-c58b-427e-a024-dd0a15956ac4 None admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:49.762600 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd47625-c58b-427e-a024-dd0a15956ac4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:49.763070 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd47625-c58b-427e-a024-dd0a15956ac4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:49.764728 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd47625-c58b-427e-a024-dd0a15956ac4 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:49.783441 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 396/797] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:49.784548 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd47625-c58b-427e-a024-dd0a15956ac4 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:49.859499 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea12b26f-df46-42bf-9fdb-066b72eb9037 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:49.888878 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:49.898119 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f3976-a805-4008-8f23-aacbb4d69294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:49.899203 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f3976-a805-4008-8f23-aacbb4d69294 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:49.899493 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f3976-a805-4008-8f23-aacbb4d69294 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:49.899594 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd47625-c58b-427e-a024-dd0a15956ac4 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:49.899779 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f3976-a805-4008-8f23-aacbb4d69294 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:49.911260 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3f3976-a805-4008-8f23-aacbb4d69294 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:49.912724 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3f3976-a805-4008-8f23-aacbb4d69294 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:49.930883 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-5a3f3976-a805-4008-8f23-aacbb4d69294 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:49.930883 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:49.930883 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:49.930883 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:49.930883 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:49.930883 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:49.930883 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:49.930883 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:49.930883 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:49.930883 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:49.930883 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:49.930883 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:49.930883 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:49.930883 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:49.930883 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:49.931798 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:49.931798 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:49.931798 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:49.931798 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:49.931798 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:49.931798 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:49.931798 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:49.931798 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:49.931798 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:49.931798 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:49.931798 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:49.931798 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:49.931798 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:49.931798 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:49.931798 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:49.931798 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:49.931798 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:49.933110 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:49.933110 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:49.933110 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:49.933110 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:49.933110 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 402/798] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:49.933110 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f3976-a805-4008-8f23-aacbb4d69294 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:49.942238 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc6bbc-cd48-40f5-becd-603cc0f06e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:49.942919 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc6bbc-cd48-40f5-becd-603cc0f06e0d None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:49.943210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc6bbc-cd48-40f5-becd-603cc0f06e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:49.943490 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc6bbc-cd48-40f5-becd-603cc0f06e0d None admin] PATH_INFO: `/v3/services` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:49.944206 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc6bbc-cd48-40f5-becd-603cc0f06e0d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:49.944519 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc6bbc-cd48-40f5-becd-603cc0f06e0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:49.945916 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc6bbc-cd48-40f5-becd-603cc0f06e0d None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:49.951089 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 397/799] 10.222.0.39 () {56 vars in 1124 bytes} [Mon Jun 20 05:58:49 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:49.952312 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44276f9-2bf7-45f9-a848-6cad07ae9e89 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:49.952601 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44276f9-2bf7-45f9-a848-6cad07ae9e89 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:49.952914 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44276f9-2bf7-45f9-a848-6cad07ae9e89 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:49.954358 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 398/800] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:58:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:49.958823 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44276f9-2bf7-45f9-a848-6cad07ae9e89 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:49.984250 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:50.047997 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f3976-a805-4008-8f23-aacbb4d69294 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:50.071316 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44276f9-2bf7-45f9-a848-6cad07ae9e89 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:50.091219 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979eaba-cdf1-4931-92c8-713531e829e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:50.092388 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979eaba-cdf1-4931-92c8-713531e829e9 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:50.092939 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979eaba-cdf1-4931-92c8-713531e829e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:50.093419 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979eaba-cdf1-4931-92c8-713531e829e9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:50.102277 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6979eaba-cdf1-4931-92c8-713531e829e9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:50.104070 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6979eaba-cdf1-4931-92c8-713531e829e9 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:50.111861 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae5116-07a5-4ab3-b788-5b5fccc98c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:50.112527 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae5116-07a5-4ab3-b788-5b5fccc98c3c None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:50.112843 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae5116-07a5-4ab3-b788-5b5fccc98c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:50.113122 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae5116-07a5-4ab3-b788-5b5fccc98c3c None admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:50.113841 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaae5116-07a5-4ab3-b788-5b5fccc98c3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:50.114147 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaae5116-07a5-4ab3-b788-5b5fccc98c3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:50.115510 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaae5116-07a5-4ab3-b788-5b5fccc98c3c None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:50.120637 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-6979eaba-cdf1-4931-92c8-713531e829e9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 05:58:50.120637 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:50.120637 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:50.120637 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:50.120637 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:50.120637 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:50.120637 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:50.120637 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:50.120637 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:50.120637 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:50.120637 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:50.120637 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:50.120637 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:58:50.120637 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:58:50.120637 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:58:50.120637 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:58:50.121561 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:50.121561 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:50.121561 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:58:50.121561 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:50.121561 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:58:50.121561 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:50.121561 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:50.121561 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:50.121561 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:50.121561 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:50.121561 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:50.121561 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:50.121561 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:50.121561 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:50.121561 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:50.121561 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:50.121561 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:50.121561 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:50.122681 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:50.122681 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:50.122681 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:58:50.122681 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:58:50.122681 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:58:50.122681 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:58:50.122681 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:58:50.122681 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:58:50.122681 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 05:58:50.122681 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:50.124512 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 403/801] 10.222.0.39 () {56 vars in 1093 bytes} [Mon Jun 20 05:58:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:50.126211 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979eaba-cdf1-4931-92c8-713531e829e9 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:50.133274 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 399/802] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:50.134640 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ee5ba-fd03-472a-acbc-62fd83698b8d None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:50.134951 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ee5ba-fd03-472a-acbc-62fd83698b8d None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:50.135237 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ee5ba-fd03-472a-acbc-62fd83698b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:50.158202 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-bd1ee5ba-fd03-472a-acbc-62fd83698b8d None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:50.159875 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-bd1ee5ba-fd03-472a-acbc-62fd83698b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:50.178603 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:50.248815 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:50.253768 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979eaba-cdf1-4931-92c8-713531e829e9 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:50.260321 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 400/803] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:58:50.261311 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ee5ba-fd03-472a-acbc-62fd83698b8d None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:50.291945 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1898e67-29f7-44e4-bec2-d793e2c2792e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:50.292615 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1898e67-29f7-44e4-bec2-d793e2c2792e None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:50.292940 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1898e67-29f7-44e4-bec2-d793e2c2792e None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:50.293212 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1898e67-29f7-44e4-bec2-d793e2c2792e None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:50.293969 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1898e67-29f7-44e4-bec2-d793e2c2792e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:50.294275 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1898e67-29f7-44e4-bec2-d793e2c2792e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:50.295659 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1898e67-29f7-44e4-bec2-d793e2c2792e None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:50.301644 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 404/804] 10.222.0.39 () {56 vars in 1124 bytes} [Mon Jun 20 05:58:50 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:50.302500 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1898e67-29f7-44e4-bec2-d793e2c2792e None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:50.426371 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ee5ba-fd03-472a-acbc-62fd83698b8d None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:50.463072 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1898e67-29f7-44e4-bec2-d793e2c2792e None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:50.472030 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d100a42-8aab-46c9-96d9-6606dc003831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:50.472719 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d100a42-8aab-46c9-96d9-6606dc003831 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:50.473011 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d100a42-8aab-46c9-96d9-6606dc003831 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:50.473289 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d100a42-8aab-46c9-96d9-6606dc003831 None admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:50.474142 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d100a42-8aab-46c9-96d9-6606dc003831 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:50.474473 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d100a42-8aab-46c9-96d9-6606dc003831 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:50.475904 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d100a42-8aab-46c9-96d9-6606dc003831 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:50.494894 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 401/805] 10.222.0.39 () {56 vars in 1133 bytes} [Mon Jun 20 05:58:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:50.495714 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d100a42-8aab-46c9-96d9-6606dc003831 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:50.499570 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f85e6-7c3a-4954-ad29-42267d259c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:50.500054 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:50.500410 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f85e6-7c3a-4954-ad29-42267d259c73 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:50.500818 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f85e6-7c3a-4954-ad29-42267d259c73 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:50.501096 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f85e6-7c3a-4954-ad29-42267d259c73 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:50.510540 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9f85e6-7c3a-4954-ad29-42267d259c73 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:50.511990 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9f85e6-7c3a-4954-ad29-42267d259c73 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:50.527122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-4b9f85e6-7c3a-4954-ad29-42267d259c73 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:50.527122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:50.527122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:50.527122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:50.527122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:50.527122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:50.527122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:50.527122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:50.527122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:50.527122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:50.527122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:50.527122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:50.527122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:58:50.527122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:58:50.527122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:58:50.528214 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:58:50.528214 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:50.528214 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:50.528214 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:50.528214 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:50.528214 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:50.528214 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:50.528214 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:50.528214 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:50.528214 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:50.528214 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:50.528214 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:50.528214 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:50.528214 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:50.528214 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:50.528214 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:50.528214 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:50.529189 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:58:50.529189 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:58:50.529189 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:58:50.529189 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:58:50.529189 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:58:50.529189 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:58:50.529189 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:50.529189 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:50.529189 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 405/806] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:50.529676 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f85e6-7c3a-4954-ad29-42267d259c73 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:50.555287 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:50.613064 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d100a42-8aab-46c9-96d9-6606dc003831 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:50.638983 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f85e6-7c3a-4954-ad29-42267d259c73 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:50.654559 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2905f336-816f-44fb-a667-c860e4b550ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:50.655375 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905f336-816f-44fb-a667-c860e4b550ae None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:50.655651 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905f336-816f-44fb-a667-c860e4b550ae None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:50.655916 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905f336-816f-44fb-a667-c860e4b550ae None admin] PATH_INFO: `/v3/services/network` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:50.656569 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2905f336-816f-44fb-a667-c860e4b550ae None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:50.658907 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2905f336-816f-44fb-a667-c860e4b550ae None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:50.670431 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-2905f336-816f-44fb-a667-c860e4b550ae None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 05:58:50.670431 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:50.670431 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:58:50.670431 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:58:50.670431 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:58:50.670431 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:58:50.670431 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:58:50.670431 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:58:50.670431 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 05:58:50.670431 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:50.670431 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:58:50.670431 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:50.670431 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:50.670431 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:50.670431 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:50.670431 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:50.670431 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:50.671478 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:50.671478 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:50.671478 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:50.671478 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:50.671478 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:50.671478 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:50.671478 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:58:50.671478 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:58:50.671478 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:58:50.671478 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:58:50.671478 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:50.671478 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:50.671478 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:50.671478 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:50.671478 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:50.671478 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:50.672342 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:50.672342 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:50.672342 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:50.672342 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:50.672342 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:50.672342 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:50.672342 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:50.672342 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:50.672342 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:50.672342 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:50.672342 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:58:50.672342 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:58:50.672342 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 05:58:50.672342 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:50.672342 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 402/807] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:50 2022] GET /identity/v3/services/network => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:50.673828 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a98cf-b0d1-418f-bb67-1c263587afb9 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:50.673828 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a98cf-b0d1-418f-bb67-1c263587afb9 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:50.673828 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a98cf-b0d1-418f-bb67-1c263587afb9 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:50.675236 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 403/808] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:58:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:50.675989 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a98cf-b0d1-418f-bb67-1c263587afb9 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:50.682544 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e702c-ab1f-49cf-962d-1932f0202de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:50.683215 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e702c-ab1f-49cf-962d-1932f0202de1 None admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:50.683494 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e702c-ab1f-49cf-962d-1932f0202de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:50.683763 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e702c-ab1f-49cf-962d-1932f0202de1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:50.684503 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680e702c-ab1f-49cf-962d-1932f0202de1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:50.685900 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680e702c-ab1f-49cf-962d-1932f0202de1 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:50.709692 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 406/809] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Jun 20 05:58:50 2022] POST /identity/v3/endpoints => generated 346 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:58:50.710538 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e702c-ab1f-49cf-962d-1932f0202de1 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:50.757165 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:50.807914 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a98cf-b0d1-418f-bb67-1c263587afb9 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:50.811624 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:50.838964 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e702c-ab1f-49cf-962d-1932f0202de1 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:50.849280 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d3f98a-d9bf-407d-9ca7-ac409ec9e059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:50.850245 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3f98a-d9bf-407d-9ca7-ac409ec9e059 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:50.850593 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3f98a-d9bf-407d-9ca7-ac409ec9e059 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:50.850873 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3f98a-d9bf-407d-9ca7-ac409ec9e059 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:50.883650 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d041f43-c8a5-4a65-bbbb-6810f70a7cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:50.884579 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d041f43-c8a5-4a65-bbbb-6810f70a7cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:50.885758 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d041f43-c8a5-4a65-bbbb-6810f70a7cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:50.885758 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d041f43-c8a5-4a65-bbbb-6810f70a7cd7 None admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:50.886641 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d041f43-c8a5-4a65-bbbb-6810f70a7cd7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:50.886964 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d041f43-c8a5-4a65-bbbb-6810f70a7cd7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:50.888597 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d041f43-c8a5-4a65-bbbb-6810f70a7cd7 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:50.907668 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 407/810] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jun 20 05:58:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:50.908391 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d041f43-c8a5-4a65-bbbb-6810f70a7cd7 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:50.940260 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d3f98a-d9bf-407d-9ca7-ac409ec9e059 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:50.941756 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d3f98a-d9bf-407d-9ca7-ac409ec9e059 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:51.022880 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:51.063709 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d041f43-c8a5-4a65-bbbb-6810f70a7cd7 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:51.083214 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 404/811] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 05:58:50 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 05:58:51.084527 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556fe071-b727-4010-a04c-9250abbbde26 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:51.084834 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556fe071-b727-4010-a04c-9250abbbde26 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:51.085110 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556fe071-b727-4010-a04c-9250abbbde26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:51.106301 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-556fe071-b727-4010-a04c-9250abbbde26 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:51.107493 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-556fe071-b727-4010-a04c-9250abbbde26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:51.111066 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf12fe-d112-4898-a1dc-d6d8eba69e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:51.111066 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf12fe-d112-4898-a1dc-d6d8eba69e84 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:51.111302 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf12fe-d112-4898-a1dc-d6d8eba69e84 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:51.111516 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf12fe-d112-4898-a1dc-d6d8eba69e84 None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:51.112216 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cf12fe-d112-4898-a1dc-d6d8eba69e84 None admin] RBAC: Adding query filter params (name=network) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:51.112524 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cf12fe-d112-4898-a1dc-d6d8eba69e84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:51.113917 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cf12fe-d112-4898-a1dc-d6d8eba69e84 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:51.122938 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 408/812] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Jun 20 05:58:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:51.122938 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf12fe-d112-4898-a1dc-d6d8eba69e84 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:51.124897 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:51.198235 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 405/813] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:58:51.199408 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556fe071-b727-4010-a04c-9250abbbde26 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:51.259714 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf12fe-d112-4898-a1dc-d6d8eba69e84 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:51.301500 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c4aa5-c9c9-433b-8463-e9a957f743fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:51.302479 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c4aa5-c9c9-433b-8463-e9a957f743fc None admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:51.302764 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c4aa5-c9c9-433b-8463-e9a957f743fc None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:51.303050 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c4aa5-c9c9-433b-8463-e9a957f743fc None admin] PATH_INFO: `/v3/projects/b349043204b34d1794818184ffe6505c/users/b2b490cf71bc468da5ea2be04239e33f/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:51.305082 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c4aa5-c9c9-433b-8463-e9a957f743fc None admin] RBAC: Authorizing `identity:create_grant(project_id=b349043204b34d1794818184ffe6505c, user_id=b2b490cf71bc468da5ea2be04239e33f, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:51.306532 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c4aa5-c9c9-433b-8463-e9a957f743fc None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:51.313512 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:51.321727 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 409/814] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jun 20 05:58:51 2022] PUT /identity/v3/projects/b349043204b34d1794818184ffe6505c/users/b2b490cf71bc468da5ea2be04239e33f/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:58:51.322772 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c4aa5-c9c9-433b-8463-e9a957f743fc None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:51.327502 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556fe071-b727-4010-a04c-9250abbbde26 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:51.386315 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8abf55-a4b1-4471-8272-df1034331b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:51.386709 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8abf55-a4b1-4471-8272-df1034331b99 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:51.386942 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8abf55-a4b1-4471-8272-df1034331b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:51.387341 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8abf55-a4b1-4471-8272-df1034331b99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:51.400823 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8abf55-a4b1-4471-8272-df1034331b99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:51.402041 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8abf55-a4b1-4471-8272-df1034331b99 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:51.423694 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-eb8abf55-a4b1-4471-8272-df1034331b99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:51.423694 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:51.423694 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:51.423694 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:51.423694 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:51.423694 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:51.423694 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:51.423694 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:51.423694 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:51.423694 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:51.423694 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:51.423694 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:51.423694 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:51.423694 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:51.423694 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:51.424672 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:51.424672 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:51.424672 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:51.424672 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:51.424672 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:51.424672 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:51.424672 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:51.424672 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:51.424672 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:51.424672 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:51.424672 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:51.424672 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:51.424672 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:51.424672 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:51.424672 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:51.424672 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:51.424672 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:51.425645 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:51.425645 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:51.425645 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:51.425645 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:51.425645 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 406/815] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:51.426846 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8abf55-a4b1-4471-8272-df1034331b99 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:51.433737 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:51.508514 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c4aa5-c9c9-433b-8463-e9a957f743fc None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:51.560733 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320a4079-d460-4df6-a96c-60dcebb3d4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:51.561471 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a4079-d460-4df6-a96c-60dcebb3d4c8 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:51.561825 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a4079-d460-4df6-a96c-60dcebb3d4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:51.562222 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a4079-d460-4df6-a96c-60dcebb3d4c8 None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:51.563934 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320a4079-d460-4df6-a96c-60dcebb3d4c8 None admin] RBAC: Adding query filter params (type=network) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:51.564314 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320a4079-d460-4df6-a96c-60dcebb3d4c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:51.565838 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320a4079-d460-4df6-a96c-60dcebb3d4c8 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:51.571842 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 410/816] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Jun 20 05:58:51 2022] GET /identity/v3/services?type=network => generated 350 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:51.572770 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320a4079-d460-4df6-a96c-60dcebb3d4c8 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:51.579533 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8abf55-a4b1-4471-8272-df1034331b99 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:51.676971 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d866f-ce48-417e-8c32-1e2bb14bc068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:51.678384 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d866f-ce48-417e-8c32-1e2bb14bc068 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:51.679057 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d866f-ce48-417e-8c32-1e2bb14bc068 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:51.679540 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d866f-ce48-417e-8c32-1e2bb14bc068 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:51.694070 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d866f-ce48-417e-8c32-1e2bb14bc068 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:51.704093 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-188d866f-ce48-417e-8c32-1e2bb14bc068 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:51.704093 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:51.704093 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:51.704093 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:51.704093 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:51.704093 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:51.704093 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:51.704093 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:51.704093 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:51.704093 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:51.704093 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:51.704093 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:51.704093 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:51.704093 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:51.704093 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:51.704093 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:51.705078 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:51.705078 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:51.705078 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:51.705078 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:51.705078 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:51.705078 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:51.705078 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:51.705078 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:51.705078 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:51.705078 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:51.705078 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:51.705078 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:51.705078 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:51.705078 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:51.705078 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:51.705078 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:51.705938 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:51.705938 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:51.705938 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:51.705938 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:51.705938 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:51.705938 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:51.705938 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:51.705938 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:51.705938 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:51.705938 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:51.705938 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:51.705938 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:51.709152 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 407/817] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jun 20 05:58:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:51.715321 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d866f-ce48-417e-8c32-1e2bb14bc068 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:51.723412 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:51.775233 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320a4079-d460-4df6-a96c-60dcebb3d4c8 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:51.826669 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:51.842183 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f320c2a2-2845-4d2c-9d14-dc93caf0b53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:51.843367 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320c2a2-2845-4d2c-9d14-dc93caf0b53b None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:51.843655 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320c2a2-2845-4d2c-9d14-dc93caf0b53b None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:51.843930 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320c2a2-2845-4d2c-9d14-dc93caf0b53b None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:51.847880 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f320c2a2-2845-4d2c-9d14-dc93caf0b53b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:51.848219 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f320c2a2-2845-4d2c-9d14-dc93caf0b53b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:51.850826 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f320c2a2-2845-4d2c-9d14-dc93caf0b53b None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:51.871934 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d866f-ce48-417e-8c32-1e2bb14bc068 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:51.882347 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 411/818] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:51.882347 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f320c2a2-2845-4d2c-9d14-dc93caf0b53b None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:51.944129 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c4775-a1ea-4cf0-ba81-366f7e01de80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:51.944824 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c4775-a1ea-4cf0-ba81-366f7e01de80 None admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:51.945112 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c4775-a1ea-4cf0-ba81-366f7e01de80 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:51.948290 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c4775-a1ea-4cf0-ba81-366f7e01de80 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:51.949900 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50c4775-a1ea-4cf0-ba81-366f7e01de80 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:51.953933 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50c4775-a1ea-4cf0-ba81-366f7e01de80 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:52.001507 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 408/819] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Jun 20 05:58:51 2022] POST /identity/v3/endpoints => generated 327 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:58:52.002433 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c4775-a1ea-4cf0-ba81-366f7e01de80 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:52.051079 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f320c2a2-2845-4d2c-9d14-dc93caf0b53b None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:52.212547 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:52.230345 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0749ba8-2018-4cd3-81a7-2592b13caaa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:52.230345 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0749ba8-2018-4cd3-81a7-2592b13caaa4 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:52.230345 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0749ba8-2018-4cd3-81a7-2592b13caaa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:52.230345 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0749ba8-2018-4cd3-81a7-2592b13caaa4 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:52.231315 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0749ba8-2018-4cd3-81a7-2592b13caaa4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:52.231315 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0749ba8-2018-4cd3-81a7-2592b13caaa4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:52.232461 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0749ba8-2018-4cd3-81a7-2592b13caaa4 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:52.244026 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 412/820] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jun 20 05:58:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:52.249792 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0749ba8-2018-4cd3-81a7-2592b13caaa4 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:52.276648 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c4775-a1ea-4cf0-ba81-366f7e01de80 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:52.310261 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:52.326871 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c53c7-55c0-4393-ab79-81849c863af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:52.328033 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c53c7-55c0-4393-ab79-81849c863af2 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:52.328672 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c53c7-55c0-4393-ab79-81849c863af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:52.330990 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c53c7-55c0-4393-ab79-81849c863af2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:52.339778 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c53c7-55c0-4393-ab79-81849c863af2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:52.341564 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c53c7-55c0-4393-ab79-81849c863af2 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:52.358810 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-f55c53c7-55c0-4393-ab79-81849c863af2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:52.358810 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:52.358810 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:52.358810 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:52.358810 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:52.358810 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:52.358810 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:52.358810 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:52.358810 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:52.358810 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:52.358810 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:52.358810 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:52.358810 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:58:52.358810 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:58:52.358810 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:58:52.360521 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:58:52.360521 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:52.360521 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:52.360521 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:52.360521 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:52.360521 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:52.360521 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:52.360521 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:52.360521 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:52.360521 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:52.360521 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:52.360521 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:52.360521 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:52.360521 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:52.360521 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:52.360521 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:52.360521 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:52.362259 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:58:52.362259 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:58:52.362259 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:58:52.362259 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:58:52.362259 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:58:52.362259 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:58:52.362259 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:52.362259 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:52.366006 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 409/821] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:52.373344 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c53c7-55c0-4393-ab79-81849c863af2 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:52.381982 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0749ba8-2018-4cd3-81a7-2592b13caaa4 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:52.429476 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e23fbd2-8c14-4221-9b5a-9d1d3d3627ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:52.430285 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23fbd2-8c14-4221-9b5a-9d1d3d3627ea None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:52.430570 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23fbd2-8c14-4221-9b5a-9d1d3d3627ea None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:52.430850 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23fbd2-8c14-4221-9b5a-9d1d3d3627ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:52.445088 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e23fbd2-8c14-4221-9b5a-9d1d3d3627ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:52.447006 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e23fbd2-8c14-4221-9b5a-9d1d3d3627ea None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:52.474735 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-1e23fbd2-8c14-4221-9b5a-9d1d3d3627ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:52.474735 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:52.474735 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:52.474735 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:52.474735 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:52.474735 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:52.474735 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:52.474735 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:52.474735 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:52.474735 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:52.474735 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:52.474735 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:52.474735 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:52.474735 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:52.474735 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:52.475665 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:52.475665 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:52.475665 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:52.475665 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:52.475665 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:52.475665 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:52.475665 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:52.475665 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:52.475665 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:52.475665 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:52.475665 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:52.475665 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:52.475665 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:52.475665 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:52.475665 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:52.475665 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:52.475665 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:52.476575 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:52.476575 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:52.476575 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:52.476575 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:52.476575 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 413/822] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:58:52.481689 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e23fbd2-8c14-4221-9b5a-9d1d3d3627ea None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:52.506696 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c53c7-55c0-4393-ab79-81849c863af2 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:52.529303 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:52.545721 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c37ca-d70b-40fa-88ad-b908ec131098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:52.546389 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c37ca-d70b-40fa-88ad-b908ec131098 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:52.546668 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c37ca-d70b-40fa-88ad-b908ec131098 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:52.546941 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c37ca-d70b-40fa-88ad-b908ec131098 None admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:52.548677 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752c37ca-d70b-40fa-88ad-b908ec131098 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:52.549025 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752c37ca-d70b-40fa-88ad-b908ec131098 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:52.550559 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752c37ca-d70b-40fa-88ad-b908ec131098 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:52.564173 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 410/823] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jun 20 05:58:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:58:52.573807 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c37ca-d70b-40fa-88ad-b908ec131098 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:52.608291 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:52.613893 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e23fbd2-8c14-4221-9b5a-9d1d3d3627ea None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:52.651937 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ff4cd-1202-4b3a-83f1-ae2806ef6cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:52.653004 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ff4cd-1202-4b3a-83f1-ae2806ef6cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:52.653496 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ff4cd-1202-4b3a-83f1-ae2806ef6cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:52.654006 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ff4cd-1202-4b3a-83f1-ae2806ef6cc2 None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:52.654959 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38ff4cd-1202-4b3a-83f1-ae2806ef6cc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:52.655481 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38ff4cd-1202-4b3a-83f1-ae2806ef6cc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:52.657843 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38ff4cd-1202-4b3a-83f1-ae2806ef6cc2 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:52.673089 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 414/824] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:52.678657 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ff4cd-1202-4b3a-83f1-ae2806ef6cc2 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:52.692317 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c37ca-d70b-40fa-88ad-b908ec131098 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:52.736004 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99be3f5-5a20-4fe1-992e-33473b773f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:52.736631 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99be3f5-5a20-4fe1-992e-33473b773f47 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:52.736963 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99be3f5-5a20-4fe1-992e-33473b773f47 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:52.737247 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99be3f5-5a20-4fe1-992e-33473b773f47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:52.738104 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99be3f5-5a20-4fe1-992e-33473b773f47 None admin] RBAC: Adding query filter params (role.id=5a64bd8372704de98e75436ff69e46b3, scope.project.id=b349043204b34d1794818184ffe6505c, user.id=3cee106502e54829ad802ee41c9165fa) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:52.738424 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99be3f5-5a20-4fe1-992e-33473b773f47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:52.739974 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99be3f5-5a20-4fe1-992e-33473b773f47 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:52.753078 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 411/825] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jun 20 05:58:52 2022] GET /identity/v3/role_assignments?user.id=3cee106502e54829ad802ee41c9165fa&scope.project.id=b349043204b34d1794818184ffe6505c&role.id=5a64bd8372704de98e75436ff69e46b3 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:52.921300 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ff4cd-1202-4b3a-83f1-ae2806ef6cc2 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:52.958721 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea73f3a-25d7-4ae0-960f-88ea00e3f20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:52.959912 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea73f3a-25d7-4ae0-960f-88ea00e3f20c None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:52.960420 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea73f3a-25d7-4ae0-960f-88ea00e3f20c None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:52.960941 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea73f3a-25d7-4ae0-960f-88ea00e3f20c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:52.969176 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea73f3a-25d7-4ae0-960f-88ea00e3f20c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:52.970880 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea73f3a-25d7-4ae0-960f-88ea00e3f20c None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:52.986845 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-1ea73f3a-25d7-4ae0-960f-88ea00e3f20c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 05:58:52.986845 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:52.986845 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:52.986845 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:52.986845 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:52.986845 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:52.986845 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:52.986845 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:52.986845 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:52.986845 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:52.986845 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:52.986845 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:52.986845 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:58:52.986845 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:58:52.986845 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:58:52.986845 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:58:52.987789 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:52.987789 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:52.987789 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:58:52.987789 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:52.987789 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:58:52.987789 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:52.987789 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:52.987789 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:52.987789 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:52.987789 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:52.987789 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:52.987789 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:52.987789 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:52.987789 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:52.987789 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:52.987789 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:52.987789 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:52.987789 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:52.988791 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:52.988791 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:52.988791 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:58:52.988791 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:58:52.988791 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:58:52.988791 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:58:52.988791 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:58:52.988791 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:58:52.988791 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 05:58:52.988791 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:52.989993 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 415/826] 10.222.0.39 () {56 vars in 1117 bytes} [Mon Jun 20 05:58:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:58:52.997397 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99be3f5-5a20-4fe1-992e-33473b773f47 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:53.050088 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5853f61-d7d4-4853-9e09-85c617a05d81 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:53.050419 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5853f61-d7d4-4853-9e09-85c617a05d81 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:53.050653 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5853f61-d7d4-4853-9e09-85c617a05d81 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:53.052146 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 416/827] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:58:53.057357 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7544f-21b2-4430-8baf-389addfde09f None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:53.057645 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7544f-21b2-4430-8baf-389addfde09f None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:53.057933 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7544f-21b2-4430-8baf-389addfde09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:53.060093 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:53.077064 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-f3b7544f-21b2-4430-8baf-389addfde09f None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:53.078433 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-f3b7544f-21b2-4430-8baf-389addfde09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:53.092808 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:53.138637 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99be3f5-5a20-4fe1-992e-33473b773f47 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:53.160722 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 417/828] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:53 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:58:53.177808 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b7544f-21b2-4430-8baf-389addfde09f None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:53.196623 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f657e55f-75fa-4b30-a4b6-b02840dae53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:53.197320 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f657e55f-75fa-4b30-a4b6-b02840dae53f None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:53.197602 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f657e55f-75fa-4b30-a4b6-b02840dae53f None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:53.197876 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f657e55f-75fa-4b30-a4b6-b02840dae53f None admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:53.198720 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f657e55f-75fa-4b30-a4b6-b02840dae53f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:53.199029 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f657e55f-75fa-4b30-a4b6-b02840dae53f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:53.200758 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f657e55f-75fa-4b30-a4b6-b02840dae53f None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:53.229799 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 412/829] 10.222.0.39 () {56 vars in 1149 bytes} [Mon Jun 20 05:58:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:53.235215 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f657e55f-75fa-4b30-a4b6-b02840dae53f None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:53.315149 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b7544f-21b2-4430-8baf-389addfde09f None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:53.351450 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f657e55f-75fa-4b30-a4b6-b02840dae53f None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:53.353211 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:53.362520 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e84f65-8673-4a26-9dbb-9c42fc0efc47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:53.363689 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e84f65-8673-4a26-9dbb-9c42fc0efc47 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:53.364115 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e84f65-8673-4a26-9dbb-9c42fc0efc47 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:53.364629 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e84f65-8673-4a26-9dbb-9c42fc0efc47 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:53.365520 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e84f65-8673-4a26-9dbb-9c42fc0efc47 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:53.367067 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e84f65-8673-4a26-9dbb-9c42fc0efc47 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:53.385464 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-80e84f65-8673-4a26-9dbb-9c42fc0efc47 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 05:58:53.385464 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:53.385464 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:58:53.385464 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:58:53.385464 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:58:53.385464 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:58:53.385464 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:58:53.385464 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:58:53.385464 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 05:58:53.385464 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:53.385464 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:58:53.385464 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:53.385464 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:53.385464 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:53.385464 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:53.385464 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:53.385464 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:53.386745 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:53.386745 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:53.386745 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:53.386745 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:53.386745 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:53.386745 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:53.386745 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:58:53.386745 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:58:53.386745 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:58:53.386745 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:58:53.386745 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:53.386745 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:53.386745 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:53.386745 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:53.386745 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:53.386745 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:53.387771 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:53.387771 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:53.387771 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:53.387771 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:53.387771 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:53.387771 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:53.387771 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:53.387771 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:53.387771 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:53.387771 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:53.387771 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:58:53.387771 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:58:53.387771 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 05:58:53.387771 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:53.390419 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 418/830] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jun 20 05:58:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:58:53.397066 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e84f65-8673-4a26-9dbb-9c42fc0efc47 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:53.398850 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878bd7cc-c263-41d2-80a5-b889db21ee9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:53.399738 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bd7cc-c263-41d2-80a5-b889db21ee9e None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:53.400086 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bd7cc-c263-41d2-80a5-b889db21ee9e None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:53.400827 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bd7cc-c263-41d2-80a5-b889db21ee9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:53.417479 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878bd7cc-c263-41d2-80a5-b889db21ee9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:53.417676 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:53.419394 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878bd7cc-c263-41d2-80a5-b889db21ee9e None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:53.441565 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-878bd7cc-c263-41d2-80a5-b889db21ee9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:53.441565 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:53.441565 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:53.441565 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:53.441565 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:53.441565 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:53.441565 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:53.441565 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:53.441565 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:53.441565 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:53.441565 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:53.441565 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:53.441565 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:53.441565 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:53.441565 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:53.442683 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:53.442683 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:53.442683 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:53.442683 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:53.442683 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:53.442683 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:53.442683 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:53.442683 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:53.442683 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:53.442683 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:53.442683 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:53.442683 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:53.442683 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:53.442683 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:53.442683 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:53.442683 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:53.442683 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:53.443630 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:53.443630 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:53.443630 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:53.443630 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:53.445958 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 413/831] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:58:53.452769 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878bd7cc-c263-41d2-80a5-b889db21ee9e None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:53.541347 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e84f65-8673-4a26-9dbb-9c42fc0efc47 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:53.588092 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878bd7cc-c263-41d2-80a5-b889db21ee9e None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:53.588754 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c6c4e-b5ae-4fbe-8e0e-9f147f1d6718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:53.589716 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c6c4e-b5ae-4fbe-8e0e-9f147f1d6718 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:53.590182 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c6c4e-b5ae-4fbe-8e0e-9f147f1d6718 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:53.590654 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c6c4e-b5ae-4fbe-8e0e-9f147f1d6718 None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:53.591522 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c6c4e-b5ae-4fbe-8e0e-9f147f1d6718 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:53.591976 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c6c4e-b5ae-4fbe-8e0e-9f147f1d6718 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:53.593535 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c6c4e-b5ae-4fbe-8e0e-9f147f1d6718 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:53.609240 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 419/832] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jun 20 05:58:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:58:53.612637 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c6c4e-b5ae-4fbe-8e0e-9f147f1d6718 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:53.632533 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fce4c0-bc4f-44b0-a652-c4b4361ba978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:53.633361 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fce4c0-bc4f-44b0-a652-c4b4361ba978 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:53.633642 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fce4c0-bc4f-44b0-a652-c4b4361ba978 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:53.633914 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fce4c0-bc4f-44b0-a652-c4b4361ba978 None admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:53.634676 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fce4c0-bc4f-44b0-a652-c4b4361ba978 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:53.634988 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fce4c0-bc4f-44b0-a652-c4b4361ba978 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:53.636366 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fce4c0-bc4f-44b0-a652-c4b4361ba978 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:53.648844 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 414/833] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:53.650235 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89600e8e-c095-464d-bf8a-f598470f4d48 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:53.650362 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89600e8e-c095-464d-bf8a-f598470f4d48 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:53.650560 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89600e8e-c095-464d-bf8a-f598470f4d48 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:53.652026 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 415/834] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:53.657502 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89600e8e-c095-464d-bf8a-f598470f4d48 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:53.675061 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:53.729766 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:53.769512 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c6c4e-b5ae-4fbe-8e0e-9f147f1d6718 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:53.781510 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89600e8e-c095-464d-bf8a-f598470f4d48 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:53.819583 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e27b86-b7ab-46f5-9744-13b02d2c757e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:53.820386 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e27b86-b7ab-46f5-9744-13b02d2c757e None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:53.820664 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e27b86-b7ab-46f5-9744-13b02d2c757e None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:53.820969 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e27b86-b7ab-46f5-9744-13b02d2c757e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:53.823639 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a4899-85ec-41a4-82ea-217373c8bf55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:53.825060 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a4899-85ec-41a4-82ea-217373c8bf55 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:53.825532 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a4899-85ec-41a4-82ea-217373c8bf55 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:53.825966 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a4899-85ec-41a4-82ea-217373c8bf55 None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:53.827245 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a4899-85ec-41a4-82ea-217373c8bf55 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:53.827797 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a4899-85ec-41a4-82ea-217373c8bf55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:53.829155 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e27b86-b7ab-46f5-9744-13b02d2c757e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:53.830220 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a4899-85ec-41a4-82ea-217373c8bf55 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:53.830461 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e27b86-b7ab-46f5-9744-13b02d2c757e None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:53.849018 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 420/835] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jun 20 05:58:53 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:58:53.849018 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59897b2-3e32-4458-8f26-f4313d0195a9 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:53.849018 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59897b2-3e32-4458-8f26-f4313d0195a9 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:53.849018 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59897b2-3e32-4458-8f26-f4313d0195a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:53.849416 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-a8e27b86-b7ab-46f5-9744-13b02d2c757e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:53.849416 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:53.849416 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:53.849416 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:53.849416 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:53.849416 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:53.849416 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:53.849416 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:53.849416 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:53.849416 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:53.849416 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:53.849416 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:53.849416 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:58:53.849416 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:58:53.849416 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:58:53.850244 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:58:53.850244 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:53.850244 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:53.850244 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:53.850244 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:53.850244 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:53.850244 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:53.850244 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:53.850244 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:53.850244 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:53.850244 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:53.850244 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:53.850244 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:53.850244 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:53.850244 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:53.850244 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:53.850244 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:53.851144 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:58:53.851144 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:58:53.851144 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:58:53.851144 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:58:53.851144 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:58:53.851144 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:58:53.851144 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:53.851144 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:53.852201 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 416/836] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:53.853283 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e27b86-b7ab-46f5-9744-13b02d2c757e None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:53.870244 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-e59897b2-3e32-4458-8f26-f4313d0195a9 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:53.871851 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-e59897b2-3e32-4458-8f26-f4313d0195a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:53.952325 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 421/837] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:53 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:58:53.958582 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:53.978545 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59897b2-3e32-4458-8f26-f4313d0195a9 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:53.991956 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e27b86-b7ab-46f5-9744-13b02d2c757e None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:54.037826 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e0e43-070e-412b-a52d-e00b9be2c02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:54.038529 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e0e43-070e-412b-a52d-e00b9be2c02a None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:54.038819 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e0e43-070e-412b-a52d-e00b9be2c02a None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:54.039105 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e0e43-070e-412b-a52d-e00b9be2c02a None admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:54.039938 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56e0e43-070e-412b-a52d-e00b9be2c02a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:54.040262 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56e0e43-070e-412b-a52d-e00b9be2c02a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:54.041810 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56e0e43-070e-412b-a52d-e00b9be2c02a None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:54.056171 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 417/838] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jun 20 05:58:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:58:54.065225 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:54.067015 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e0e43-070e-412b-a52d-e00b9be2c02a None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:54.099734 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59897b2-3e32-4458-8f26-f4313d0195a9 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:54.155087 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a95202-363a-41a2-8bd8-e6ff18cdbebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:54.156283 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a95202-363a-41a2-8bd8-e6ff18cdbebe None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:54.157509 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a95202-363a-41a2-8bd8-e6ff18cdbebe None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:54.157958 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a95202-363a-41a2-8bd8-e6ff18cdbebe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:54.171777 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a95202-363a-41a2-8bd8-e6ff18cdbebe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:54.186431 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-02a95202-363a-41a2-8bd8-e6ff18cdbebe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:58:54.186431 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:54.186431 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:54.186431 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:54.186431 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:54.186431 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:54.186431 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:54.186431 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:54.186431 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:54.186431 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:54.186431 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:54.186431 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:54.186431 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:54.186431 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:54.186431 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:54.186431 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:54.189250 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:54.189250 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:54.189250 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:54.189250 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:54.189250 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:54.189250 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:54.189250 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:54.189250 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:54.189250 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:54.189250 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:54.189250 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:54.189250 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:54.189250 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:54.189250 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:54.189250 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:54.189250 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:54.190722 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:54.190722 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:54.190722 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:54.190722 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:54.190722 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:54.190722 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:54.190722 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:54.190722 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:54.190722 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:54.190722 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:54.190722 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:58:54.190722 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:54.193404 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 422/839] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jun 20 05:58:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:54.199245 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a95202-363a-41a2-8bd8-e6ff18cdbebe None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:54.237016 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e0e43-070e-412b-a52d-e00b9be2c02a None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:54.278926 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e89e19-2962-4410-9101-5349c3db048d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:54.280229 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e89e19-2962-4410-9101-5349c3db048d None admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:54.280513 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e89e19-2962-4410-9101-5349c3db048d None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:54.280811 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e89e19-2962-4410-9101-5349c3db048d None admin] PATH_INFO: `/v3/projects/b349043204b34d1794818184ffe6505c/users/8c0f131484cb48d289cae1f473ec2fbc/roles/b7e86f43512c42bfa0d069e3e6fb97c5` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:54.285759 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:54.302663 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e89e19-2962-4410-9101-5349c3db048d None admin] RBAC: Authorizing `identity:create_grant(project_id=b349043204b34d1794818184ffe6505c, user_id=8c0f131484cb48d289cae1f473ec2fbc, role_id=b7e86f43512c42bfa0d069e3e6fb97c5)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:54.304486 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e89e19-2962-4410-9101-5349c3db048d None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:54.322254 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 418/840] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jun 20 05:58:54 2022] PUT /identity/v3/projects/b349043204b34d1794818184ffe6505c/users/8c0f131484cb48d289cae1f473ec2fbc/roles/b7e86f43512c42bfa0d069e3e6fb97c5 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:58:54.335923 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a95202-363a-41a2-8bd8-e6ff18cdbebe None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:54.370675 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:54.378727 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6953c669-3bcd-4b11-bfb8-f427c0b0f539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:54.383552 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953c669-3bcd-4b11-bfb8-f427c0b0f539 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:54.383880 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953c669-3bcd-4b11-bfb8-f427c0b0f539 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:54.384161 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953c669-3bcd-4b11-bfb8-f427c0b0f539 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:54.384994 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6953c669-3bcd-4b11-bfb8-f427c0b0f539 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:54.385339 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6953c669-3bcd-4b11-bfb8-f427c0b0f539 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:54.386708 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6953c669-3bcd-4b11-bfb8-f427c0b0f539 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:54.400028 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 423/841] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 05:58:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:58:54.406180 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e89e19-2962-4410-9101-5349c3db048d None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:54.528869 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e89e19-2962-4410-9101-5349c3db048d None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:54.567899 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c623f1-24a5-41f4-b3ed-2fa82ef02b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:54.568784 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c623f1-24a5-41f4-b3ed-2fa82ef02b0f None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:54.569063 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c623f1-24a5-41f4-b3ed-2fa82ef02b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:54.569331 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c623f1-24a5-41f4-b3ed-2fa82ef02b0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:54.581099 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c623f1-24a5-41f4-b3ed-2fa82ef02b0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:54.582563 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c623f1-24a5-41f4-b3ed-2fa82ef02b0f None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:54.601748 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-32c623f1-24a5-41f4-b3ed-2fa82ef02b0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:54.601748 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:54.601748 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:54.601748 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:54.601748 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:54.601748 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:54.601748 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:54.601748 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:54.601748 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:54.601748 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:54.601748 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:54.601748 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:54.601748 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:54.601748 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:54.601748 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:54.603189 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:54.603189 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:54.603189 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:54.603189 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:54.603189 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:54.603189 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:54.603189 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:54.603189 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:54.603189 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:54.603189 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:54.603189 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:54.603189 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:54.603189 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:54.603189 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:54.603189 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:54.603189 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:54.603189 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:54.604070 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:54.604070 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:54.604070 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:54.604070 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:54.604070 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 419/842] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:54.608827 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6953c669-3bcd-4b11-bfb8-f427c0b0f539 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:54.728985 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6953c669-3bcd-4b11-bfb8-f427c0b0f539 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:54.771483 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51961369-df03-4e74-9326-6e29a8dfca5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:54.772149 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51961369-df03-4e74-9326-6e29a8dfca5b None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:54.772429 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51961369-df03-4e74-9326-6e29a8dfca5b None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:54.772733 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51961369-df03-4e74-9326-6e29a8dfca5b None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:54.773453 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51961369-df03-4e74-9326-6e29a8dfca5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:54.773753 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51961369-df03-4e74-9326-6e29a8dfca5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:54.775124 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51961369-df03-4e74-9326-6e29a8dfca5b None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:54.789238 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 424/843] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:54.794856 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c623f1-24a5-41f4-b3ed-2fa82ef02b0f None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:54.838049 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:54.920072 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c623f1-24a5-41f4-b3ed-2fa82ef02b0f None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:54.970040 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab729aa-aaa4-4806-8c00-18d53d3c6fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:54.970849 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab729aa-aaa4-4806-8c00-18d53d3c6fcc None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:54.971125 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab729aa-aaa4-4806-8c00-18d53d3c6fcc None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:54.971481 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab729aa-aaa4-4806-8c00-18d53d3c6fcc None admin] PATH_INFO: `/v3/users/swift` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:54.981083 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab729aa-aaa4-4806-8c00-18d53d3c6fcc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:54.983248 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab729aa-aaa4-4806-8c00-18d53d3c6fcc None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:55.002042 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-1ab729aa-aaa4-4806-8c00-18d53d3c6fcc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 20 05:58:55.002042 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:55.002042 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:55.002042 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:55.002042 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:55.002042 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:55.002042 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:55.002042 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:55.002042 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:55.002042 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:55.002042 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:55.002042 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:55.002042 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:58:55.002042 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:58:55.002042 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:58:55.002042 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:58:55.004603 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:55.004603 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:55.004603 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:58:55.004603 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:55.004603 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:58:55.004603 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:55.004603 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:55.004603 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:55.004603 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:55.004603 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:55.004603 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:55.004603 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:55.004603 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:55.004603 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:55.004603 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:55.004603 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:55.004603 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:55.004603 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:55.008210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:55.008210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:55.008210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:58:55.008210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:58:55.008210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:58:55.008210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:58:55.008210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:58:55.008210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:58:55.008210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 20 05:58:55.008210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:55.008210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 420/844] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jun 20 05:58:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:55.009695 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51961369-df03-4e74-9326-6e29a8dfca5b None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:55.076745 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:55.143846 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51961369-df03-4e74-9326-6e29a8dfca5b None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:55.184021 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b99e8-7edd-44d9-8295-13fa0ea74780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:55.184718 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b99e8-7edd-44d9-8295-13fa0ea74780 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:55.185007 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b99e8-7edd-44d9-8295-13fa0ea74780 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:55.185287 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b99e8-7edd-44d9-8295-13fa0ea74780 None admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:55.186135 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7b99e8-7edd-44d9-8295-13fa0ea74780 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:55.186445 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7b99e8-7edd-44d9-8295-13fa0ea74780 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:55.188347 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7b99e8-7edd-44d9-8295-13fa0ea74780 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:55.208341 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 425/845] 10.222.0.39 () {56 vars in 1135 bytes} [Mon Jun 20 05:58:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:55.213954 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab729aa-aaa4-4806-8c00-18d53d3c6fcc None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:55.218016 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303b4d9-66d1-40d6-bf67-6e53669a9fa7 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:55.218016 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303b4d9-66d1-40d6-bf67-6e53669a9fa7 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:55.218016 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303b4d9-66d1-40d6-bf67-6e53669a9fa7 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:55.226026 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 426/846] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:58:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:55.230211 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbb22f-c592-44f7-abb6-6d58aff70018 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:55.230439 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbb22f-c592-44f7-abb6-6d58aff70018 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:55.230710 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbb22f-c592-44f7-abb6-6d58aff70018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:55.249022 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-55cbb22f-c592-44f7-abb6-6d58aff70018 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:55.250768 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-55cbb22f-c592-44f7-abb6-6d58aff70018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:55.338603 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 427/847] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:55 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:58:55.348579 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:55.356985 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab729aa-aaa4-4806-8c00-18d53d3c6fcc None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:55.357631 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cbb22f-c592-44f7-abb6-6d58aff70018 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:55.399439 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508897b3-9ab7-49f9-8948-417ac35faa8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:55.400487 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508897b3-9ab7-49f9-8948-417ac35faa8e None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:55.401077 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508897b3-9ab7-49f9-8948-417ac35faa8e None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:55.401555 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508897b3-9ab7-49f9-8948-417ac35faa8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:55.420248 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:55.493985 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cbb22f-c592-44f7-abb6-6d58aff70018 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:55.497532 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508897b3-9ab7-49f9-8948-417ac35faa8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:55.499020 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508897b3-9ab7-49f9-8948-417ac35faa8e None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:55.541510 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6a9db-47ec-4e8f-835e-ada9c1c6cf17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:55.542250 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6a9db-47ec-4e8f-835e-ada9c1c6cf17 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:55.542532 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6a9db-47ec-4e8f-835e-ada9c1c6cf17 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:55.542807 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6a9db-47ec-4e8f-835e-ada9c1c6cf17 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:55.543467 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d6a9db-47ec-4e8f-835e-ada9c1c6cf17 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:55.544858 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d6a9db-47ec-4e8f-835e-ada9c1c6cf17 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:55.571541 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-83d6a9db-47ec-4e8f-835e-ada9c1c6cf17 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 05:58:55.571541 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:55.571541 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:58:55.571541 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:58:55.571541 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:58:55.571541 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:58:55.571541 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:58:55.571541 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:58:55.571541 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 05:58:55.571541 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:55.571541 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:58:55.571541 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:55.571541 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:55.571541 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:55.571541 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:55.571541 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:55.572548 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:55.572548 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:55.572548 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:55.572548 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:55.572548 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:55.572548 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:55.572548 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:55.572548 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:58:55.572548 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:58:55.572548 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:58:55.572548 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:58:55.572548 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:55.572548 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:55.572548 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:55.572548 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:55.572548 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:55.573403 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:55.573403 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:55.573403 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:55.573403 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:55.573403 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:55.573403 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:55.573403 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:55.573403 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:55.573403 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:55.573403 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:55.573403 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:55.573403 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:58:55.573403 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:58:55.573403 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 05:58:55.573403 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:55.577086 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 428/848] 10.222.0.39 () {56 vars in 1132 bytes} [Mon Jun 20 05:58:55 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:58:55.579901 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6a9db-47ec-4e8f-835e-ada9c1c6cf17 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:55.611243 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:55.620621 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 421/849] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 05:58:55 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 05:58:55.626432 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508897b3-9ab7-49f9-8948-417ac35faa8e None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:55.728591 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6a9db-47ec-4e8f-835e-ada9c1c6cf17 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:55.731077 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:55.761474 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508897b3-9ab7-49f9-8948-417ac35faa8e None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:55.775840 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57cdfd0-c3f1-4f28-8ba0-c9c5d61ac59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:55.776910 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cdfd0-c3f1-4f28-8ba0-c9c5d61ac59c None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:55.777480 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cdfd0-c3f1-4f28-8ba0-c9c5d61ac59c None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:55.777950 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cdfd0-c3f1-4f28-8ba0-c9c5d61ac59c None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:55.778853 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57cdfd0-c3f1-4f28-8ba0-c9c5d61ac59c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:55.779355 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57cdfd0-c3f1-4f28-8ba0-c9c5d61ac59c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:55.780971 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57cdfd0-c3f1-4f28-8ba0-c9c5d61ac59c None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:55.786863 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 429/850] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Jun 20 05:58:55 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:55.793247 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57cdfd0-c3f1-4f28-8ba0-c9c5d61ac59c None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:55.810918 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5171c774-ff5c-49c9-93df-48e38f43a210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:55.811980 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171c774-ff5c-49c9-93df-48e38f43a210 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:55.812261 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171c774-ff5c-49c9-93df-48e38f43a210 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:55.813089 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171c774-ff5c-49c9-93df-48e38f43a210 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:55.829570 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5171c774-ff5c-49c9-93df-48e38f43a210 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:55.831032 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5171c774-ff5c-49c9-93df-48e38f43a210 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:55.852234 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-5171c774-ff5c-49c9-93df-48e38f43a210 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:55.852234 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:55.852234 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:55.852234 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:55.852234 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:55.852234 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:55.852234 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:55.852234 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:55.852234 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:55.852234 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:55.852234 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:55.852234 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:55.852234 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:55.852234 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:55.852234 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:55.853222 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:55.853222 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:55.853222 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:55.853222 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:55.853222 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:55.853222 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:55.853222 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:55.853222 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:55.853222 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:55.853222 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:55.853222 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:55.853222 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:55.853222 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:55.853222 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:55.853222 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:55.853222 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:55.853222 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:55.854123 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:55.854123 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:55.854123 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:55.854123 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:55.858271 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 422/851] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:55.859181 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5171c774-ff5c-49c9-93df-48e38f43a210 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:55.915151 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:55.934378 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57cdfd0-c3f1-4f28-8ba0-c9c5d61ac59c None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:55.970263 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5171c774-ff5c-49c9-93df-48e38f43a210 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:55.975085 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c98d3-e0a0-4628-9bb5-3f7809db9f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:55.976162 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c98d3-e0a0-4628-9bb5-3f7809db9f75 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:55.976660 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c98d3-e0a0-4628-9bb5-3f7809db9f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:55.977218 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c98d3-e0a0-4628-9bb5-3f7809db9f75 None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:55.978154 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50c98d3-e0a0-4628-9bb5-3f7809db9f75 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:55.978717 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50c98d3-e0a0-4628-9bb5-3f7809db9f75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:55.980379 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50c98d3-e0a0-4628-9bb5-3f7809db9f75 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:55.993010 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 430/852] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Jun 20 05:58:55 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:58:56.011565 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649f1d33-1eff-4686-8d97-13164b3b51ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:56.012252 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f1d33-1eff-4686-8d97-13164b3b51ff None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:56.012577 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f1d33-1eff-4686-8d97-13164b3b51ff None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:56.012886 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f1d33-1eff-4686-8d97-13164b3b51ff None admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:56.013664 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649f1d33-1eff-4686-8d97-13164b3b51ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:56.013977 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649f1d33-1eff-4686-8d97-13164b3b51ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:56.015442 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649f1d33-1eff-4686-8d97-13164b3b51ff None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:56.029592 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 423/853] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:58:56.035605 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c98d3-e0a0-4628-9bb5-3f7809db9f75 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:56.073563 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:56.138636 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b2f8c-022c-4b68-aa45-96e0edd3da35 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:56.139016 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b2f8c-022c-4b68-aa45-96e0edd3da35 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:56.139185 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b2f8c-022c-4b68-aa45-96e0edd3da35 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:56.141161 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 424/854] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:58:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:56.147506 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd90b2-7e76-4b67-a783-30dc58139da6 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:56.147820 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd90b2-7e76-4b67-a783-30dc58139da6 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:56.148070 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd90b2-7e76-4b67-a783-30dc58139da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:56.168756 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-a2bd90b2-7e76-4b67-a783-30dc58139da6 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:56.170110 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c98d3-e0a0-4628-9bb5-3f7809db9f75 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:56.170503 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-a2bd90b2-7e76-4b67-a783-30dc58139da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:56.210144 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2147aec9-ab60-4cd9-9f68-7cef9e19a01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:56.211524 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147aec9-ab60-4cd9-9f68-7cef9e19a01e None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:56.212020 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147aec9-ab60-4cd9-9f68-7cef9e19a01e None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:56.212495 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147aec9-ab60-4cd9-9f68-7cef9e19a01e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:56.223446 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2147aec9-ab60-4cd9-9f68-7cef9e19a01e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:56.225123 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2147aec9-ab60-4cd9-9f68-7cef9e19a01e None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:56.242111 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-2147aec9-ab60-4cd9-9f68-7cef9e19a01e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:56.242111 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:56.242111 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:56.242111 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:56.242111 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:56.242111 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:56.242111 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:56.242111 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:56.242111 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:56.242111 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:56.242111 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:56.242111 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:56.242111 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:58:56.242111 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:58:56.242111 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:58:56.243084 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:58:56.243084 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:56.243084 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:56.243084 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:56.243084 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:56.243084 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:56.243084 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:56.243084 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:56.243084 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:56.243084 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:56.243084 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:56.243084 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:56.243084 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:56.243084 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:56.243084 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:56.243084 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:56.243084 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:56.244004 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:58:56.244004 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:58:56.244004 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:58:56.244004 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:58:56.244004 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:58:56.244004 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:58:56.244004 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:56.244004 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:56.244004 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 431/855] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:56.249457 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2147aec9-ab60-4cd9-9f68-7cef9e19a01e None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:56.259441 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 425/856] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:56 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 05:58:56.284465 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd90b2-7e76-4b67-a783-30dc58139da6 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:56.350848 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:56.373467 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:56.383844 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2147aec9-ab60-4cd9-9f68-7cef9e19a01e None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:56.424510 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c8496-5e3f-4175-b626-57e5daa20dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:56.425556 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c8496-5e3f-4175-b626-57e5daa20dac None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:56.426035 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd90b2-7e76-4b67-a783-30dc58139da6 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:56.426249 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c8496-5e3f-4175-b626-57e5daa20dac None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:56.426747 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c8496-5e3f-4175-b626-57e5daa20dac None admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:56.427740 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565c8496-5e3f-4175-b626-57e5daa20dac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:56.428255 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565c8496-5e3f-4175-b626-57e5daa20dac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:56.429937 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565c8496-5e3f-4175-b626-57e5daa20dac None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:56.442863 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 432/857] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jun 20 05:58:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:56.448510 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c8496-5e3f-4175-b626-57e5daa20dac None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:56.464577 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f58d60e-e225-4cef-9ec1-4c50537c4cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:56.465408 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58d60e-e225-4cef-9ec1-4c50537c4cbe None admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:56.465670 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58d60e-e225-4cef-9ec1-4c50537c4cbe None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:56.465948 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58d60e-e225-4cef-9ec1-4c50537c4cbe None admin] PATH_INFO: `/v3/services` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:56.466877 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f58d60e-e225-4cef-9ec1-4c50537c4cbe None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:56.468334 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f58d60e-e225-4cef-9ec1-4c50537c4cbe None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:56.488750 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 426/858] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Jun 20 05:58:56 2022] POST /identity/v3/services => generated 251 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 05:58:56.582920 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c8496-5e3f-4175-b626-57e5daa20dac None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:56.630948 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e9a7d-35e1-4961-98db-377fa8b88413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:56.631536 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e9a7d-35e1-4961-98db-377fa8b88413 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:56.631815 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e9a7d-35e1-4961-98db-377fa8b88413 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:56.632086 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e9a7d-35e1-4961-98db-377fa8b88413 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:56.633013 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e9a7d-35e1-4961-98db-377fa8b88413 None admin] RBAC: Adding query filter params (role.id=5a64bd8372704de98e75436ff69e46b3, scope.project.id=b349043204b34d1794818184ffe6505c, user.id=b2b490cf71bc468da5ea2be04239e33f) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:56.633330 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e9a7d-35e1-4961-98db-377fa8b88413 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:56.634788 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e9a7d-35e1-4961-98db-377fa8b88413 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:56.642356 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 433/859] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jun 20 05:58:56 2022] GET /identity/v3/role_assignments?user.id=b2b490cf71bc468da5ea2be04239e33f&scope.project.id=b349043204b34d1794818184ffe6505c&role.id=5a64bd8372704de98e75436ff69e46b3 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:58:56.788979 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179de7c3-9d77-4d1e-8f24-6092a37561e9 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:56.789502 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179de7c3-9d77-4d1e-8f24-6092a37561e9 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:56.789609 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179de7c3-9d77-4d1e-8f24-6092a37561e9 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:56.791050 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 427/860] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:58:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:56.797259 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009a64a-5a36-405f-a63a-9a491cf2fe9b None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:56.797925 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009a64a-5a36-405f-a63a-9a491cf2fe9b None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:56.797925 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009a64a-5a36-405f-a63a-9a491cf2fe9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:56.815455 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-c009a64a-5a36-405f-a63a-9a491cf2fe9b None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:56.816646 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-c009a64a-5a36-405f-a63a-9a491cf2fe9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:56.825229 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:56.889369 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 434/861] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:56 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:58:56.912933 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179de7c3-9d77-4d1e-8f24-6092a37561e9 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:57.023205 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:57.029360 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179de7c3-9d77-4d1e-8f24-6092a37561e9 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:57.067212 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a9631-f039-4cc0-8b89-cb9c00a36660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:57.068010 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a9631-f039-4cc0-8b89-cb9c00a36660 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:57.068292 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a9631-f039-4cc0-8b89-cb9c00a36660 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:57.068562 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a9631-f039-4cc0-8b89-cb9c00a36660 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:57.080522 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232a9631-f039-4cc0-8b89-cb9c00a36660 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:57.088343 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-232a9631-f039-4cc0-8b89-cb9c00a36660 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:57.088343 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:57.088343 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:57.088343 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:57.088343 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:57.088343 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:57.088343 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:57.088343 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:57.088343 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:57.088343 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:57.088343 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:57.088343 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:57.088343 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:57.088343 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:57.088343 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:57.088343 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:57.089317 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:57.089317 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:57.089317 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:57.089317 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:57.089317 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:57.089317 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:57.089317 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:57.089317 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:57.089317 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:57.089317 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:57.089317 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:57.089317 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:57.089317 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:57.089317 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:57.089317 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:57.089317 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:57.090182 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:57.090182 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:57.090182 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:57.090182 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:57.090182 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:57.090182 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:57.090182 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:57.090182 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:57.090182 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:57.090182 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:57.090182 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:58:57.090182 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:57.090182 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 428/862] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jun 20 05:58:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:57.096153 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c009a64a-5a36-405f-a63a-9a491cf2fe9b None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:57.200935 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c009a64a-5a36-405f-a63a-9a491cf2fe9b None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:57.239436 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1e537d-b812-4da3-b4b6-a1d888b48a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:57.240119 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e537d-b812-4da3-b4b6-a1d888b48a16 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:57.240401 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e537d-b812-4da3-b4b6-a1d888b48a16 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:57.240674 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e537d-b812-4da3-b4b6-a1d888b48a16 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:57.241532 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1e537d-b812-4da3-b4b6-a1d888b48a16 None admin] RBAC: Adding query filter params (name=service) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:57.241837 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1e537d-b812-4da3-b4b6-a1d888b48a16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:57.243209 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1e537d-b812-4da3-b4b6-a1d888b48a16 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:57.253422 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 435/863] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jun 20 05:58:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:57.266909 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a9631-f039-4cc0-8b89-cb9c00a36660 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:57.498630 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a9631-f039-4cc0-8b89-cb9c00a36660 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:57.533312 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae903d-a248-4793-aac9-0b81abc93a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:57.534440 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae903d-a248-4793-aac9-0b81abc93a0f None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:57.534926 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae903d-a248-4793-aac9-0b81abc93a0f None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:57.535420 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae903d-a248-4793-aac9-0b81abc93a0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:57.546181 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baae903d-a248-4793-aac9-0b81abc93a0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:57.548510 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baae903d-a248-4793-aac9-0b81abc93a0f None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:57.566544 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-baae903d-a248-4793-aac9-0b81abc93a0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:57.566544 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:57.566544 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:57.566544 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:57.566544 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:57.566544 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:57.566544 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:57.566544 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:57.566544 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:57.566544 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:57.566544 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:57.566544 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:57.566544 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:57.566544 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:57.566544 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:57.567441 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:57.567441 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:57.567441 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:57.567441 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:57.567441 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:57.567441 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:57.567441 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:57.567441 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:57.567441 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:57.567441 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:57.567441 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:57.567441 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:57.567441 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:57.567441 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:57.567441 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:57.567441 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:57.567441 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:57.568434 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:57.568434 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:57.568434 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:57.568434 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:57.570629 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 429/864] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:57.576780 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1e537d-b812-4da3-b4b6-a1d888b48a16 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:57.580509 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:57.689545 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1e537d-b812-4da3-b4b6-a1d888b48a16 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:57.725570 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba04c2-a1a7-4e08-a80e-972c5fa5fe7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:57.726146 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba04c2-a1a7-4e08-a80e-972c5fa5fe7f None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:57.726433 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba04c2-a1a7-4e08-a80e-972c5fa5fe7f None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:57.726711 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba04c2-a1a7-4e08-a80e-972c5fa5fe7f None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:57.727434 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ba04c2-a1a7-4e08-a80e-972c5fa5fe7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:57.727740 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ba04c2-a1a7-4e08-a80e-972c5fa5fe7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:57.729141 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ba04c2-a1a7-4e08-a80e-972c5fa5fe7f None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:57.741758 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 436/865] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:57.747373 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae903d-a248-4793-aac9-0b81abc93a0f None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:57.764186 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:57.863383 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae903d-a248-4793-aac9-0b81abc93a0f None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:57.900962 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c9b3c-253f-49d2-8d32-da50e5ca777a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:57.901779 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c9b3c-253f-49d2-8d32-da50e5ca777a None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:57.902062 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c9b3c-253f-49d2-8d32-da50e5ca777a None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:57.902336 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c9b3c-253f-49d2-8d32-da50e5ca777a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:57.910444 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342c9b3c-253f-49d2-8d32-da50e5ca777a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:57.911991 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342c9b3c-253f-49d2-8d32-da50e5ca777a None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:57.927235 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-342c9b3c-253f-49d2-8d32-da50e5ca777a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 05:58:57.927235 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:57.927235 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:57.927235 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:57.927235 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:57.927235 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:57.927235 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:57.927235 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:57.927235 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:57.927235 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:57.927235 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:57.927235 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:57.927235 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:58:57.927235 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:58:57.927235 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:58:57.927235 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:58:57.928196 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:57.928196 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:57.928196 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:58:57.928196 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:57.928196 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:58:57.928196 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:57.928196 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:57.928196 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:57.928196 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:57.928196 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:57.928196 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:57.928196 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:57.928196 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:57.928196 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:57.928196 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:57.928196 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:57.928196 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:57.928196 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:57.929482 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:57.929482 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:57.929482 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:58:57.929482 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:58:57.929482 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:58:57.929482 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:58:57.929482 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:58:57.929482 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:58:57.929482 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 05:58:57.929482 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:57.929482 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 430/866] 10.222.0.39 () {56 vars in 1117 bytes} [Mon Jun 20 05:58:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:57.936002 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba04c2-a1a7-4e08-a80e-972c5fa5fe7f None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:58.002387 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:58.048070 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba04c2-a1a7-4e08-a80e-972c5fa5fe7f None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:58.083156 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b6353a-5abe-420f-a658-ae4b3940d2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:58.083882 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b6353a-5abe-420f-a658-ae4b3940d2e2 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:58.084166 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b6353a-5abe-420f-a658-ae4b3940d2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:58.084491 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b6353a-5abe-420f-a658-ae4b3940d2e2 None admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:58.085365 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b6353a-5abe-420f-a658-ae4b3940d2e2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:58.085676 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b6353a-5abe-420f-a658-ae4b3940d2e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:58.087098 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b6353a-5abe-420f-a658-ae4b3940d2e2 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:58.105323 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 437/867] 10.222.0.39 () {56 vars in 1149 bytes} [Mon Jun 20 05:58:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:58.111720 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c9b3c-253f-49d2-8d32-da50e5ca777a None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:58.185457 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:58.222014 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c9b3c-253f-49d2-8d32-da50e5ca777a None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:58.259797 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f434f03-1f5b-4ece-9c60-f6ad9be556ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:58.260368 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f434f03-1f5b-4ece-9c60-f6ad9be556ac None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:58.260651 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f434f03-1f5b-4ece-9c60-f6ad9be556ac None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:58.260962 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f434f03-1f5b-4ece-9c60-f6ad9be556ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:58.316028 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb61aa-dcbd-48dd-9dd5-159c1772ecb6 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:58.316681 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb61aa-dcbd-48dd-9dd5-159c1772ecb6 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:58.317202 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb61aa-dcbd-48dd-9dd5-159c1772ecb6 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:58.320015 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 438/868] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:58:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:58:58.324659 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e5bbc-ab07-4a94-a27d-128074ef00f5 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:58.325232 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e5bbc-ab07-4a94-a27d-128074ef00f5 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:58.325725 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e5bbc-ab07-4a94-a27d-128074ef00f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:58.334734 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f434f03-1f5b-4ece-9c60-f6ad9be556ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:58.336198 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f434f03-1f5b-4ece-9c60-f6ad9be556ac None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:58.345867 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-f60e5bbc-ab07-4a94-a27d-128074ef00f5 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:58.347341 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-f60e5bbc-ab07-4a94-a27d-128074ef00f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:58.436733 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:58.439312 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 439/869] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:58 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 05:58:58.465080 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e5bbc-ab07-4a94-a27d-128074ef00f5 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:58.489881 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 431/870] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 05:58:58 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 05:58:58.496354 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f434f03-1f5b-4ece-9c60-f6ad9be556ac None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:58.534728 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:58.588208 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e5bbc-ab07-4a94-a27d-128074ef00f5 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:58.628089 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f434f03-1f5b-4ece-9c60-f6ad9be556ac None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:58.635420 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e60c7-e286-473d-acea-22de0b56a091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:58.636094 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e60c7-e286-473d-acea-22de0b56a091 None admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:58.636376 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e60c7-e286-473d-acea-22de0b56a091 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:58.636651 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e60c7-e286-473d-acea-22de0b56a091 None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:58.637409 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222e60c7-e286-473d-acea-22de0b56a091 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:58.638767 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222e60c7-e286-473d-acea-22de0b56a091 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:58.653931 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 440/871] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Jun 20 05:58:58 2022] POST /identity/v3/services => generated 269 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 05:58:58.662326 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbfd056-5919-4e24-9b3a-54ba46ba6bd7 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:58.662678 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbfd056-5919-4e24-9b3a-54ba46ba6bd7 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:58.662960 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbfd056-5919-4e24-9b3a-54ba46ba6bd7 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:58.668803 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 441/872] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:58:58 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:58.672153 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622396f-2646-467e-a889-2cb0294b5d74 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:58.672647 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622396f-2646-467e-a889-2cb0294b5d74 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:58.672890 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622396f-2646-467e-a889-2cb0294b5d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:58.683825 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc6f1a-7d4e-412c-a578-d724538e096c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:58.685352 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc6f1a-7d4e-412c-a578-d724538e096c None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:58.685352 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc6f1a-7d4e-412c-a578-d724538e096c None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:58.685352 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc6f1a-7d4e-412c-a578-d724538e096c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:58.702193 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc6f1a-7d4e-412c-a578-d724538e096c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:58.703743 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-e622396f-2646-467e-a889-2cb0294b5d74 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:58.704673 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc6f1a-7d4e-412c-a578-d724538e096c None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:58.705982 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-e622396f-2646-467e-a889-2cb0294b5d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:58.724875 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-70fc6f1a-7d4e-412c-a578-d724538e096c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:58.724875 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:58.724875 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:58.724875 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:58.724875 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:58.724875 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:58.724875 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:58.724875 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:58.724875 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:58.724875 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:58.724875 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:58.724875 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:58.724875 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:58.724875 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:58.724875 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:58.725875 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:58.725875 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:58.725875 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:58.725875 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:58.725875 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:58.725875 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:58.725875 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:58.725875 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:58.725875 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:58.725875 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:58.725875 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:58.725875 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:58.725875 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:58.725875 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:58.725875 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:58.725875 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:58.725875 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:58.726801 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:58.726801 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:58.726801 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:58.726801 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:58.726801 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 432/873] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:58:58.731791 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc6f1a-7d4e-412c-a578-d724538e096c None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:58.754808 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:58.803075 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 442/874] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:58 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 05:58:58.826743 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e622396f-2646-467e-a889-2cb0294b5d74 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:58.871040 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc6f1a-7d4e-412c-a578-d724538e096c None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:58.885146 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:58.914339 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c642dc0f-54c6-4000-9042-a267b08a76db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:58.915369 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642dc0f-54c6-4000-9042-a267b08a76db None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:58.915661 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642dc0f-54c6-4000-9042-a267b08a76db None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:58.915938 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642dc0f-54c6-4000-9042-a267b08a76db None admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:58.916862 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c642dc0f-54c6-4000-9042-a267b08a76db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:58.917946 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c642dc0f-54c6-4000-9042-a267b08a76db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:58.919356 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c642dc0f-54c6-4000-9042-a267b08a76db None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:58.931132 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 433/875] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:58.932419 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c12007-5791-4f38-a327-e2e8431b19fc None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:58.932733 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c12007-5791-4f38-a327-e2e8431b19fc None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:58.933005 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c12007-5791-4f38-a327-e2e8431b19fc None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:58.934396 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 434/876] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:58.936347 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c12007-5791-4f38-a327-e2e8431b19fc None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:58.958397 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e622396f-2646-467e-a889-2cb0294b5d74 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:59.001782 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b4c1e-dcfa-4801-b219-d3f2f58f6679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:59.002590 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b4c1e-dcfa-4801-b219-d3f2f58f6679 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:59.002868 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b4c1e-dcfa-4801-b219-d3f2f58f6679 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:59.003139 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b4c1e-dcfa-4801-b219-d3f2f58f6679 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:59.003793 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1b4c1e-dcfa-4801-b219-d3f2f58f6679 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:59.005192 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1b4c1e-dcfa-4801-b219-d3f2f58f6679 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:59.018551 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-ef1b4c1e-dcfa-4801-b219-d3f2f58f6679 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 05:58:59.018551 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:59.018551 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:58:59.018551 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:58:59.018551 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:58:59.018551 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:58:59.018551 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:58:59.018551 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:58:59.018551 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 05:58:59.018551 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:59.018551 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:58:59.018551 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:59.018551 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:59.018551 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:59.018551 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:59.018551 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:59.018551 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:59.019699 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:59.019699 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:59.019699 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:59.019699 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:59.019699 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:59.019699 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:59.019699 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:58:59.019699 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:58:59.019699 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:58:59.019699 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:58:59.019699 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:59.019699 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:59.019699 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:59.019699 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:59.019699 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:59.019699 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:59.020629 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:59.020629 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:59.020629 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:59.020629 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:59.020629 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:59.020629 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:59.020629 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:59.020629 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:59.020629 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:59.020629 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:59.020629 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:58:59.020629 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:58:59.020629 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 05:58:59.020629 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:59.020629 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 443/877] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jun 20 05:58:58 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:58:59.021769 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d83fcd-5914-42aa-80ca-023e42143f51 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:59.021769 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d83fcd-5914-42aa-80ca-023e42143f51 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:59.021769 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d83fcd-5914-42aa-80ca-023e42143f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:59.026743 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:59.039201 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-35d83fcd-5914-42aa-80ca-023e42143f51 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:59.040392 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-35d83fcd-5914-42aa-80ca-023e42143f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:59.052348 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c12007-5791-4f38-a327-e2e8431b19fc None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:59.089674 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db4437-fe63-42a6-acb3-fc0aed871e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:59.090371 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db4437-fe63-42a6-acb3-fc0aed871e76 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:59.090649 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db4437-fe63-42a6-acb3-fc0aed871e76 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:59.090919 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db4437-fe63-42a6-acb3-fc0aed871e76 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:59.098830 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20db4437-fe63-42a6-acb3-fc0aed871e76 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:59.100262 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20db4437-fe63-42a6-acb3-fc0aed871e76 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:59.108744 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 444/878] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:59 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:58:59.116744 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d83fcd-5914-42aa-80ca-023e42143f51 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:59.116881 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-20db4437-fe63-42a6-acb3-fc0aed871e76 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:59.116881 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:59.116881 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:59.116881 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:59.116881 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:59.116881 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:59.116881 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:59.116881 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:59.116881 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:59.116881 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:59.116881 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:59.116881 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:59.116881 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:58:59.116881 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:58:59.116881 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:58:59.117800 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:58:59.117800 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:59.117800 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:59.117800 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:59.117800 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:59.117800 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:59.117800 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:59.117800 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:59.117800 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:59.117800 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:59.117800 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:59.117800 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:59.117800 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:59.117800 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:59.117800 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:59.117800 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:59.117800 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:59.118702 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:58:59.118702 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:58:59.118702 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:58:59.118702 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:58:59.118702 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:58:59.118702 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:58:59.118702 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:59.118702 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:58:59.118702 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 435/879] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:58:59.122607 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db4437-fe63-42a6-acb3-fc0aed871e76 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:59.158758 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:59.230746 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db4437-fe63-42a6-acb3-fc0aed871e76 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:59.231089 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d83fcd-5914-42aa-80ca-023e42143f51 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:59.267457 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6bed8-e0c8-45b1-a81d-3d955800a90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:59.268125 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6bed8-e0c8-45b1-a81d-3d955800a90c None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:59.268409 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6bed8-e0c8-45b1-a81d-3d955800a90c None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:59.268687 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6bed8-e0c8-45b1-a81d-3d955800a90c None admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:59.269510 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e6bed8-e0c8-45b1-a81d-3d955800a90c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:59.269612 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fef0f3-93d9-42cc-a017-324c742fa2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:59.269825 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e6bed8-e0c8-45b1-a81d-3d955800a90c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:59.270217 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fef0f3-93d9-42cc-a017-324c742fa2c2 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:59.270499 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fef0f3-93d9-42cc-a017-324c742fa2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:59.270774 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fef0f3-93d9-42cc-a017-324c742fa2c2 None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:59.271257 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e6bed8-e0c8-45b1-a81d-3d955800a90c None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:59.271479 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fef0f3-93d9-42cc-a017-324c742fa2c2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:59.271784 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fef0f3-93d9-42cc-a017-324c742fa2c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:59.273404 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fef0f3-93d9-42cc-a017-324c742fa2c2 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:59.278075 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:59.284215 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 445/880] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jun 20 05:58:59 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:59.284215 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fef0f3-93d9-42cc-a017-324c742fa2c2 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:59.284456 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 436/881] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jun 20 05:58:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:58:59.285238 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6bed8-e0c8-45b1-a81d-3d955800a90c None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:59.389741 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6bed8-e0c8-45b1-a81d-3d955800a90c None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:59.400372 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:59.403882 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fef0f3-93d9-42cc-a017-324c742fa2c2 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:59.427641 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe0f9d-7e19-45ab-bf4c-bf033068d29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:59.428265 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe0f9d-7e19-45ab-bf4c-bf033068d29d None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:59.428552 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe0f9d-7e19-45ab-bf4c-bf033068d29d None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:59.428872 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe0f9d-7e19-45ab-bf4c-bf033068d29d None admin] PATH_INFO: `/v3/services` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:59.429744 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fe0f9d-7e19-45ab-bf4c-bf033068d29d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:59.429869 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fe0f9d-7e19-45ab-bf4c-bf033068d29d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:59.431216 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fe0f9d-7e19-45ab-bf4c-bf033068d29d None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:59.443672 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 437/882] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jun 20 05:58:59 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:59.443672 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe0f9d-7e19-45ab-bf4c-bf033068d29d None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:59.448080 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cd2845-b883-46f1-861b-ff4c77dfaba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:59.449626 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd2845-b883-46f1-861b-ff4c77dfaba6 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:59.449626 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd2845-b883-46f1-861b-ff4c77dfaba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:59.449823 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd2845-b883-46f1-861b-ff4c77dfaba6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:59.450353 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cd2845-b883-46f1-861b-ff4c77dfaba6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:59.451719 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cd2845-b883-46f1-861b-ff4c77dfaba6 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:59.465159 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-a0cd2845-b883-46f1-861b-ff4c77dfaba6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 05:58:59.465159 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:59.465159 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:58:59.465159 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:58:59.465159 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:58:59.465159 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:58:59.465159 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:58:59.465159 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:58:59.465159 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 05:58:59.465159 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:59.465159 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:58:59.465159 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:59.465159 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:59.465159 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:59.465159 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:59.465159 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:59.465159 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:59.466362 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:59.466362 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:59.466362 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:59.466362 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:59.466362 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:59.466362 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:59.466362 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:58:59.466362 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:58:59.466362 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:58:59.466362 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:58:59.466362 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:59.466362 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:59.466362 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:59.466362 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:59.466362 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:59.466362 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:59.467204 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:59.467204 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:59.467204 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:59.467204 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:59.467204 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:59.467204 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:59.467204 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:59.467204 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:59.467204 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:59.467204 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:59.467204 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:58:59.467204 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:58:59.467204 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 05:58:59.467204 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:58:59.467204 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 446/883] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Jun 20 05:58:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:59.468001 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cd2845-b883-46f1-861b-ff4c77dfaba6 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:59.521241 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:59.564463 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe0f9d-7e19-45ab-bf4c-bf033068d29d None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:59.576396 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cd2845-b883-46f1-861b-ff4c77dfaba6 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:59.599950 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f32225-d765-41a3-81c4-f87203cd4051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:59.600601 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f32225-d765-41a3-81c4-f87203cd4051 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:59.600916 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f32225-d765-41a3-81c4-f87203cd4051 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:59.601205 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f32225-d765-41a3-81c4-f87203cd4051 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:59.602021 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f32225-d765-41a3-81c4-f87203cd4051 None admin] RBAC: Adding query filter params (role.id=b7e86f43512c42bfa0d069e3e6fb97c5, scope.project.id=b349043204b34d1794818184ffe6505c, user.id=8c0f131484cb48d289cae1f473ec2fbc) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:59.602431 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f32225-d765-41a3-81c4-f87203cd4051 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:59.603857 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f32225-d765-41a3-81c4-f87203cd4051 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:59.611995 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604377fb-e671-416e-afc4-73001d316932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:59.612654 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604377fb-e671-416e-afc4-73001d316932 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:59.612971 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604377fb-e671-416e-afc4-73001d316932 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:59.613254 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604377fb-e671-416e-afc4-73001d316932 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:59.614056 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604377fb-e671-416e-afc4-73001d316932 None admin] RBAC: Adding query filter params (interface=public, service_id=6ca29d4386ed4488844b1343060eb1b0, region_id=RegionOne) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:59.614375 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604377fb-e671-416e-afc4-73001d316932 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:59.615770 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604377fb-e671-416e-afc4-73001d316932 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:59.621058 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 438/884] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jun 20 05:58:59 2022] GET /identity/v3/role_assignments?user.id=8c0f131484cb48d289cae1f473ec2fbc&scope.project.id=b349043204b34d1794818184ffe6505c&role.id=b7e86f43512c42bfa0d069e3e6fb97c5 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:59.626879 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 447/885] 10.222.0.39 () {56 vars in 1251 bytes} [Mon Jun 20 05:58:59 2022] GET /identity/v3/endpoints?service_id=6ca29d4386ed4488844b1343060eb1b0&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:59.627098 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f32225-d765-41a3-81c4-f87203cd4051 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:59.628061 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604377fb-e671-416e-afc4-73001d316932 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:59.668419 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:59.763063 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604377fb-e671-416e-afc4-73001d316932 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:59.763610 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f32225-d765-41a3-81c4-f87203cd4051 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:59.793156 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:59.803989 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba4c09-59a9-4a02-ab5d-66e74f92adac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:59.804843 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba4c09-59a9-4a02-ab5d-66e74f92adac None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:59.805230 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba4c09-59a9-4a02-ab5d-66e74f92adac None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:59.805639 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba4c09-59a9-4a02-ab5d-66e74f92adac None admin] PATH_INFO: `/v3/services` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:59.806265 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb11e65-842c-4514-96c9-f6410ef62635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:59.807403 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb11e65-842c-4514-96c9-f6410ef62635 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:59.807403 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb11e65-842c-4514-96c9-f6410ef62635 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:59.807587 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ba4c09-59a9-4a02-ab5d-66e74f92adac None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:59.807673 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb11e65-842c-4514-96c9-f6410ef62635 None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:59.807859 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ba4c09-59a9-4a02-ab5d-66e74f92adac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:59.808165 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb11e65-842c-4514-96c9-f6410ef62635 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:59.809577 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ba4c09-59a9-4a02-ab5d-66e74f92adac None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:59.809690 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb11e65-842c-4514-96c9-f6410ef62635 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:59.818208 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 439/886] 10.222.0.39 () {56 vars in 1122 bytes} [Mon Jun 20 05:58:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:59.820888 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 448/887] 10.222.0.39 () {56 vars in 1087 bytes} [Mon Jun 20 05:58:59 2022] GET /identity/v3/services => generated 1268 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 05:58:59.823731 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba4c09-59a9-4a02-ab5d-66e74f92adac None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:59.943762 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba4c09-59a9-4a02-ab5d-66e74f92adac None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:59.981382 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740a018-7a24-47d2-8ac2-05ae780b492f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:59.982049 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740a018-7a24-47d2-8ac2-05ae780b492f None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:59.982329 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740a018-7a24-47d2-8ac2-05ae780b492f None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:59.982606 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740a018-7a24-47d2-8ac2-05ae780b492f None admin] PATH_INFO: `/v3/services` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:59.983311 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a740a018-7a24-47d2-8ac2-05ae780b492f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:59.983614 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a740a018-7a24-47d2-8ac2-05ae780b492f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:59.985501 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a740a018-7a24-47d2-8ac2-05ae780b492f None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:59.990354 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 440/888] 10.222.0.39 () {56 vars in 1122 bytes} [Mon Jun 20 05:58:59 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:00.794175 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bbc1f-8c68-482a-9351-e700b9107345 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:00.794667 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bbc1f-8c68-482a-9351-e700b9107345 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:00.794667 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bbc1f-8c68-482a-9351-e700b9107345 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:00.796241 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 449/889] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:59:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:00.802010 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b40a3d-3dfc-418f-a216-22b114f1fed8 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:00.802301 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b40a3d-3dfc-418f-a216-22b114f1fed8 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:00.802579 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b40a3d-3dfc-418f-a216-22b114f1fed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:00.819863 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-a7b40a3d-3dfc-418f-a216-22b114f1fed8 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:00.821086 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-a7b40a3d-3dfc-418f-a216-22b114f1fed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:00.880125 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:00.900316 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 441/890] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:00 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:59:00.922882 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0bbc1f-8c68-482a-9351-e700b9107345 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:01.026317 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:01.036684 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0bbc1f-8c68-482a-9351-e700b9107345 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:01.072112 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b8560d-0fef-448c-a902-9169575c3785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:01.072871 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8560d-0fef-448c-a902-9169575c3785 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:01.073153 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8560d-0fef-448c-a902-9169575c3785 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:01.073424 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8560d-0fef-448c-a902-9169575c3785 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:01.074331 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b8560d-0fef-448c-a902-9169575c3785 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:01.075687 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b8560d-0fef-448c-a902-9169575c3785 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:01.088330 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-05b8560d-0fef-448c-a902-9169575c3785 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 05:59:01.088330 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:01.088330 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:59:01.088330 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:59:01.088330 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:59:01.088330 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:59:01.088330 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:59:01.088330 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:59:01.088330 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 05:59:01.088330 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:01.088330 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:59:01.088330 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:01.088330 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:01.088330 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:01.088330 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:01.088330 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:01.089368 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:01.089368 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:01.089368 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:01.089368 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:01.089368 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:01.089368 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:01.089368 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:01.089368 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:59:01.089368 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:59:01.089368 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:59:01.089368 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:59:01.089368 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:01.089368 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:01.089368 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:01.089368 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:01.089368 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:01.090442 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:01.090442 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:01.090442 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:01.090442 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:01.090442 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:01.090442 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:01.090442 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:01.090442 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:01.090442 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:01.090442 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:01.090442 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:01.090442 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:59:01.090442 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:59:01.090442 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 05:59:01.090442 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:01.090442 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 450/891] 10.222.0.39 () {56 vars in 1132 bytes} [Mon Jun 20 05:59:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:01.095895 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b40a3d-3dfc-418f-a216-22b114f1fed8 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:01.207991 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b40a3d-3dfc-418f-a216-22b114f1fed8 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:01.245033 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c648cf-ddb3-4a26-a840-ca3d5cfb1fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:01.245779 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c648cf-ddb3-4a26-a840-ca3d5cfb1fe4 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:01.246108 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c648cf-ddb3-4a26-a840-ca3d5cfb1fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:01.246391 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c648cf-ddb3-4a26-a840-ca3d5cfb1fe4 None admin] PATH_INFO: `/v3/services` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:01.247097 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c648cf-ddb3-4a26-a840-ca3d5cfb1fe4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:01.247405 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c648cf-ddb3-4a26-a840-ca3d5cfb1fe4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:01.248803 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c648cf-ddb3-4a26-a840-ca3d5cfb1fe4 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:01.254925 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 442/892] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Jun 20 05:59:01 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:01.260179 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b8560d-0fef-448c-a902-9169575c3785 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:01.369434 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b8560d-0fef-448c-a902-9169575c3785 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:01.405450 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5452fcc-c4ab-4228-925e-08e34b86b39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:01.406788 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5452fcc-c4ab-4228-925e-08e34b86b39a None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:01.407078 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5452fcc-c4ab-4228-925e-08e34b86b39a None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:01.407358 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5452fcc-c4ab-4228-925e-08e34b86b39a None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:01.408071 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5452fcc-c4ab-4228-925e-08e34b86b39a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:01.408381 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5452fcc-c4ab-4228-925e-08e34b86b39a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:01.409786 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5452fcc-c4ab-4228-925e-08e34b86b39a None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:01.415232 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 451/893] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Jun 20 05:59:01 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:01.420628 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c648cf-ddb3-4a26-a840-ca3d5cfb1fe4 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:01.478836 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:01.537245 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c648cf-ddb3-4a26-a840-ca3d5cfb1fe4 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:01.575060 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06572378-43f5-4ccf-97bb-d10eb36ce469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:01.575724 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06572378-43f5-4ccf-97bb-d10eb36ce469 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:01.576006 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06572378-43f5-4ccf-97bb-d10eb36ce469 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:01.576281 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06572378-43f5-4ccf-97bb-d10eb36ce469 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:01.577168 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06572378-43f5-4ccf-97bb-d10eb36ce469 None admin] RBAC: Adding query filter params (interface=public, service_id=280ddc250cd74d9fae467152d81afd3a, region_id=RegionOne) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:01.577480 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06572378-43f5-4ccf-97bb-d10eb36ce469 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:01.580099 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06572378-43f5-4ccf-97bb-d10eb36ce469 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:01.586082 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 443/894] 10.222.0.39 () {56 vars in 1251 bytes} [Mon Jun 20 05:59:01 2022] GET /identity/v3/endpoints?service_id=280ddc250cd74d9fae467152d81afd3a&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:01.593905 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5452fcc-c4ab-4228-925e-08e34b86b39a None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:01.616957 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:01.704433 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5452fcc-c4ab-4228-925e-08e34b86b39a None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:01.739814 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe70942-dfd4-497c-9381-f5e1c63c9c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:01.740484 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe70942-dfd4-497c-9381-f5e1c63c9c63 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:01.740792 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe70942-dfd4-497c-9381-f5e1c63c9c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:01.741069 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe70942-dfd4-497c-9381-f5e1c63c9c63 None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:01.741752 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe70942-dfd4-497c-9381-f5e1c63c9c63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:01.743102 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe70942-dfd4-497c-9381-f5e1c63c9c63 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:01.749189 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 452/895] 10.222.0.39 () {56 vars in 1087 bytes} [Mon Jun 20 05:59:01 2022] GET /identity/v3/services => generated 1268 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 05:59:01.921031 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45063c6b-28e9-4997-a49a-5fc00aa70eb2 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:01.921905 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45063c6b-28e9-4997-a49a-5fc00aa70eb2 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:01.922147 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45063c6b-28e9-4997-a49a-5fc00aa70eb2 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:01.923828 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 444/896] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:59:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:01.928776 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cfa5d1-8741-48d1-8575-08f43515ec5d None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:01.929236 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cfa5d1-8741-48d1-8575-08f43515ec5d None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:01.929320 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cfa5d1-8741-48d1-8575-08f43515ec5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:01.948276 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-24cfa5d1-8741-48d1-8575-08f43515ec5d None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:01.949749 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-24cfa5d1-8741-48d1-8575-08f43515ec5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:02.019649 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 453/897] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:01 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:59:02.041260 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae8514-0d9c-47e8-8cde-668fbd805d21 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:02.041551 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae8514-0d9c-47e8-8cde-668fbd805d21 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:02.041867 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae8514-0d9c-47e8-8cde-668fbd805d21 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:02.041979 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cfa5d1-8741-48d1-8575-08f43515ec5d None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:02.043518 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 445/898] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:59:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:02.049297 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a1659-4169-4597-b03e-eacff6afc2c0 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:02.049627 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a1659-4169-4597-b03e-eacff6afc2c0 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:02.049929 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a1659-4169-4597-b03e-eacff6afc2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:02.057999 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:02.069715 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-df4a1659-4169-4597-b03e-eacff6afc2c0 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:02.071624 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-df4a1659-4169-4597-b03e-eacff6afc2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:02.150847 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cfa5d1-8741-48d1-8575-08f43515ec5d None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:02.151950 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 446/899] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:02 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 05:59:02.153296 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23578425-6c42-4e11-a606-baa7cf45847e None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:02.153580 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23578425-6c42-4e11-a606-baa7cf45847e None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:02.153848 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23578425-6c42-4e11-a606-baa7cf45847e None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:02.156782 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 447/900] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:59:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:02.160310 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62571f-e1b3-46a4-9e4c-e9bfca92fe53 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:02.160587 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62571f-e1b3-46a4-9e4c-e9bfca92fe53 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:02.160887 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62571f-e1b3-46a4-9e4c-e9bfca92fe53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:02.178532 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-8d62571f-e1b3-46a4-9e4c-e9bfca92fe53 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:02.180142 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-8d62571f-e1b3-46a4-9e4c-e9bfca92fe53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:02.198522 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f92e29f-5bd7-4252-b4b7-ed29c09c8bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:02.199602 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92e29f-5bd7-4252-b4b7-ed29c09c8bc6 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:02.199881 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92e29f-5bd7-4252-b4b7-ed29c09c8bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:02.200150 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92e29f-5bd7-4252-b4b7-ed29c09c8bc6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:02.200835 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f92e29f-5bd7-4252-b4b7-ed29c09c8bc6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:02.202189 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f92e29f-5bd7-4252-b4b7-ed29c09c8bc6 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:02.215434 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-1f92e29f-5bd7-4252-b4b7-ed29c09c8bc6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 05:59:02.215434 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:02.215434 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:59:02.215434 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:59:02.215434 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:59:02.215434 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:59:02.215434 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:59:02.215434 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:59:02.215434 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 05:59:02.215434 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:02.215434 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:59:02.215434 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:02.215434 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:02.215434 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:02.215434 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:02.215434 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:02.215434 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:02.216473 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:02.216473 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:02.216473 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:02.216473 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:02.216473 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:02.216473 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:02.216473 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:59:02.216473 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:59:02.216473 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:59:02.216473 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:59:02.216473 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:02.216473 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:02.216473 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:02.216473 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:02.216473 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:02.216473 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:02.217991 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:02.217991 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:02.217991 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:02.217991 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:02.217991 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:02.217991 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:02.217991 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:02.217991 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:02.217991 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:02.217991 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:02.217991 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:59:02.217991 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:59:02.217991 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 05:59:02.217991 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:02.217991 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 454/901] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jun 20 05:59:02 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:59:02.219473 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f92e29f-5bd7-4252-b4b7-ed29c09c8bc6 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:02.229767 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:02.267121 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 448/902] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:02 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 05:59:02.268282 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d62571f-e1b3-46a4-9e4c-e9bfca92fe53 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:02.319675 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:02.344275 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f92e29f-5bd7-4252-b4b7-ed29c09c8bc6 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:02.378484 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d62571f-e1b3-46a4-9e4c-e9bfca92fe53 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:02.380721 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b3cf77-b487-48a7-9ec6-5e5c72eb974b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:02.381572 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3cf77-b487-48a7-9ec6-5e5c72eb974b None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:02.381876 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3cf77-b487-48a7-9ec6-5e5c72eb974b None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:02.382125 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3cf77-b487-48a7-9ec6-5e5c72eb974b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:02.393932 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b3cf77-b487-48a7-9ec6-5e5c72eb974b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:59:02.402221 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-89b3cf77-b487-48a7-9ec6-5e5c72eb974b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 05:59:02.402221 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:02.402221 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:02.402221 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:02.402221 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:02.402221 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:02.402221 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:02.402221 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:02.402221 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:02.402221 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:02.402221 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:02.402221 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:02.402221 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:59:02.402221 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:59:02.402221 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:59:02.402221 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:59:02.403160 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:59:02.403160 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:59:02.403160 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:59:02.403160 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:59:02.403160 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:02.403160 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:02.403160 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:02.403160 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:02.403160 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:02.403160 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:02.403160 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:02.403160 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:02.403160 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:02.403160 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:02.403160 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:02.403160 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:02.403991 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:02.403991 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:02.403991 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:02.403991 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:02.403991 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:59:02.403991 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:59:02.403991 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:59:02.403991 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:59:02.403991 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:59:02.403991 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:59:02.403991 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 05:59:02.403991 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:02.403991 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 455/903] 10.222.0.39 () {56 vars in 1120 bytes} [Mon Jun 20 05:59:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:02.404731 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b3cf77-b487-48a7-9ec6-5e5c72eb974b None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:02.418202 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165d59f-8675-4b30-803e-23434a4abd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:02.418988 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165d59f-8675-4b30-803e-23434a4abd51 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:02.419271 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165d59f-8675-4b30-803e-23434a4abd51 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:02.419547 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165d59f-8675-4b30-803e-23434a4abd51 None admin] PATH_INFO: `/v3/services` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:02.420373 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1165d59f-8675-4b30-803e-23434a4abd51 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:02.420680 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1165d59f-8675-4b30-803e-23434a4abd51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:02.423250 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1165d59f-8675-4b30-803e-23434a4abd51 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:02.436538 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 449/904] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jun 20 05:59:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:02.436538 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165d59f-8675-4b30-803e-23434a4abd51 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:02.478050 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:02.539215 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b3cf77-b487-48a7-9ec6-5e5c72eb974b None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:02.550554 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165d59f-8675-4b30-803e-23434a4abd51 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:02.577309 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5090b5-f0e8-4a11-ad86-b662835475ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:02.577950 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5090b5-f0e8-4a11-ad86-b662835475ef None admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:02.578230 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5090b5-f0e8-4a11-ad86-b662835475ef None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:02.578507 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5090b5-f0e8-4a11-ad86-b662835475ef None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:02.579232 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5090b5-f0e8-4a11-ad86-b662835475ef None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:02.580595 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5090b5-f0e8-4a11-ad86-b662835475ef None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:02.587762 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2196b684-fe2c-45c4-9296-1eb07adffeb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:02.588271 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:02.588492 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196b684-fe2c-45c4-9296-1eb07adffeb1 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:02.589179 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196b684-fe2c-45c4-9296-1eb07adffeb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:02.589443 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196b684-fe2c-45c4-9296-1eb07adffeb1 None admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:02.590187 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2196b684-fe2c-45c4-9296-1eb07adffeb1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:02.590522 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2196b684-fe2c-45c4-9296-1eb07adffeb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:02.592010 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2196b684-fe2c-45c4-9296-1eb07adffeb1 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:02.600880 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 456/905] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Jun 20 05:59:02 2022] POST /identity/v3/services => generated 241 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:59:02.602195 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5090b5-f0e8-4a11-ad86-b662835475ef None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:02.618896 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 450/906] 10.222.0.39 () {56 vars in 1115 bytes} [Mon Jun 20 05:59:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:02.620341 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2196b684-fe2c-45c4-9296-1eb07adffeb1 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:02.729569 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5090b5-f0e8-4a11-ad86-b662835475ef None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:02.774232 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:02.775496 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77785ac-7daf-49d2-9234-33fe1516a07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:02.776338 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77785ac-7daf-49d2-9234-33fe1516a07a None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:02.776626 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77785ac-7daf-49d2-9234-33fe1516a07a None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:02.777039 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77785ac-7daf-49d2-9234-33fe1516a07a None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:02.777651 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77785ac-7daf-49d2-9234-33fe1516a07a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:02.778008 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77785ac-7daf-49d2-9234-33fe1516a07a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:02.779382 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77785ac-7daf-49d2-9234-33fe1516a07a None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:02.779695 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2196b684-fe2c-45c4-9296-1eb07adffeb1 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:02.784860 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 457/907] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jun 20 05:59:02 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:02.791431 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77785ac-7daf-49d2-9234-33fe1516a07a None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:02.829413 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef66e1d-6a51-4e52-8a64-1d3c5211c766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:02.829622 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef66e1d-6a51-4e52-8a64-1d3c5211c766 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:02.829887 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef66e1d-6a51-4e52-8a64-1d3c5211c766 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:02.830163 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef66e1d-6a51-4e52-8a64-1d3c5211c766 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:02.842052 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef66e1d-6a51-4e52-8a64-1d3c5211c766 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:02.844922 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef66e1d-6a51-4e52-8a64-1d3c5211c766 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:02.863263 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:02.864994 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-5ef66e1d-6a51-4e52-8a64-1d3c5211c766 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:59:02.864994 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:02.864994 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:02.864994 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:02.864994 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:02.864994 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:02.864994 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:02.864994 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:02.864994 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:02.864994 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:02.864994 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:02.864994 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:02.864994 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:59:02.864994 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:59:02.864994 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:59:02.867169 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:59:02.867169 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:02.867169 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:02.867169 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:02.867169 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:02.867169 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:02.867169 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:02.867169 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:02.867169 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:02.867169 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:02.867169 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:02.867169 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:02.867169 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:02.867169 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:02.867169 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:02.867169 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:02.867169 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:02.868485 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:59:02.868485 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:59:02.868485 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:59:02.868485 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:59:02.868485 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 451/908] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:59:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:02.872435 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef66e1d-6a51-4e52-8a64-1d3c5211c766 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:02.917087 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77785ac-7daf-49d2-9234-33fe1516a07a None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:02.962887 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed223c-b824-4e99-b6b7-14ff67019dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:02.963544 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed223c-b824-4e99-b6b7-14ff67019dfe None admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:02.963839 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed223c-b824-4e99-b6b7-14ff67019dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:02.964117 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed223c-b824-4e99-b6b7-14ff67019dfe None admin] PATH_INFO: `/v3/endpoints` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:02.964913 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed223c-b824-4e99-b6b7-14ff67019dfe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:02.966792 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed223c-b824-4e99-b6b7-14ff67019dfe None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:02.993862 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef66e1d-6a51-4e52-8a64-1d3c5211c766 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:03.000840 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 458/909] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Jun 20 05:59:02 2022] POST /identity/v3/endpoints => generated 346 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 05:59:03.047522 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfafbccb-6b70-48ff-84f1-6e15a06088c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:03.048258 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfafbccb-6b70-48ff-84f1-6e15a06088c7 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:03.048595 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfafbccb-6b70-48ff-84f1-6e15a06088c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:03.048899 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfafbccb-6b70-48ff-84f1-6e15a06088c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:03.049638 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfafbccb-6b70-48ff-84f1-6e15a06088c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:03.049944 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfafbccb-6b70-48ff-84f1-6e15a06088c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:03.051356 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfafbccb-6b70-48ff-84f1-6e15a06088c7 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:03.066552 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 452/910] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:59:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:03.072157 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed223c-b824-4e99-b6b7-14ff67019dfe None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:03.192417 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed223c-b824-4e99-b6b7-14ff67019dfe None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:03.207976 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:03.230464 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d227279-ac7f-4f98-97f2-00bab6403c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:03.231280 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d227279-ac7f-4f98-97f2-00bab6403c17 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:03.231567 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d227279-ac7f-4f98-97f2-00bab6403c17 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:03.231846 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d227279-ac7f-4f98-97f2-00bab6403c17 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:03.240061 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d227279-ac7f-4f98-97f2-00bab6403c17 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:03.241536 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d227279-ac7f-4f98-97f2-00bab6403c17 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:03.257076 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-7d227279-ac7f-4f98-97f2-00bab6403c17 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 05:59:03.257076 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:03.257076 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:03.257076 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:03.257076 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:03.257076 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:03.257076 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:03.257076 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:03.257076 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:03.257076 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:03.257076 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:03.257076 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:03.257076 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:59:03.257076 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:59:03.257076 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:59:03.257076 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:59:03.258080 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:03.258080 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:03.258080 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:59:03.258080 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:59:03.258080 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:59:03.258080 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:59:03.258080 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:03.258080 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:03.258080 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:03.258080 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:03.258080 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:03.258080 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:03.258080 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:03.258080 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:03.258080 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:03.258080 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:03.258080 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:03.258080 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:03.259042 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:03.259042 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:03.259042 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:59:03.259042 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:59:03.259042 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:59:03.259042 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:59:03.259042 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:59:03.259042 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:59:03.259042 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 05:59:03.259042 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:03.259042 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 459/911] 10.222.0.39 () {56 vars in 1117 bytes} [Mon Jun 20 05:59:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:03.266500 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfafbccb-6b70-48ff-84f1-6e15a06088c7 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:03.276421 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:03.377078 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfafbccb-6b70-48ff-84f1-6e15a06088c7 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:03.415310 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4b232-d520-4432-b87e-e9387b0b9cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:03.416339 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4b232-d520-4432-b87e-e9387b0b9cb5 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:03.416859 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4b232-d520-4432-b87e-e9387b0b9cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:03.417368 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4b232-d520-4432-b87e-e9387b0b9cb5 None admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:03.418405 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e4b232-d520-4432-b87e-e9387b0b9cb5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:03.418915 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e4b232-d520-4432-b87e-e9387b0b9cb5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:03.420559 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e4b232-d520-4432-b87e-e9387b0b9cb5 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:03.439729 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 453/912] 10.222.0.39 () {56 vars in 1149 bytes} [Mon Jun 20 05:59:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:03.445650 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d227279-ac7f-4f98-97f2-00bab6403c17 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:03.552724 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d227279-ac7f-4f98-97f2-00bab6403c17 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:03.589328 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef5ca4-9956-4c6b-9013-a8f1d57a1be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:03.589974 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef5ca4-9956-4c6b-9013-a8f1d57a1be1 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:03.590247 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef5ca4-9956-4c6b-9013-a8f1d57a1be1 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:03.590525 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef5ca4-9956-4c6b-9013-a8f1d57a1be1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:03.634657 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:03.660477 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ef5ca4-9956-4c6b-9013-a8f1d57a1be1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:03.661960 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ef5ca4-9956-4c6b-9013-a8f1d57a1be1 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:03.763291 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 460/913] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 05:59:03 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 05:59:03.769029 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4b232-d520-4432-b87e-e9387b0b9cb5 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:03.840160 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:03.859010 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7e14b-6483-4ad9-8002-619c317b976d None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:03.859331 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7e14b-6483-4ad9-8002-619c317b976d None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:03.859584 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7e14b-6483-4ad9-8002-619c317b976d None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:03.861242 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 461/914] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:59:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:03.869242 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0133e-24cb-4904-9e8d-e68b6fa32d2e None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:03.869640 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0133e-24cb-4904-9e8d-e68b6fa32d2e None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:03.870030 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0133e-24cb-4904-9e8d-e68b6fa32d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:03.885157 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4b232-d520-4432-b87e-e9387b0b9cb5 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:03.892660 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-8fc0133e-24cb-4904-9e8d-e68b6fa32d2e None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:03.894460 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-8fc0133e-24cb-4904-9e8d-e68b6fa32d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:03.924149 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3815cd-8a42-4a4a-9f48-e27fe5fa22f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:03.924972 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3815cd-8a42-4a4a-9f48-e27fe5fa22f2 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:03.925352 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3815cd-8a42-4a4a-9f48-e27fe5fa22f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:03.925629 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3815cd-8a42-4a4a-9f48-e27fe5fa22f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:03.936999 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3815cd-8a42-4a4a-9f48-e27fe5fa22f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:03.938598 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3815cd-8a42-4a4a-9f48-e27fe5fa22f2 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:03.958819 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-7b3815cd-8a42-4a4a-9f48-e27fe5fa22f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:59:03.958819 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:03.958819 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:03.958819 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:03.958819 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:03.958819 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:03.958819 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:03.958819 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:03.958819 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:03.958819 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:03.958819 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:03.958819 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:03.958819 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:59:03.958819 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:59:03.958819 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:59:03.959735 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:59:03.959735 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:03.959735 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:03.959735 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:03.959735 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:03.959735 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:03.959735 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:03.959735 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:03.959735 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:03.959735 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:03.959735 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:03.959735 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:03.959735 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:03.959735 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:03.959735 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:03.959735 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:03.959735 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:03.960627 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:59:03.960627 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:59:03.960627 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:59:03.960627 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:59:03.960627 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 454/915] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:59:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:03.966024 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3815cd-8a42-4a4a-9f48-e27fe5fa22f2 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:03.976785 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 462/916] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:59:04.003075 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0133e-24cb-4904-9e8d-e68b6fa32d2e None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:04.006084 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:04.091088 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3815cd-8a42-4a4a-9f48-e27fe5fa22f2 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:04.110130 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:04.117034 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0133e-24cb-4904-9e8d-e68b6fa32d2e None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:04.130476 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af5207e-a0d4-4edd-b386-042e9c2e7657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:04.131434 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5207e-a0d4-4edd-b386-042e9c2e7657 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:04.131915 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5207e-a0d4-4edd-b386-042e9c2e7657 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:04.132645 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5207e-a0d4-4edd-b386-042e9c2e7657 None admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:04.133577 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af5207e-a0d4-4edd-b386-042e9c2e7657 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:04.134064 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af5207e-a0d4-4edd-b386-042e9c2e7657 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:04.135776 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af5207e-a0d4-4edd-b386-042e9c2e7657 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:04.153753 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 455/917] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:59:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:04.154932 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af5207e-a0d4-4edd-b386-042e9c2e7657 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:04.159173 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d63e9e6-1a62-4808-a8d0-f04134f6690e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:04.160744 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63e9e6-1a62-4808-a8d0-f04134f6690e None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:04.160744 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63e9e6-1a62-4808-a8d0-f04134f6690e None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:04.160744 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63e9e6-1a62-4808-a8d0-f04134f6690e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:04.161312 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d63e9e6-1a62-4808-a8d0-f04134f6690e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:04.162721 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d63e9e6-1a62-4808-a8d0-f04134f6690e None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:04.176455 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-7d63e9e6-1a62-4808-a8d0-f04134f6690e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 05:59:04.176455 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:04.176455 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:59:04.176455 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:59:04.176455 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:59:04.176455 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:59:04.176455 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:59:04.176455 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:59:04.176455 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 05:59:04.176455 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:04.176455 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:59:04.176455 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:04.176455 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:04.176455 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:04.176455 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:04.176455 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:04.177490 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:04.177490 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:04.177490 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:04.177490 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:04.177490 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:04.177490 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:04.177490 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:04.177490 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:59:04.177490 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:59:04.177490 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:59:04.177490 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:59:04.177490 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:04.177490 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:04.177490 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:04.177490 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:04.177490 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:04.178349 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:04.178349 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:04.178349 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:04.178349 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:04.178349 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:04.178349 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:04.178349 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:04.178349 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:04.178349 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:04.178349 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:04.178349 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:04.178349 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:59:04.178349 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:59:04.178349 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 05:59:04.178349 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:04.182634 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 463/918] 10.222.0.39 () {56 vars in 1132 bytes} [Mon Jun 20 05:59:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:59:04.183584 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d63e9e6-1a62-4808-a8d0-f04134f6690e None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:04.258782 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:04.279953 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af5207e-a0d4-4edd-b386-042e9c2e7657 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:04.295413 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d63e9e6-1a62-4808-a8d0-f04134f6690e None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:04.318927 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b42bd53-ff63-44ae-a064-37c4b8c583cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:04.320167 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42bd53-ff63-44ae-a064-37c4b8c583cd None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:04.320654 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42bd53-ff63-44ae-a064-37c4b8c583cd None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:04.321209 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42bd53-ff63-44ae-a064-37c4b8c583cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:04.329821 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b42bd53-ff63-44ae-a064-37c4b8c583cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:04.331876 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b42bd53-ff63-44ae-a064-37c4b8c583cd None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:04.332125 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc48fc-b7c1-49ab-a5fd-72a5c1cef5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:04.332868 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc48fc-b7c1-49ab-a5fd-72a5c1cef5a0 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:04.333124 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc48fc-b7c1-49ab-a5fd-72a5c1cef5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:04.333384 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc48fc-b7c1-49ab-a5fd-72a5c1cef5a0 None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:04.334089 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fc48fc-b7c1-49ab-a5fd-72a5c1cef5a0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:04.334391 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fc48fc-b7c1-49ab-a5fd-72a5c1cef5a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:04.335840 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fc48fc-b7c1-49ab-a5fd-72a5c1cef5a0 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:04.345011 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 464/919] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Jun 20 05:59:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:04.347035 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc48fc-b7c1-49ab-a5fd-72a5c1cef5a0 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:04.351069 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-5b42bd53-ff63-44ae-a064-37c4b8c583cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:59:04.351069 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:04.351069 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:04.351069 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:04.351069 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:04.351069 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:04.351069 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:04.351069 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:04.351069 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:04.351069 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:04.351069 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:04.351069 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:04.351069 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:59:04.351069 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:59:04.351069 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:59:04.351991 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:59:04.351991 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:04.351991 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:04.351991 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:04.351991 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:04.351991 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:04.351991 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:04.351991 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:04.351991 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:04.351991 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:04.351991 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:04.351991 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:04.351991 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:04.351991 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:04.351991 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:04.351991 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:04.351991 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:04.352902 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:59:04.352902 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:59:04.352902 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:59:04.352902 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:59:04.352902 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:59:04.352902 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:59:04.352902 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:59:04.352902 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:59:04.355140 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 456/920] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jun 20 05:59:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:59:04.361840 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b42bd53-ff63-44ae-a064-37c4b8c583cd None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:04.400590 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:04.454991 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc48fc-b7c1-49ab-a5fd-72a5c1cef5a0 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:04.478280 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b42bd53-ff63-44ae-a064-37c4b8c583cd None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:04.488210 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:04.494623 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9696bb-78ba-42c9-9328-24c4dc9a0dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:04.495456 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9696bb-78ba-42c9-9328-24c4dc9a0dd9 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:04.495998 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9696bb-78ba-42c9-9328-24c4dc9a0dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:04.496441 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9696bb-78ba-42c9-9328-24c4dc9a0dd9 None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:04.497436 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9696bb-78ba-42c9-9328-24c4dc9a0dd9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:04.497884 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9696bb-78ba-42c9-9328-24c4dc9a0dd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:04.499908 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9696bb-78ba-42c9-9328-24c4dc9a0dd9 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:04.510281 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 465/921] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Jun 20 05:59:04 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:04.511382 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9696bb-78ba-42c9-9328-24c4dc9a0dd9 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:04.520039 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a77b7d-9e1d-49f5-817d-01048bec1d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:04.520860 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a77b7d-9e1d-49f5-817d-01048bec1d05 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:04.521242 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a77b7d-9e1d-49f5-817d-01048bec1d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:04.521620 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a77b7d-9e1d-49f5-817d-01048bec1d05 None admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:04.522616 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a77b7d-9e1d-49f5-817d-01048bec1d05 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:04.523027 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a77b7d-9e1d-49f5-817d-01048bec1d05 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:04.524712 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a77b7d-9e1d-49f5-817d-01048bec1d05 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:04.542988 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 457/922] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jun 20 05:59:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:04.544076 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a77b7d-9e1d-49f5-817d-01048bec1d05 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:04.618797 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9696bb-78ba-42c9-9328-24c4dc9a0dd9 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:04.643129 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:04.649400 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a77b7d-9e1d-49f5-817d-01048bec1d05 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:04.659492 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593e78ae-7b57-4bfc-a241-7b64c5922f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:04.660454 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e78ae-7b57-4bfc-a241-7b64c5922f82 None admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:04.661068 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e78ae-7b57-4bfc-a241-7b64c5922f82 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:04.661522 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e78ae-7b57-4bfc-a241-7b64c5922f82 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:04.662502 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593e78ae-7b57-4bfc-a241-7b64c5922f82 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:04.664157 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593e78ae-7b57-4bfc-a241-7b64c5922f82 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:04.693083 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 466/923] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Jun 20 05:59:04 2022] POST /identity/v3/endpoints => generated 347 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:59:04.695971 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa27042-d946-4ae2-8b2c-2f405b07d3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:04.696777 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa27042-d946-4ae2-8b2c-2f405b07d3be None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:04.697132 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa27042-d946-4ae2-8b2c-2f405b07d3be None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:04.697476 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa27042-d946-4ae2-8b2c-2f405b07d3be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:04.698484 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa27042-d946-4ae2-8b2c-2f405b07d3be None admin] RBAC: Adding query filter params (role.id=b20a688ed203460d9430dd8aa432756b, scope.project.id=b349043204b34d1794818184ffe6505c, user.id=8c0f131484cb48d289cae1f473ec2fbc) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:04.699189 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa27042-d946-4ae2-8b2c-2f405b07d3be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:04.700800 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa27042-d946-4ae2-8b2c-2f405b07d3be None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:04.708793 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 458/924] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jun 20 05:59:04 2022] GET /identity/v3/role_assignments?user.id=8c0f131484cb48d289cae1f473ec2fbc&scope.project.id=b349043204b34d1794818184ffe6505c&role.id=b20a688ed203460d9430dd8aa432756b => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:04.798716 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ba698-11a9-4fbb-9007-6172acd2c08a None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:04.799408 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ba698-11a9-4fbb-9007-6172acd2c08a None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:04.799911 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ba698-11a9-4fbb-9007-6172acd2c08a None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:04.802017 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 467/925] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:59:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:04.807801 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89684d09-8668-4f6a-a375-733afcaff443 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:04.808111 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89684d09-8668-4f6a-a375-733afcaff443 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:04.808370 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89684d09-8668-4f6a-a375-733afcaff443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:04.826964 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-89684d09-8668-4f6a-a375-733afcaff443 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:04.828866 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-89684d09-8668-4f6a-a375-733afcaff443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:04.917352 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 459/926] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:59:04.940867 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ba698-11a9-4fbb-9007-6172acd2c08a None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:04.999945 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:05.056841 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ba698-11a9-4fbb-9007-6172acd2c08a None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:05.092561 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc18d2f-0b2e-4bf2-9f4a-db566173e20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:05.094202 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc18d2f-0b2e-4bf2-9f4a-db566173e20e None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:05.094657 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc18d2f-0b2e-4bf2-9f4a-db566173e20e None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:05.095074 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc18d2f-0b2e-4bf2-9f4a-db566173e20e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:05.095881 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc18d2f-0b2e-4bf2-9f4a-db566173e20e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:05.097458 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc18d2f-0b2e-4bf2-9f4a-db566173e20e None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:05.110593 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-2bc18d2f-0b2e-4bf2-9f4a-db566173e20e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 05:59:05.110593 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:05.110593 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:59:05.110593 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:59:05.110593 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:59:05.110593 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:59:05.110593 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:59:05.110593 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:59:05.110593 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 05:59:05.110593 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:05.110593 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:59:05.110593 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:05.110593 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:05.110593 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:05.110593 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:05.110593 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:05.110593 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:05.111837 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:05.111837 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:05.111837 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:05.111837 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:05.111837 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:05.111837 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:05.111837 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:59:05.111837 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:59:05.111837 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:59:05.111837 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:59:05.111837 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:05.111837 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:05.111837 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:05.111837 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:05.111837 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:05.111837 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:05.112953 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:05.112953 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:05.112953 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:05.112953 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:05.112953 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:05.112953 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:05.112953 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:05.112953 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:05.112953 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:05.112953 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:05.112953 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:59:05.112953 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:59:05.112953 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 05:59:05.112953 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:05.115392 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 468/927] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Jun 20 05:59:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:05.121329 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89684d09-8668-4f6a-a375-733afcaff443 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:05.187446 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fbad8b-2917-45eb-9410-95cc223d03d8 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:05.187840 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fbad8b-2917-45eb-9410-95cc223d03d8 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:05.188226 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fbad8b-2917-45eb-9410-95cc223d03d8 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:05.189908 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 469/928] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:59:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:05.195189 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685af513-1fda-4b23-9cec-66ec41237ce5 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:05.195478 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685af513-1fda-4b23-9cec-66ec41237ce5 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:05.195752 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685af513-1fda-4b23-9cec-66ec41237ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:05.213733 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-685af513-1fda-4b23-9cec-66ec41237ce5 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:05.214951 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-685af513-1fda-4b23-9cec-66ec41237ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:05.217123 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:05.233353 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89684d09-8668-4f6a-a375-733afcaff443 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:05.269388 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221cd11c-a920-4778-8ec8-030b5fdc33d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:05.270053 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221cd11c-a920-4778-8ec8-030b5fdc33d2 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:05.270331 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221cd11c-a920-4778-8ec8-030b5fdc33d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:05.270606 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221cd11c-a920-4778-8ec8-030b5fdc33d2 None admin] PATH_INFO: `/v3/services` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:05.271306 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221cd11c-a920-4778-8ec8-030b5fdc33d2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:05.271605 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221cd11c-a920-4778-8ec8-030b5fdc33d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:05.273064 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221cd11c-a920-4778-8ec8-030b5fdc33d2 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:05.278415 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 460/929] 10.222.0.39 () {56 vars in 1122 bytes} [Mon Jun 20 05:59:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:05.284242 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221cd11c-a920-4778-8ec8-030b5fdc33d2 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:05.306225 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 470/930] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 05:59:05.329837 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685af513-1fda-4b23-9cec-66ec41237ce5 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:05.378793 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:05.392574 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221cd11c-a920-4778-8ec8-030b5fdc33d2 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:05.428413 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61005a6-be60-46c3-a729-134c7d55ad60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:05.429146 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61005a6-be60-46c3-a729-134c7d55ad60 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:05.429417 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61005a6-be60-46c3-a729-134c7d55ad60 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:05.429698 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61005a6-be60-46c3-a729-134c7d55ad60 None admin] PATH_INFO: `/v3/services` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:05.430411 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61005a6-be60-46c3-a729-134c7d55ad60 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:05.430726 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61005a6-be60-46c3-a729-134c7d55ad60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:05.432096 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61005a6-be60-46c3-a729-134c7d55ad60 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:05.438594 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 461/931] 10.222.0.39 () {56 vars in 1122 bytes} [Mon Jun 20 05:59:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:05.441388 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685af513-1fda-4b23-9cec-66ec41237ce5 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:05.446096 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61005a6-be60-46c3-a729-134c7d55ad60 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:05.475845 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:05.490321 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7163aa7b-bf64-41d8-bac5-35d88e101470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:05.491284 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163aa7b-bf64-41d8-bac5-35d88e101470 None admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:05.491772 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163aa7b-bf64-41d8-bac5-35d88e101470 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:05.492247 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163aa7b-bf64-41d8-bac5-35d88e101470 None admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:05.493418 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7163aa7b-bf64-41d8-bac5-35d88e101470 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:05.495147 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7163aa7b-bf64-41d8-bac5-35d88e101470 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:05.496963 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: WARNING keystone.server.flask.common [None req-7163aa7b-bf64-41d8-bac5-35d88e101470 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 20 05:59:05.517448 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.sql.core [None req-7163aa7b-bf64-41d8-bac5-35d88e101470 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 20 05:59:05.517448 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 20 05:59:05.517448 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [parameters: {'id': '1e643d29dd0d46aca1e435e02f9d702f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 20 05:59:05.517448 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80271) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 20 05:59:05.526575 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-7163aa7b-bf64-41d8-bac5-35d88e101470 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1e643d29dd0d46aca1e435e02f9d702f.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1e643d29dd0d46aca1e435e02f9d702f. Jun 20 05:59:05.526575 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:05.526575 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 20 05:59:05.526575 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 20 05:59:05.526575 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 20 05:59:05.526575 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 20 05:59:05.526575 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 20 05:59:05.526575 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application result = self._query(query) Jun 20 05:59:05.526575 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 20 05:59:05.526575 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application conn.query(q) Jun 20 05:59:05.526575 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 20 05:59:05.526575 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 20 05:59:05.526575 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 20 05:59:05.527379 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application result.read() Jun 20 05:59:05.527379 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 20 05:59:05.527379 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 20 05:59:05.527379 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 20 05:59:05.527379 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 20 05:59:05.527379 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 20 05:59:05.527379 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 20 05:59:05.527379 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 20 05:59:05.527379 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 20 05:59:05.527379 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 20 05:59:05.527379 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:05.527379 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 20 05:59:05.527379 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:05.527379 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:05.527379 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 20 05:59:05.527379 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 20 05:59:05.527379 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 20 05:59:05.527379 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 20 05:59:05.528341 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 20 05:59:05.528341 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application next(self.gen) Jun 20 05:59:05.528341 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 20 05:59:05.528341 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application yield resource Jun 20 05:59:05.528341 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 20 05:59:05.528341 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application next(self.gen) Jun 20 05:59:05.528341 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 20 05:59:05.528341 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application self.session.rollback() Jun 20 05:59:05.528341 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 05:59:05.528341 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application self.force_reraise() Jun 20 05:59:05.528341 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 05:59:05.528341 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise self.value Jun 20 05:59:05.528341 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 20 05:59:05.528341 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 20 05:59:05.528341 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 20 05:59:05.528341 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application session.commit() Jun 20 05:59:05.528341 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 20 05:59:05.529277 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 20 05:59:05.529277 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 20 05:59:05.529277 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application self._prepare_impl() Jun 20 05:59:05.529277 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 20 05:59:05.529277 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application self.session.flush() Jun 20 05:59:05.529277 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 20 05:59:05.529277 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application self._flush(objects) Jun 20 05:59:05.529277 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 20 05:59:05.529277 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 20 05:59:05.529277 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 20 05:59:05.529277 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application compat.raise_( Jun 20 05:59:05.529277 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 20 05:59:05.529277 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception Jun 20 05:59:05.529277 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 20 05:59:05.529277 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application flush_context.execute() Jun 20 05:59:05.529277 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 20 05:59:05.529277 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rec.execute(self) Jun 20 05:59:05.530201 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 20 05:59:05.530201 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 20 05:59:05.530201 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 20 05:59:05.530201 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 20 05:59:05.530201 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 20 05:59:05.530201 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 20 05:59:05.530201 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 20 05:59:05.530201 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 20 05:59:05.530201 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 20 05:59:05.530201 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 20 05:59:05.530201 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 20 05:59:05.530201 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 20 05:59:05.530201 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 20 05:59:05.530201 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 20 05:59:05.530201 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 20 05:59:05.531410 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 20 05:59:05.531410 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 20 05:59:05.531410 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception Jun 20 05:59:05.531410 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 20 05:59:05.531410 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 20 05:59:05.531410 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 20 05:59:05.531410 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 20 05:59:05.531410 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 20 05:59:05.531410 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application result = self._query(query) Jun 20 05:59:05.531410 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 20 05:59:05.531410 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application conn.query(q) Jun 20 05:59:05.531410 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 20 05:59:05.531410 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 20 05:59:05.531410 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 20 05:59:05.531410 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application result.read() Jun 20 05:59:05.531410 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 20 05:59:05.531410 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 20 05:59:05.532298 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 20 05:59:05.532298 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 20 05:59:05.532298 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 20 05:59:05.532298 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 20 05:59:05.532298 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 20 05:59:05.532298 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 20 05:59:05.532298 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 20 05:59:05.532298 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 20 05:59:05.532298 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [parameters: {'id': '1e643d29dd0d46aca1e435e02f9d702f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 20 05:59:05.532298 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 20 05:59:05.532298 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:05.532298 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:59:05.532298 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:05.532298 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:05.532298 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 20 05:59:05.534782 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 20 05:59:05.534782 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 20 05:59:05.534782 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 20 05:59:05.534782 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 20 05:59:05.534782 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:05.534782 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:59:05.534782 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:05.534782 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:05.534782 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:05.534782 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:05.534782 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:05.534782 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:05.534782 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:05.534782 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:05.534782 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:05.534782 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:05.534782 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:05.537053 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:05.537053 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 20 05:59:05.537053 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 20 05:59:05.537053 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:05.537053 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:05.537053 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 20 05:59:05.537053 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 20 05:59:05.537053 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1e643d29dd0d46aca1e435e02f9d702f. Jun 20 05:59:05.537053 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:05.544866 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 471/932] 10.222.0.39 () {60 vars in 1140 bytes} [Mon Jun 20 05:59:05 2022] POST /identity/v3/projects => generated 262 bytes in 211 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:05.547507 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7163aa7b-bf64-41d8-bac5-35d88e101470 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:05.575540 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61005a6-be60-46c3-a729-134c7d55ad60 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:05.622125 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db8298-8cba-47fe-bfb7-afe8b98050b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:05.622785 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db8298-8cba-47fe-bfb7-afe8b98050b1 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:05.623068 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db8298-8cba-47fe-bfb7-afe8b98050b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:05.623343 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db8298-8cba-47fe-bfb7-afe8b98050b1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:05.624361 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57db8298-8cba-47fe-bfb7-afe8b98050b1 None admin] RBAC: Adding query filter params (interface=public, service_id=221a7a49b37d4780bf9e01491f6b6e9f, region_id=RegionOne) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:05.624361 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57db8298-8cba-47fe-bfb7-afe8b98050b1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:05.626589 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57db8298-8cba-47fe-bfb7-afe8b98050b1 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:05.636776 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 462/933] 10.222.0.39 () {56 vars in 1251 bytes} [Mon Jun 20 05:59:05 2022] GET /identity/v3/endpoints?service_id=221a7a49b37d4780bf9e01491f6b6e9f&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:05.638578 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db8298-8cba-47fe-bfb7-afe8b98050b1 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:05.671544 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7163aa7b-bf64-41d8-bac5-35d88e101470 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:05.673782 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:05.717274 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c123696-abaf-4d15-b6eb-5ada45b9f602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:05.719344 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c123696-abaf-4d15-b6eb-5ada45b9f602 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:05.719825 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c123696-abaf-4d15-b6eb-5ada45b9f602 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:05.721013 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c123696-abaf-4d15-b6eb-5ada45b9f602 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:05.728786 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c123696-abaf-4d15-b6eb-5ada45b9f602 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:05.730759 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:05.731866 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c123696-abaf-4d15-b6eb-5ada45b9f602 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:05.751549 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-5c123696-abaf-4d15-b6eb-5ada45b9f602 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:59:05.751549 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:05.751549 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:05.751549 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:05.751549 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:05.751549 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:05.751549 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:05.751549 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:05.751549 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:05.751549 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:05.751549 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:05.751549 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:05.751549 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:59:05.751549 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:59:05.751549 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:59:05.752499 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:59:05.752499 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:05.752499 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:05.752499 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:05.752499 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:05.752499 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:05.752499 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:05.752499 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:05.752499 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:05.752499 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:05.752499 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:05.752499 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:05.752499 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:05.752499 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:05.752499 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:05.752499 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:05.752499 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:05.753444 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:59:05.753444 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:59:05.753444 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:59:05.753444 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:59:05.753444 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:59:05.753444 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:59:05.753444 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:59:05.753444 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:05.759424 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 472/934] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jun 20 05:59:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:05.760189 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c123696-abaf-4d15-b6eb-5ada45b9f602 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:05.763033 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db8298-8cba-47fe-bfb7-afe8b98050b1 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:05.815403 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d373b49-1054-4e8b-8720-6aeb064971ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:05.816508 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d373b49-1054-4e8b-8720-6aeb064971ba None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:05.817015 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d373b49-1054-4e8b-8720-6aeb064971ba None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:05.817613 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d373b49-1054-4e8b-8720-6aeb064971ba None admin] PATH_INFO: `/v3/services` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:05.818787 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d373b49-1054-4e8b-8720-6aeb064971ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:05.820346 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d373b49-1054-4e8b-8720-6aeb064971ba None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:05.836969 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 463/935] 10.222.0.39 () {56 vars in 1087 bytes} [Mon Jun 20 05:59:05 2022] GET /identity/v3/services => generated 1497 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 05:59:05.887413 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c123696-abaf-4d15-b6eb-5ada45b9f602 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:05.926946 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c2248-f78f-4261-bc52-9aae6926d800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:05.927639 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c2248-f78f-4261-bc52-9aae6926d800 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:05.927924 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c2248-f78f-4261-bc52-9aae6926d800 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:05.928201 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c2248-f78f-4261-bc52-9aae6926d800 None admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:05.929040 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18c2248-f78f-4261-bc52-9aae6926d800 None admin] RBAC: Adding query filter params (name=service) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:05.929354 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18c2248-f78f-4261-bc52-9aae6926d800 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:05.930862 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18c2248-f78f-4261-bc52-9aae6926d800 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:05.957638 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 473/936] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Jun 20 05:59:05 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:06.825322 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e65f0-ad35-41bb-bb33-ee5a237a0785 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:06.825847 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e65f0-ad35-41bb-bb33-ee5a237a0785 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:06.825847 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e65f0-ad35-41bb-bb33-ee5a237a0785 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:06.828059 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 464/937] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:06.834390 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21100cf8-1f25-49dd-9f4f-90f8745e52ae None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:06.834866 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21100cf8-1f25-49dd-9f4f-90f8745e52ae None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:06.834974 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21100cf8-1f25-49dd-9f4f-90f8745e52ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:06.852264 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-21100cf8-1f25-49dd-9f4f-90f8745e52ae None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:06.853800 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-21100cf8-1f25-49dd-9f4f-90f8745e52ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:06.870660 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:06.893397 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38982d10-de2e-4b39-b2c9-d01fbf8e1a98 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:06.894032 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38982d10-de2e-4b39-b2c9-d01fbf8e1a98 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:06.894514 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38982d10-de2e-4b39-b2c9-d01fbf8e1a98 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:06.896062 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 465/938] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:59:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:06.901073 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc3b48-f45f-406e-82a6-7868f8f88397 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:06.901575 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc3b48-f45f-406e-82a6-7868f8f88397 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:06.902046 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc3b48-f45f-406e-82a6-7868f8f88397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:06.922112 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-c8bc3b48-f45f-406e-82a6-7868f8f88397 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:06.924167 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-c8bc3b48-f45f-406e-82a6-7868f8f88397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:06.927147 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 474/939] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 05:59:06.950756 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21100cf8-1f25-49dd-9f4f-90f8745e52ae None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:07.007912 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 466/940] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 05:59:07.030948 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc3b48-f45f-406e-82a6-7868f8f88397 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:07.071701 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21100cf8-1f25-49dd-9f4f-90f8745e52ae None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:07.119513 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d072f10d-3d7b-4814-a0f2-7876d9c6330b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:07.121700 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:07.122903 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072f10d-3d7b-4814-a0f2-7876d9c6330b None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:07.123430 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072f10d-3d7b-4814-a0f2-7876d9c6330b None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:07.123893 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072f10d-3d7b-4814-a0f2-7876d9c6330b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:07.137757 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d072f10d-3d7b-4814-a0f2-7876d9c6330b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:59:07.147174 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-d072f10d-3d7b-4814-a0f2-7876d9c6330b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 05:59:07.147174 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:07.147174 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:07.147174 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:07.147174 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:07.147174 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:07.147174 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:07.147174 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:07.147174 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:07.147174 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:07.147174 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:07.147174 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:07.147174 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:59:07.147174 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:59:07.147174 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:59:07.147174 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:59:07.148118 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:59:07.148118 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:59:07.148118 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:59:07.148118 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:59:07.148118 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:07.148118 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:07.148118 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:07.148118 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:07.148118 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:07.148118 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:07.148118 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:07.148118 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:07.148118 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:07.148118 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:07.148118 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:07.148118 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:07.148975 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:07.148975 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:07.148975 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:07.148975 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:07.148975 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:59:07.148975 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:59:07.148975 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:59:07.148975 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:59:07.148975 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:59:07.148975 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:59:07.148975 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 05:59:07.148975 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:07.151829 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 475/941] 10.222.0.39 () {56 vars in 1120 bytes} [Mon Jun 20 05:59:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:59:07.160790 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d072f10d-3d7b-4814-a0f2-7876d9c6330b None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:07.160942 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc3b48-f45f-406e-82a6-7868f8f88397 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:07.185108 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:07.206181 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bced9d8-d63a-4683-a137-af2b636094e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:07.207265 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bced9d8-d63a-4683-a137-af2b636094e9 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:07.207550 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bced9d8-d63a-4683-a137-af2b636094e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:07.207828 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bced9d8-d63a-4683-a137-af2b636094e9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:07.208651 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bced9d8-d63a-4683-a137-af2b636094e9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:07.210739 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bced9d8-d63a-4683-a137-af2b636094e9 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:07.226756 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-1bced9d8-d63a-4683-a137-af2b636094e9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 05:59:07.226756 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:07.226756 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:59:07.226756 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:59:07.226756 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:59:07.226756 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:59:07.226756 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:59:07.226756 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:59:07.226756 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 05:59:07.226756 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:59:07.226756 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:59:07.226756 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:59:07.226756 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:07.226756 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:07.226756 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:07.226756 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:07.226756 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:07.227783 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:07.227783 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:07.227783 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:07.227783 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:07.227783 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:07.227783 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:07.227783 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:59:07.227783 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:59:07.227783 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:59:07.227783 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:59:07.227783 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:07.227783 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:07.227783 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:07.227783 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:07.227783 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:07.227783 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:07.228619 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:07.228619 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:07.228619 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:07.228619 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:07.228619 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:07.228619 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:07.228619 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:07.228619 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:07.228619 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:07.228619 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:07.228619 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:59:07.228619 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:59:07.228619 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 05:59:07.228619 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:59:07.228619 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 467/942] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jun 20 05:59:07 2022] GET /identity/v3/services/compute => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:59:07.236106 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bced9d8-d63a-4683-a137-af2b636094e9 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:07.271314 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d072f10d-3d7b-4814-a0f2-7876d9c6330b None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:07.307365 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f4c48-aaeb-4c23-947b-d95f9c7b2054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:07.308298 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f4c48-aaeb-4c23-947b-d95f9c7b2054 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:07.308582 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f4c48-aaeb-4c23-947b-d95f9c7b2054 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:07.308946 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f4c48-aaeb-4c23-947b-d95f9c7b2054 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:07.309758 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f4c48-aaeb-4c23-947b-d95f9c7b2054 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:07.310058 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f4c48-aaeb-4c23-947b-d95f9c7b2054 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:07.311439 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f4c48-aaeb-4c23-947b-d95f9c7b2054 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:07.320741 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 476/943] 10.222.0.39 () {56 vars in 1115 bytes} [Mon Jun 20 05:59:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:07.326716 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f4c48-aaeb-4c23-947b-d95f9c7b2054 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:07.366755 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bced9d8-d63a-4683-a137-af2b636094e9 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:07.408993 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:07.412436 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c0ff2-4c1d-46dd-b9ac-46ff4bae43ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:07.414172 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c0ff2-4c1d-46dd-b9ac-46ff4bae43ed None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:07.414467 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c0ff2-4c1d-46dd-b9ac-46ff4bae43ed None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:07.414744 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c0ff2-4c1d-46dd-b9ac-46ff4bae43ed None admin] PATH_INFO: `/v3/services` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:07.415929 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046c0ff2-4c1d-46dd-b9ac-46ff4bae43ed None admin] RBAC: Adding query filter params (name=compute) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:07.416236 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046c0ff2-4c1d-46dd-b9ac-46ff4bae43ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:07.417871 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046c0ff2-4c1d-46dd-b9ac-46ff4bae43ed None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:07.420439 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:07.428754 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 468/944] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Jun 20 05:59:07 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:07.431438 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c0ff2-4c1d-46dd-b9ac-46ff4bae43ed None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:07.446900 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f4c48-aaeb-4c23-947b-d95f9c7b2054 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:07.490737 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c94796-a5f6-4d01-81f0-b338898e46c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:07.491981 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c94796-a5f6-4d01-81f0-b338898e46c3 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:07.492832 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c94796-a5f6-4d01-81f0-b338898e46c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:07.493252 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c94796-a5f6-4d01-81f0-b338898e46c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:07.507281 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c94796-a5f6-4d01-81f0-b338898e46c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:07.510564 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c94796-a5f6-4d01-81f0-b338898e46c3 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:07.529737 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-d6c94796-a5f6-4d01-81f0-b338898e46c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:59:07.529737 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:07.529737 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:07.529737 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:07.529737 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:07.529737 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:07.529737 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:07.529737 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:07.529737 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:07.529737 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:07.529737 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:07.529737 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:07.529737 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:59:07.529737 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:59:07.529737 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:59:07.530717 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:59:07.530717 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:07.530717 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:07.530717 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:07.530717 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:07.530717 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:07.530717 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:07.530717 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:07.530717 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:07.530717 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:07.530717 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:07.530717 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:07.530717 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:07.530717 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:07.530717 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:07.530717 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:07.530717 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:07.531675 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:59:07.531675 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:59:07.531675 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:59:07.531675 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:07.531675 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 477/945] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:59:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:07.537345 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c94796-a5f6-4d01-81f0-b338898e46c3 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:07.565372 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c0ff2-4c1d-46dd-b9ac-46ff4bae43ed None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:07.611063 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d21aa16-82e3-4c4b-b21b-675cdb2ba879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:07.611783 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21aa16-82e3-4c4b-b21b-675cdb2ba879 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:07.612086 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21aa16-82e3-4c4b-b21b-675cdb2ba879 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:07.612373 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21aa16-82e3-4c4b-b21b-675cdb2ba879 None admin] PATH_INFO: `/v3/services` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:07.613125 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d21aa16-82e3-4c4b-b21b-675cdb2ba879 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:07.613434 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d21aa16-82e3-4c4b-b21b-675cdb2ba879 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:07.614819 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d21aa16-82e3-4c4b-b21b-675cdb2ba879 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:07.625027 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 469/946] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Jun 20 05:59:07 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:07.666429 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c94796-a5f6-4d01-81f0-b338898e46c3 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:07.697557 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:07.710114 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c526a3-bd32-4d1b-9285-588eb384df4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:07.711151 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c526a3-bd32-4d1b-9285-588eb384df4a None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:07.711629 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c526a3-bd32-4d1b-9285-588eb384df4a None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:07.712098 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c526a3-bd32-4d1b-9285-588eb384df4a None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:07.713083 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c526a3-bd32-4d1b-9285-588eb384df4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:07.713594 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c526a3-bd32-4d1b-9285-588eb384df4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:07.715230 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c526a3-bd32-4d1b-9285-588eb384df4a None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:07.730419 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 478/947] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:59:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:07.736993 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d21aa16-82e3-4c4b-b21b-675cdb2ba879 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:07.807352 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:07.850567 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d21aa16-82e3-4c4b-b21b-675cdb2ba879 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:07.888666 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2704e30f-cb73-4d1c-80eb-923219042884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:07.889942 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2704e30f-cb73-4d1c-80eb-923219042884 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:07.890459 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2704e30f-cb73-4d1c-80eb-923219042884 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:07.890957 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2704e30f-cb73-4d1c-80eb-923219042884 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:07.899519 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2704e30f-cb73-4d1c-80eb-923219042884 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:07.901278 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2704e30f-cb73-4d1c-80eb-923219042884 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:07.916934 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-2704e30f-cb73-4d1c-80eb-923219042884 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 05:59:07.916934 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:07.916934 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:07.916934 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:07.916934 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:07.916934 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:07.916934 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:07.916934 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:07.916934 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:07.916934 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:07.916934 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:07.916934 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:07.916934 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:59:07.916934 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:59:07.916934 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:59:07.916934 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:59:07.917897 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:07.917897 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:07.917897 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:59:07.917897 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:59:07.917897 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:59:07.917897 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:59:07.917897 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:07.917897 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:07.917897 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:07.917897 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:07.917897 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:07.917897 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:07.917897 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:07.917897 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:07.917897 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:07.917897 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:07.917897 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:07.917897 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:07.918845 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:07.918845 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:07.918845 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:59:07.918845 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:59:07.918845 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:59:07.918845 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:59:07.918845 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:59:07.918845 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:59:07.918845 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 05:59:07.918845 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:59:07.922083 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 470/948] 10.222.0.39 () {56 vars in 1117 bytes} [Mon Jun 20 05:59:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:07.931158 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c526a3-bd32-4d1b-9285-588eb384df4a None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:08.033655 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c526a3-bd32-4d1b-9285-588eb384df4a None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:08.038922 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834c7e8-aa7e-44f2-8294-6d80ec7685cf None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:08.039209 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834c7e8-aa7e-44f2-8294-6d80ec7685cf None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:08.039484 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834c7e8-aa7e-44f2-8294-6d80ec7685cf None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:08.045022 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 471/949] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:59:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:08.046171 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c7da4-dee8-4e9d-a28b-f1466eebc342 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:08.046768 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c7da4-dee8-4e9d-a28b-f1466eebc342 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:08.046768 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c7da4-dee8-4e9d-a28b-f1466eebc342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:08.063858 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-c08c7da4-dee8-4e9d-a28b-f1466eebc342 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:08.065081 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-c08c7da4-dee8-4e9d-a28b-f1466eebc342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:08.078428 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc448f29-657f-4180-a822-ac4c1cb14f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:08.079115 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc448f29-657f-4180-a822-ac4c1cb14f25 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:08.079403 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc448f29-657f-4180-a822-ac4c1cb14f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:08.079718 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc448f29-657f-4180-a822-ac4c1cb14f25 None admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:08.080573 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc448f29-657f-4180-a822-ac4c1cb14f25 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:08.080915 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc448f29-657f-4180-a822-ac4c1cb14f25 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:08.082477 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc448f29-657f-4180-a822-ac4c1cb14f25 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:08.103991 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 479/950] 10.222.0.39 () {56 vars in 1149 bytes} [Mon Jun 20 05:59:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:08.110167 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc448f29-657f-4180-a822-ac4c1cb14f25 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:08.157176 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 472/951] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:59:08.172389 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:08.176262 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a149bc1-2735-47f1-86ed-35c186c176a3 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:08.176598 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a149bc1-2735-47f1-86ed-35c186c176a3 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:08.176912 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a149bc1-2735-47f1-86ed-35c186c176a3 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:08.178393 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 473/952] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:59:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:59:08.179015 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a149bc1-2735-47f1-86ed-35c186c176a3 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:08.235445 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc448f29-657f-4180-a822-ac4c1cb14f25 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:08.243078 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:08.273939 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dbed10-ba55-45ee-a7c5-242b61bbb371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:08.274841 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dbed10-ba55-45ee-a7c5-242b61bbb371 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:08.275261 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dbed10-ba55-45ee-a7c5-242b61bbb371 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:08.275520 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dbed10-ba55-45ee-a7c5-242b61bbb371 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:08.286687 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dbed10-ba55-45ee-a7c5-242b61bbb371 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:08.288248 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dbed10-ba55-45ee-a7c5-242b61bbb371 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:08.290654 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a149bc1-2735-47f1-86ed-35c186c176a3 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:08.307163 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-c3dbed10-ba55-45ee-a7c5-242b61bbb371 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:59:08.307163 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:08.307163 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:08.307163 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:08.307163 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:08.307163 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:08.307163 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:08.307163 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:08.307163 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:08.307163 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:08.307163 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:08.307163 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:08.307163 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:59:08.307163 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:59:08.307163 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:59:08.308070 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:59:08.308070 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:08.308070 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:08.308070 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:08.308070 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:08.308070 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:08.308070 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:08.308070 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:08.308070 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:08.308070 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:08.308070 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:08.308070 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:08.308070 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:08.308070 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:08.308070 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:08.308070 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:08.308070 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:08.309028 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:59:08.309028 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:59:08.309028 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:59:08.309028 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:08.310613 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 480/953] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:59:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:59:08.312813 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75926b1-c9f6-46ff-89cd-8a704ca3c126 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:08.312940 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75926b1-c9f6-46ff-89cd-8a704ca3c126 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:08.313215 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75926b1-c9f6-46ff-89cd-8a704ca3c126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:08.331991 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ce75a-f6bf-4215-a745-da506ab95175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:08.332836 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ce75a-f6bf-4215-a745-da506ab95175 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:08.333119 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ce75a-f6bf-4215-a745-da506ab95175 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:08.333329 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-f75926b1-c9f6-46ff-89cd-8a704ca3c126 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:08.333433 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ce75a-f6bf-4215-a745-da506ab95175 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:08.334031 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3ce75a-f6bf-4215-a745-da506ab95175 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:08.334516 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-f75926b1-c9f6-46ff-89cd-8a704ca3c126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:08.335418 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3ce75a-f6bf-4215-a745-da506ab95175 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:08.348080 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-8c3ce75a-f6bf-4215-a745-da506ab95175 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 05:59:08.348080 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:08.348080 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:59:08.348080 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:59:08.348080 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:59:08.348080 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:59:08.348080 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:59:08.348080 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:59:08.348080 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 05:59:08.348080 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:59:08.348080 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:59:08.348080 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:59:08.348080 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:08.348080 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:08.348080 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:08.348080 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:08.348080 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:08.349108 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:08.349108 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:08.349108 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:08.349108 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:08.349108 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:08.349108 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:08.349108 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:59:08.349108 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:59:08.349108 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:59:08.349108 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:59:08.349108 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:08.349108 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:08.349108 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:08.349108 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:08.349108 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:08.349108 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:08.350159 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:08.350159 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:08.350159 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:08.350159 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:08.350159 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:08.350159 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:08.350159 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:08.350159 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:08.350159 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:08.350159 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:08.350159 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:59:08.350159 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:59:08.350159 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 05:59:08.350159 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:59:08.350159 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 474/954] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Jun 20 05:59:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:08.351030 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ce75a-f6bf-4215-a745-da506ab95175 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:08.412810 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 481/955] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:59:08.412810 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75926b1-c9f6-46ff-89cd-8a704ca3c126 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:08.462054 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:08.473026 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ce75a-f6bf-4215-a745-da506ab95175 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:08.493520 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:08.513362 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca5ef57-a46c-45eb-a77e-36bf5d755fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:08.514032 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5ef57-a46c-45eb-a77e-36bf5d755fe6 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:08.514315 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5ef57-a46c-45eb-a77e-36bf5d755fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:08.514639 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5ef57-a46c-45eb-a77e-36bf5d755fe6 None admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:08.515512 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca5ef57-a46c-45eb-a77e-36bf5d755fe6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:08.515822 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca5ef57-a46c-45eb-a77e-36bf5d755fe6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:08.517228 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca5ef57-a46c-45eb-a77e-36bf5d755fe6 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:08.528886 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 475/956] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:59:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:08.529657 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca5ef57-a46c-45eb-a77e-36bf5d755fe6 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:08.546207 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75926b1-c9f6-46ff-89cd-8a704ca3c126 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:08.586274 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16828771-afac-4d08-9c61-8b19af6b98e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:08.587057 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16828771-afac-4d08-9c61-8b19af6b98e9 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:08.587432 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16828771-afac-4d08-9c61-8b19af6b98e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:08.587796 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16828771-afac-4d08-9c61-8b19af6b98e9 None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:08.588595 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16828771-afac-4d08-9c61-8b19af6b98e9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:08.589023 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16828771-afac-4d08-9c61-8b19af6b98e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:08.590459 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16828771-afac-4d08-9c61-8b19af6b98e9 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:08.600338 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 482/957] 10.222.0.39 () {56 vars in 1122 bytes} [Mon Jun 20 05:59:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:08.600338 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16828771-afac-4d08-9c61-8b19af6b98e9 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:08.643404 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca5ef57-a46c-45eb-a77e-36bf5d755fe6 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:08.679741 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7093d5-3fcd-4c55-9ca9-0e5402471f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:08.680423 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7093d5-3fcd-4c55-9ca9-0e5402471f3a None admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:08.680729 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7093d5-3fcd-4c55-9ca9-0e5402471f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:08.681010 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7093d5-3fcd-4c55-9ca9-0e5402471f3a None admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:08.681709 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7093d5-3fcd-4c55-9ca9-0e5402471f3a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:08.683132 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7093d5-3fcd-4c55-9ca9-0e5402471f3a None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:08.684441 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: WARNING keystone.server.flask.common [None req-ed7093d5-3fcd-4c55-9ca9-0e5402471f3a None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 20 05:59:08.693371 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:08.697667 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.sql.core [None req-ed7093d5-3fcd-4c55-9ca9-0e5402471f3a None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 20 05:59:08.697667 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 20 05:59:08.697667 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [parameters: {'user_id': 'cfaad3ada34345528ac87b9b2d326e8b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 20 05:59:08.697667 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80272) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 20 05:59:08.704971 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16828771-afac-4d08-9c61-8b19af6b98e9 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:08.714791 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-ed7093d5-3fcd-4c55-9ca9-0e5402471f3a None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 20 05:59:08.714791 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:08.714791 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 20 05:59:08.714791 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 20 05:59:08.714791 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 20 05:59:08.714791 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 20 05:59:08.714791 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 20 05:59:08.714791 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application result = self._query(query) Jun 20 05:59:08.714791 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 20 05:59:08.714791 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application conn.query(q) Jun 20 05:59:08.714791 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 20 05:59:08.714791 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 20 05:59:08.714791 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 20 05:59:08.714791 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application result.read() Jun 20 05:59:08.714791 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 20 05:59:08.715888 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 20 05:59:08.715888 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 20 05:59:08.715888 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 20 05:59:08.715888 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 20 05:59:08.715888 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 20 05:59:08.715888 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 20 05:59:08.715888 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 20 05:59:08.715888 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 20 05:59:08.715888 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:59:08.715888 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 20 05:59:08.715888 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:59:08.715888 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:08.715888 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 20 05:59:08.715888 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 20 05:59:08.715888 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 20 05:59:08.715888 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 20 05:59:08.715888 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 20 05:59:08.715888 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application next(self.gen) Jun 20 05:59:08.717813 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 20 05:59:08.717813 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application yield resource Jun 20 05:59:08.717813 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 20 05:59:08.717813 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application next(self.gen) Jun 20 05:59:08.717813 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 20 05:59:08.717813 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application self.session.rollback() Jun 20 05:59:08.717813 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 05:59:08.717813 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application self.force_reraise() Jun 20 05:59:08.717813 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 05:59:08.717813 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise self.value Jun 20 05:59:08.717813 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 20 05:59:08.717813 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 20 05:59:08.717813 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 20 05:59:08.717813 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application session.commit() Jun 20 05:59:08.717813 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 20 05:59:08.717813 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 20 05:59:08.717813 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 20 05:59:08.720336 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application self._prepare_impl() Jun 20 05:59:08.720336 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 20 05:59:08.720336 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application self.session.flush() Jun 20 05:59:08.720336 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 20 05:59:08.720336 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application self._flush(objects) Jun 20 05:59:08.720336 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 20 05:59:08.720336 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 20 05:59:08.720336 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 20 05:59:08.720336 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application compat.raise_( Jun 20 05:59:08.720336 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 20 05:59:08.720336 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception Jun 20 05:59:08.720336 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 20 05:59:08.720336 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application flush_context.execute() Jun 20 05:59:08.720336 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 20 05:59:08.720336 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rec.execute(self) Jun 20 05:59:08.720336 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 20 05:59:08.720336 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 20 05:59:08.722663 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 20 05:59:08.722663 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 20 05:59:08.722663 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 20 05:59:08.722663 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 20 05:59:08.722663 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 20 05:59:08.722663 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 20 05:59:08.722663 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 20 05:59:08.722663 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 20 05:59:08.722663 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 20 05:59:08.722663 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 20 05:59:08.722663 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 20 05:59:08.722663 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 20 05:59:08.722663 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 20 05:59:08.722663 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 20 05:59:08.722663 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 20 05:59:08.722663 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception Jun 20 05:59:08.724769 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 20 05:59:08.724769 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 20 05:59:08.724769 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 20 05:59:08.724769 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 20 05:59:08.724769 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 20 05:59:08.724769 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application result = self._query(query) Jun 20 05:59:08.724769 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 20 05:59:08.724769 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application conn.query(q) Jun 20 05:59:08.724769 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 20 05:59:08.724769 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 20 05:59:08.724769 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 20 05:59:08.724769 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application result.read() Jun 20 05:59:08.724769 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 20 05:59:08.724769 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 20 05:59:08.724769 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 20 05:59:08.724769 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 20 05:59:08.727298 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 20 05:59:08.727298 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 20 05:59:08.727298 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 20 05:59:08.727298 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 20 05:59:08.727298 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 20 05:59:08.727298 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 20 05:59:08.727298 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [parameters: {'user_id': 'cfaad3ada34345528ac87b9b2d326e8b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 20 05:59:08.727298 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 20 05:59:08.727298 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:59:08.727298 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:59:08.727298 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:59:08.727298 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:08.727298 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:08.727298 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:08.727298 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:08.729788 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:08.729788 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:08.729788 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:08.729788 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:08.729788 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:08.729788 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:08.729788 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:08.729788 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 20 05:59:08.729788 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 20 05:59:08.729788 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:08.729788 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:08.729788 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:59:08.729788 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:59:08.729788 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:59:08.729788 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:59:08.729788 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 20 05:59:08.729788 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 20 05:59:08.731873 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 20 05:59:08.731873 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 20 05:59:08.731873 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 20 05:59:08.731873 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 20 05:59:08.731873 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 20 05:59:08.731873 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:59:08.731873 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 476/958] 10.222.0.39 () {60 vars in 1131 bytes} [Mon Jun 20 05:59:08 2022] POST /identity/v3/users => generated 160 bytes in 191 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:08.731873 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7093d5-3fcd-4c55-9ca9-0e5402471f3a None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:08.748251 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dccc547-3469-476a-b357-54caa7a319c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:08.749814 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dccc547-3469-476a-b357-54caa7a319c1 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:08.750197 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dccc547-3469-476a-b357-54caa7a319c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:08.750571 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dccc547-3469-476a-b357-54caa7a319c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:08.758091 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dccc547-3469-476a-b357-54caa7a319c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:08.759628 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dccc547-3469-476a-b357-54caa7a319c1 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:08.773572 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-9dccc547-3469-476a-b357-54caa7a319c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:59:08.773572 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:08.773572 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:08.773572 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:08.773572 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:08.773572 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:08.773572 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:08.773572 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:08.773572 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:08.773572 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:08.773572 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:08.773572 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:08.773572 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:59:08.773572 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:59:08.773572 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:59:08.774618 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:59:08.774618 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:08.774618 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:08.774618 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:08.774618 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:08.774618 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:08.774618 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:08.774618 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:08.774618 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:08.774618 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:08.774618 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:08.774618 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:08.774618 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:08.774618 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:08.774618 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:08.774618 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:08.774618 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:08.775671 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:59:08.775671 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:59:08.775671 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:59:08.775671 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:59:08.775671 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:59:08.775671 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:59:08.775671 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:59:08.775671 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:08.778714 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:08.779694 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 483/959] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jun 20 05:59:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:08.780483 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dccc547-3469-476a-b357-54caa7a319c1 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:08.853763 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7093d5-3fcd-4c55-9ca9-0e5402471f3a None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:08.891056 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dccc547-3469-476a-b357-54caa7a319c1 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:08.894933 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46c2090-bbca-43d3-9fc8-9aa3611bd2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:08.895789 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c2090-bbca-43d3-9fc8-9aa3611bd2f2 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:08.896218 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c2090-bbca-43d3-9fc8-9aa3611bd2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:08.896639 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c2090-bbca-43d3-9fc8-9aa3611bd2f2 None admin] PATH_INFO: `/v3/services` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:08.897570 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46c2090-bbca-43d3-9fc8-9aa3611bd2f2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:08.898024 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46c2090-bbca-43d3-9fc8-9aa3611bd2f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:08.899826 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46c2090-bbca-43d3-9fc8-9aa3611bd2f2 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:08.913640 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 477/960] 10.222.0.39 () {56 vars in 1122 bytes} [Mon Jun 20 05:59:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:08.914679 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46c2090-bbca-43d3-9fc8-9aa3611bd2f2 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:08.927638 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d589418c-23bb-428f-bce3-358512d9141a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:08.928485 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589418c-23bb-428f-bce3-358512d9141a None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:08.928796 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589418c-23bb-428f-bce3-358512d9141a None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:08.929068 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589418c-23bb-428f-bce3-358512d9141a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:08.937568 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d589418c-23bb-428f-bce3-358512d9141a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:08.939004 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d589418c-23bb-428f-bce3-358512d9141a None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:08.953982 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-d589418c-23bb-428f-bce3-358512d9141a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 05:59:08.953982 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:08.953982 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:08.953982 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:08.953982 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:08.953982 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:08.953982 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:08.953982 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:08.953982 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:08.953982 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:08.953982 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:08.953982 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:08.953982 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:59:08.953982 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:59:08.953982 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:59:08.953982 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:59:08.954923 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:08.954923 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:08.954923 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:59:08.954923 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:59:08.954923 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:59:08.954923 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:59:08.954923 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:08.954923 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:08.954923 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:08.954923 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:08.954923 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:08.954923 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:08.954923 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:08.954923 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:08.954923 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:08.954923 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:08.954923 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:08.954923 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:08.955867 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:08.955867 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:08.955867 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:59:08.955867 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:59:08.955867 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:59:08.955867 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:59:08.955867 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:59:08.955867 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:59:08.955867 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 05:59:08.955867 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:08.955867 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 484/961] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 05:59:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:08.955867 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d589418c-23bb-428f-bce3-358512d9141a None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:08.972391 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:09.025172 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46c2090-bbca-43d3-9fc8-9aa3611bd2f2 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:09.028279 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:09.062258 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a9408-b650-4059-a255-2b81e0b82611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:09.062919 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a9408-b650-4059-a255-2b81e0b82611 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:09.063202 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a9408-b650-4059-a255-2b81e0b82611 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:09.063478 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a9408-b650-4059-a255-2b81e0b82611 None admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:09.064256 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9a9408-b650-4059-a255-2b81e0b82611 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:09.064566 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9a9408-b650-4059-a255-2b81e0b82611 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:09.066020 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9a9408-b650-4059-a255-2b81e0b82611 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:09.066530 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d589418c-23bb-428f-bce3-358512d9141a None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:09.079650 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 478/962] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jun 20 05:59:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:09.080463 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a9408-b650-4059-a255-2b81e0b82611 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:09.105712 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c4816a-faa6-40ad-90e7-5ca7cb2dc613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:09.106434 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4816a-faa6-40ad-90e7-5ca7cb2dc613 None admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:09.106716 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4816a-faa6-40ad-90e7-5ca7cb2dc613 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:09.106992 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4816a-faa6-40ad-90e7-5ca7cb2dc613 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:09.107894 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c4816a-faa6-40ad-90e7-5ca7cb2dc613 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:09.110059 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c4816a-faa6-40ad-90e7-5ca7cb2dc613 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:09.130928 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 485/963] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Jun 20 05:59:08 2022] POST /identity/v3/endpoints => generated 349 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:59:09.131835 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c4816a-faa6-40ad-90e7-5ca7cb2dc613 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:09.214087 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a9408-b650-4059-a255-2b81e0b82611 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:09.229730 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:09.269661 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a3571-702d-4b91-907a-8bef3ffe1591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:09.270498 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a3571-702d-4b91-907a-8bef3ffe1591 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:09.270968 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a3571-702d-4b91-907a-8bef3ffe1591 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:09.271126 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a3571-702d-4b91-907a-8bef3ffe1591 None admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:09.272410 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480a3571-702d-4b91-907a-8bef3ffe1591 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:09.272410 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480a3571-702d-4b91-907a-8bef3ffe1591 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:09.273967 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480a3571-702d-4b91-907a-8bef3ffe1591 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:09.276171 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c4816a-faa6-40ad-90e7-5ca7cb2dc613 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:09.314454 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d7303-b1de-4f79-b0ae-442d4de82ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:09.314681 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 479/964] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jun 20 05:59:09 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:09.315780 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d7303-b1de-4f79-b0ae-442d4de82ff4 None admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:09.316239 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d7303-b1de-4f79-b0ae-442d4de82ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:09.316687 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d7303-b1de-4f79-b0ae-442d4de82ff4 None admin] PATH_INFO: `/v3/projects/b349043204b34d1794818184ffe6505c/users/8c0f131484cb48d289cae1f473ec2fbc/roles/b20a688ed203460d9430dd8aa432756b` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:09.319248 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4d7303-b1de-4f79-b0ae-442d4de82ff4 None admin] RBAC: Authorizing `identity:create_grant(project_id=b349043204b34d1794818184ffe6505c, user_id=8c0f131484cb48d289cae1f473ec2fbc, role_id=b20a688ed203460d9430dd8aa432756b)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:09.321010 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4d7303-b1de-4f79-b0ae-442d4de82ff4 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:09.341166 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 486/965] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jun 20 05:59:09 2022] PUT /identity/v3/projects/b349043204b34d1794818184ffe6505c/users/8c0f131484cb48d289cae1f473ec2fbc/roles/b20a688ed203460d9430dd8aa432756b => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:59:09.772084 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e979f-9df5-489f-ae7f-edd8f404d974 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:09.772378 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e979f-9df5-489f-ae7f-edd8f404d974 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:09.772662 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e979f-9df5-489f-ae7f-edd8f404d974 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:09.774094 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 480/966] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:59:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:09.779566 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906ccfd-3206-4edd-a258-c2a226f2c21e None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:09.779856 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906ccfd-3206-4edd-a258-c2a226f2c21e None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:09.780748 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906ccfd-3206-4edd-a258-c2a226f2c21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:09.797959 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-b906ccfd-3206-4edd-a258-c2a226f2c21e None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:09.799130 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-b906ccfd-3206-4edd-a258-c2a226f2c21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:09.867709 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 487/967] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:59:09.891857 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e979f-9df5-489f-ae7f-edd8f404d974 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:09.913509 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:10.001489 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e979f-9df5-489f-ae7f-edd8f404d974 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:10.036008 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e617c-742d-47c6-90f6-ad3ec743691a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:10.036600 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e617c-742d-47c6-90f6-ad3ec743691a None admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:10.036918 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e617c-742d-47c6-90f6-ad3ec743691a None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:10.037197 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e617c-742d-47c6-90f6-ad3ec743691a None admin] PATH_INFO: `/v3/services` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:10.037926 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645e617c-742d-47c6-90f6-ad3ec743691a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:10.039289 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645e617c-742d-47c6-90f6-ad3ec743691a None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:10.052746 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 481/968] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Jun 20 05:59:09 2022] POST /identity/v3/services => generated 242 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 05:59:11.346819 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7a8a8-c1a9-481f-9451-1be9e8e4f3fc None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:11.347378 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7a8a8-c1a9-481f-9451-1be9e8e4f3fc None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:11.347378 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7a8a8-c1a9-481f-9451-1be9e8e4f3fc None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:11.348816 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 488/969] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:59:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:11.353885 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf359e81-5371-47f3-9404-c66ed9b4618a None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:11.354284 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf359e81-5371-47f3-9404-c66ed9b4618a None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:11.354462 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf359e81-5371-47f3-9404-c66ed9b4618a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:11.371394 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-bf359e81-5371-47f3-9404-c66ed9b4618a None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:11.372935 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-bf359e81-5371-47f3-9404-c66ed9b4618a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:11.387675 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47326e-8fe6-4170-8e0d-36419587427e None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:11.387962 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47326e-8fe6-4170-8e0d-36419587427e None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:11.388233 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47326e-8fe6-4170-8e0d-36419587427e None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:11.390252 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 489/970] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:59:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:59:11.395264 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a11b83-01fd-4026-91ce-b4a1de798817 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:11.395552 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a11b83-01fd-4026-91ce-b4a1de798817 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:11.395829 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a11b83-01fd-4026-91ce-b4a1de798817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:11.412658 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-26a11b83-01fd-4026-91ce-b4a1de798817 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:11.413894 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-26a11b83-01fd-4026-91ce-b4a1de798817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:11.451402 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 482/971] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:11 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:59:11.474650 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf359e81-5371-47f3-9404-c66ed9b4618a None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:11.477261 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:11.477739 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:11.498487 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 490/972] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:11 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 05:59:11.522534 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a11b83-01fd-4026-91ce-b4a1de798817 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:11.581143 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf359e81-5371-47f3-9404-c66ed9b4618a None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:11.615152 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55aa02b-6631-424f-9448-d6f510d90f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:11.615882 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55aa02b-6631-424f-9448-d6f510d90f3d None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:11.616164 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55aa02b-6631-424f-9448-d6f510d90f3d None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:11.616441 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55aa02b-6631-424f-9448-d6f510d90f3d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:11.617134 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55aa02b-6631-424f-9448-d6f510d90f3d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:11.618515 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55aa02b-6631-424f-9448-d6f510d90f3d None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:11.628846 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a11b83-01fd-4026-91ce-b4a1de798817 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:11.631119 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-d55aa02b-6631-424f-9448-d6f510d90f3d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 05:59:11.631119 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:11.631119 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:59:11.631119 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:59:11.631119 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:59:11.631119 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:59:11.631119 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:59:11.631119 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:59:11.631119 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 05:59:11.631119 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:59:11.631119 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:59:11.631119 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:59:11.631119 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:11.631119 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:11.631119 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:11.631119 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:11.631119 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:11.632460 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:11.632460 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:11.632460 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:11.632460 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:11.632460 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:11.632460 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:11.632460 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:59:11.632460 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:59:11.632460 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:59:11.632460 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:59:11.632460 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:11.632460 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:11.632460 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:11.632460 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:11.632460 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:11.632460 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:11.633675 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:11.633675 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:11.633675 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:11.633675 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:11.633675 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:11.633675 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:11.633675 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:11.633675 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:11.633675 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:11.633675 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:11.633675 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:59:11.633675 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:59:11.633675 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 05:59:11.633675 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:59:11.633675 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 483/973] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Jun 20 05:59:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:59:11.638032 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55aa02b-6631-424f-9448-d6f510d90f3d None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:11.671278 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a8af7-5749-4555-9dc6-f751109cdc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:11.672369 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a8af7-5749-4555-9dc6-f751109cdc30 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:11.672833 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a8af7-5749-4555-9dc6-f751109cdc30 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:11.673290 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a8af7-5749-4555-9dc6-f751109cdc30 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:11.685543 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5a8af7-5749-4555-9dc6-f751109cdc30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:59:11.694546 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-ee5a8af7-5749-4555-9dc6-f751109cdc30 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 05:59:11.694546 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:11.694546 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:11.694546 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:11.694546 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:11.694546 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:11.694546 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:11.694546 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:11.694546 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:11.694546 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:11.694546 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:11.694546 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:11.694546 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:59:11.694546 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:59:11.694546 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:59:11.694546 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:59:11.695480 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:59:11.695480 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:59:11.695480 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:59:11.695480 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:59:11.695480 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:11.695480 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:11.695480 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:11.695480 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:11.695480 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:11.695480 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:11.695480 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:11.695480 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:11.695480 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:11.695480 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:11.695480 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:11.695480 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:11.696310 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:11.696310 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:11.696310 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:11.696310 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:11.696310 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:59:11.696310 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:59:11.696310 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:59:11.696310 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:59:11.696310 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:59:11.696310 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:59:11.696310 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 05:59:11.696310 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:11.696310 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 491/974] 10.222.0.39 () {56 vars in 1120 bytes} [Mon Jun 20 05:59:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:11.702002 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a8af7-5749-4555-9dc6-f751109cdc30 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:11.709399 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:11.745158 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55aa02b-6631-424f-9448-d6f510d90f3d None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:11.751104 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:11.782775 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a48fe8-3378-4a60-8e94-7b9997bbf00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:11.783446 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a48fe8-3378-4a60-8e94-7b9997bbf00b None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:11.783743 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a48fe8-3378-4a60-8e94-7b9997bbf00b None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:11.784027 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a48fe8-3378-4a60-8e94-7b9997bbf00b None admin] PATH_INFO: `/v3/services` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:11.784760 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a48fe8-3378-4a60-8e94-7b9997bbf00b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:11.785075 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a48fe8-3378-4a60-8e94-7b9997bbf00b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:11.786449 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a48fe8-3378-4a60-8e94-7b9997bbf00b None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:11.791362 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 484/975] 10.222.0.39 () {56 vars in 1122 bytes} [Mon Jun 20 05:59:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:11.797492 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a48fe8-3378-4a60-8e94-7b9997bbf00b None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:11.815560 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a8af7-5749-4555-9dc6-f751109cdc30 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:11.850605 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebabca82-c0cb-4985-867f-f3ff173d1af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:11.851284 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabca82-c0cb-4985-867f-f3ff173d1af4 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:11.851571 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabca82-c0cb-4985-867f-f3ff173d1af4 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:11.851850 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabca82-c0cb-4985-867f-f3ff173d1af4 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:11.852597 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebabca82-c0cb-4985-867f-f3ff173d1af4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:11.852936 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebabca82-c0cb-4985-867f-f3ff173d1af4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:11.854307 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebabca82-c0cb-4985-867f-f3ff173d1af4 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:11.863495 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 492/976] 10.222.0.39 () {56 vars in 1115 bytes} [Mon Jun 20 05:59:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:11.869267 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebabca82-c0cb-4985-867f-f3ff173d1af4 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:11.905270 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a48fe8-3378-4a60-8e94-7b9997bbf00b None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:11.938722 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:11.944829 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3574929-ca86-42b4-81a7-6b44a382243d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:11.945500 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3574929-ca86-42b4-81a7-6b44a382243d None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:11.945785 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3574929-ca86-42b4-81a7-6b44a382243d None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:11.946060 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3574929-ca86-42b4-81a7-6b44a382243d None admin] PATH_INFO: `/v3/services` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:11.946759 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3574929-ca86-42b4-81a7-6b44a382243d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:11.947066 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3574929-ca86-42b4-81a7-6b44a382243d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:11.948429 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3574929-ca86-42b4-81a7-6b44a382243d None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:11.954597 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 485/977] 10.222.0.39 () {56 vars in 1122 bytes} [Mon Jun 20 05:59:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:11.960063 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3574929-ca86-42b4-81a7-6b44a382243d None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:11.982094 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebabca82-c0cb-4985-867f-f3ff173d1af4 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:11.991912 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:12.022912 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd68a9-d382-4917-bcd3-069079fd1712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:12.023717 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd68a9-d382-4917-bcd3-069079fd1712 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:12.023996 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd68a9-d382-4917-bcd3-069079fd1712 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:12.024261 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd68a9-d382-4917-bcd3-069079fd1712 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:12.035295 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bd68a9-d382-4917-bcd3-069079fd1712 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:12.036755 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bd68a9-d382-4917-bcd3-069079fd1712 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:12.053798 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-75bd68a9-d382-4917-bcd3-069079fd1712 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:59:12.053798 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:12.053798 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:12.053798 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:12.053798 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:12.053798 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:12.053798 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:12.053798 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:12.053798 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:12.053798 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:12.053798 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:12.053798 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:12.053798 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:59:12.053798 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:59:12.053798 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:59:12.054731 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:59:12.054731 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:12.054731 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:12.054731 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:12.054731 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:12.054731 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:12.054731 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:12.054731 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:12.054731 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:12.054731 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:12.054731 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:12.054731 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:12.054731 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:12.054731 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:12.054731 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:12.054731 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:12.054731 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:12.055643 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:59:12.055643 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:59:12.055643 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:59:12.055643 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:12.055643 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 493/978] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:59:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:59:12.060598 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd68a9-d382-4917-bcd3-069079fd1712 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:12.069174 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3574929-ca86-42b4-81a7-6b44a382243d None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:12.103951 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ec1aeb-ba04-4fa5-a7df-95cba4f8339c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:12.104624 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec1aeb-ba04-4fa5-a7df-95cba4f8339c None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:12.104950 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec1aeb-ba04-4fa5-a7df-95cba4f8339c None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:12.105230 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec1aeb-ba04-4fa5-a7df-95cba4f8339c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:12.106043 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ec1aeb-ba04-4fa5-a7df-95cba4f8339c None admin] RBAC: Adding query filter params (interface=admin, service_id=221a7a49b37d4780bf9e01491f6b6e9f, region_id=RegionOne) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:12.106359 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ec1aeb-ba04-4fa5-a7df-95cba4f8339c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:12.107745 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ec1aeb-ba04-4fa5-a7df-95cba4f8339c None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:12.113266 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 486/979] 10.222.0.39 () {56 vars in 1249 bytes} [Mon Jun 20 05:59:11 2022] GET /identity/v3/endpoints?service_id=221a7a49b37d4780bf9e01491f6b6e9f&interface=admin®ion_id=RegionOne => generated 193 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:12.118549 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ec1aeb-ba04-4fa5-a7df-95cba4f8339c None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:12.172081 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd68a9-d382-4917-bcd3-069079fd1712 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:12.178197 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:12.208534 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e04e23-ee5f-4a44-825e-a6e92a0d7916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:12.209292 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e04e23-ee5f-4a44-825e-a6e92a0d7916 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:12.209580 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e04e23-ee5f-4a44-825e-a6e92a0d7916 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:12.209860 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e04e23-ee5f-4a44-825e-a6e92a0d7916 None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:12.210591 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e04e23-ee5f-4a44-825e-a6e92a0d7916 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:12.210910 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e04e23-ee5f-4a44-825e-a6e92a0d7916 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:12.212275 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e04e23-ee5f-4a44-825e-a6e92a0d7916 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:12.222411 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ec1aeb-ba04-4fa5-a7df-95cba4f8339c None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:12.223998 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 494/980] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:59:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:12.225267 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ba94a-d92f-4715-93d6-3d0e2d681389 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:12.225557 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ba94a-d92f-4715-93d6-3d0e2d681389 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:12.225835 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ba94a-d92f-4715-93d6-3d0e2d681389 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:12.227063 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 495/981] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:59:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:12.229295 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ba94a-d92f-4715-93d6-3d0e2d681389 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:12.251650 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:12.261315 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efffc89b-f594-4de5-b1a8-1d892a6e5e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:12.261984 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efffc89b-f594-4de5-b1a8-1d892a6e5e23 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:12.262269 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efffc89b-f594-4de5-b1a8-1d892a6e5e23 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:12.262548 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efffc89b-f594-4de5-b1a8-1d892a6e5e23 None admin] PATH_INFO: `/v3/services` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:12.263228 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efffc89b-f594-4de5-b1a8-1d892a6e5e23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:12.264806 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efffc89b-f594-4de5-b1a8-1d892a6e5e23 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:12.271041 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 487/982] 10.222.0.39 () {56 vars in 1087 bytes} [Mon Jun 20 05:59:12 2022] GET /identity/v3/services => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 05:59:12.272215 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38bf66-007e-4dcd-80a2-d71645af8899 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:12.272502 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38bf66-007e-4dcd-80a2-d71645af8899 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:12.272807 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38bf66-007e-4dcd-80a2-d71645af8899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:12.290129 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-dd38bf66-007e-4dcd-80a2-d71645af8899 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:12.291372 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-dd38bf66-007e-4dcd-80a2-d71645af8899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:12.343350 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ba94a-d92f-4715-93d6-3d0e2d681389 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:12.369189 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 488/983] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:12 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:59:12.384475 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c74190-ff4c-4212-a0d0-42524524a5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:12.385340 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c74190-ff4c-4212-a0d0-42524524a5f6 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:12.385625 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c74190-ff4c-4212-a0d0-42524524a5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:12.385903 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c74190-ff4c-4212-a0d0-42524524a5f6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:12.393543 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd38bf66-007e-4dcd-80a2-d71645af8899 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:12.394675 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c74190-ff4c-4212-a0d0-42524524a5f6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:12.396316 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c74190-ff4c-4212-a0d0-42524524a5f6 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:12.414055 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-72c74190-ff4c-4212-a0d0-42524524a5f6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 05:59:12.414055 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:12.414055 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:12.414055 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:12.414055 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:12.414055 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:12.414055 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:12.414055 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:12.414055 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:12.414055 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:12.414055 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:12.414055 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:12.414055 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:59:12.414055 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:59:12.414055 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:59:12.414055 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:59:12.415201 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:12.415201 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:12.415201 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:59:12.415201 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:59:12.415201 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:59:12.415201 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:59:12.415201 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:12.415201 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:12.415201 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:12.415201 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:12.415201 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:12.415201 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:12.415201 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:12.415201 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:12.415201 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:12.415201 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:12.415201 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:12.415201 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:12.416196 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:12.416196 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:12.416196 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:59:12.416196 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:59:12.416196 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:59:12.416196 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:59:12.416196 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:59:12.416196 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:59:12.416196 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 05:59:12.416196 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:12.416196 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 496/984] 10.222.0.39 () {56 vars in 1117 bytes} [Mon Jun 20 05:59:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:59:12.422343 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c74190-ff4c-4212-a0d0-42524524a5f6 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:12.462291 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:12.515134 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd38bf66-007e-4dcd-80a2-d71645af8899 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:12.522795 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:12.544788 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c74190-ff4c-4212-a0d0-42524524a5f6 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:12.551028 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c29bd-59b3-4435-beb0-6f232b366192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:12.551827 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c29bd-59b3-4435-beb0-6f232b366192 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:12.552110 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c29bd-59b3-4435-beb0-6f232b366192 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:12.552387 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c29bd-59b3-4435-beb0-6f232b366192 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:12.553080 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c29bd-59b3-4435-beb0-6f232b366192 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:12.554456 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c29bd-59b3-4435-beb0-6f232b366192 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:12.566470 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-265c29bd-59b3-4435-beb0-6f232b366192 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 05:59:12.566470 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:12.566470 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:59:12.566470 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:59:12.566470 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:59:12.566470 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:59:12.566470 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:59:12.566470 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:59:12.566470 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 05:59:12.566470 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:59:12.566470 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:59:12.566470 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:59:12.566470 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:12.566470 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:12.566470 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:12.566470 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:12.566470 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:12.567552 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:12.567552 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:12.567552 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:12.567552 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:12.567552 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:12.567552 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:12.567552 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:59:12.567552 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:59:12.567552 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:59:12.567552 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:59:12.567552 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:12.567552 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:12.567552 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:12.567552 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:12.567552 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:12.567552 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:12.568386 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:12.568386 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:12.568386 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:12.568386 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:12.568386 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:12.568386 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:12.568386 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:12.568386 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:12.568386 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:12.568386 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:12.568386 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:59:12.568386 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:59:12.568386 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 05:59:12.568386 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:59:12.568386 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 489/985] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jun 20 05:59:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:59:12.573707 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c29bd-59b3-4435-beb0-6f232b366192 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:12.584365 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925bc65d-59af-463f-b285-86a6399b6a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:12.585105 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925bc65d-59af-463f-b285-86a6399b6a91 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:12.585385 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925bc65d-59af-463f-b285-86a6399b6a91 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:12.585647 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925bc65d-59af-463f-b285-86a6399b6a91 None admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:12.586489 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925bc65d-59af-463f-b285-86a6399b6a91 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:12.586801 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925bc65d-59af-463f-b285-86a6399b6a91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:12.588247 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925bc65d-59af-463f-b285-86a6399b6a91 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:12.606876 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 497/986] 10.222.0.39 () {56 vars in 1149 bytes} [Mon Jun 20 05:59:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:12.612810 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925bc65d-59af-463f-b285-86a6399b6a91 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:12.677840 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c29bd-59b3-4435-beb0-6f232b366192 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:12.695950 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:12.714644 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb6e981-48b2-4fe6-b9e5-0a7aaa75c0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:12.715309 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6e981-48b2-4fe6-b9e5-0a7aaa75c0ab None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:12.715593 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6e981-48b2-4fe6-b9e5-0a7aaa75c0ab None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:12.715872 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6e981-48b2-4fe6-b9e5-0a7aaa75c0ab None admin] PATH_INFO: `/v3/services` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:12.716581 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb6e981-48b2-4fe6-b9e5-0a7aaa75c0ab None admin] RBAC: Adding query filter params (name=compute) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:12.716916 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb6e981-48b2-4fe6-b9e5-0a7aaa75c0ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:12.717174 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925bc65d-59af-463f-b285-86a6399b6a91 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:12.718347 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb6e981-48b2-4fe6-b9e5-0a7aaa75c0ab None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:12.723671 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 490/987] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Jun 20 05:59:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:12.729008 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb6e981-48b2-4fe6-b9e5-0a7aaa75c0ab None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:12.754881 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c021d0-6b57-464a-92db-0f7e4864e006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:12.755533 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c021d0-6b57-464a-92db-0f7e4864e006 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:12.755821 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c021d0-6b57-464a-92db-0f7e4864e006 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:12.756097 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c021d0-6b57-464a-92db-0f7e4864e006 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:12.764549 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:12.830530 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c021d0-6b57-464a-92db-0f7e4864e006 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:12.832330 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c021d0-6b57-464a-92db-0f7e4864e006 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:12.840445 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb6e981-48b2-4fe6-b9e5-0a7aaa75c0ab None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:12.876871 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3982c48-4ccb-4cb1-b4e4-4707ef849887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:12.877542 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3982c48-4ccb-4cb1-b4e4-4707ef849887 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:12.877828 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3982c48-4ccb-4cb1-b4e4-4707ef849887 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:12.878484 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3982c48-4ccb-4cb1-b4e4-4707ef849887 None admin] PATH_INFO: `/v3/services` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:12.879226 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3982c48-4ccb-4cb1-b4e4-4707ef849887 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:12.879541 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3982c48-4ccb-4cb1-b4e4-4707ef849887 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:12.881287 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3982c48-4ccb-4cb1-b4e4-4707ef849887 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:12.887047 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 491/988] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Jun 20 05:59:12 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:12.892972 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3982c48-4ccb-4cb1-b4e4-4707ef849887 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:12.946340 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:12.949923 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 498/989] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 05:59:12 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 20 05:59:12.956671 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c021d0-6b57-464a-92db-0f7e4864e006 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:12.998191 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:13.011831 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3982c48-4ccb-4cb1-b4e4-4707ef849887 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:13.053008 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805042f1-a42b-4ea3-b38f-0a5f69259918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:13.053671 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805042f1-a42b-4ea3-b38f-0a5f69259918 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:13.053956 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805042f1-a42b-4ea3-b38f-0a5f69259918 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:13.054222 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805042f1-a42b-4ea3-b38f-0a5f69259918 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:13.055009 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805042f1-a42b-4ea3-b38f-0a5f69259918 None admin] RBAC: Adding query filter params (interface=public, service_id=71bd522817324a479e9bca3081f2888e, region_id=RegionOne) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:13.055322 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805042f1-a42b-4ea3-b38f-0a5f69259918 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:13.056691 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805042f1-a42b-4ea3-b38f-0a5f69259918 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:13.062414 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 492/990] 10.222.0.39 () {56 vars in 1251 bytes} [Mon Jun 20 05:59:12 2022] GET /identity/v3/endpoints?service_id=71bd522817324a479e9bca3081f2888e&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:13.067484 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805042f1-a42b-4ea3-b38f-0a5f69259918 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:13.071597 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c021d0-6b57-464a-92db-0f7e4864e006 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:13.109485 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d77d4-d868-4545-bb94-689b7ad31042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:13.110331 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d77d4-d868-4545-bb94-689b7ad31042 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:13.110618 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d77d4-d868-4545-bb94-689b7ad31042 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:13.110895 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d77d4-d868-4545-bb94-689b7ad31042 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:13.120913 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d77d4-d868-4545-bb94-689b7ad31042 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:13.122339 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d77d4-d868-4545-bb94-689b7ad31042 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:13.141189 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-802d77d4-d868-4545-bb94-689b7ad31042 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:59:13.141189 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:13.141189 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:13.141189 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:13.141189 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:13.141189 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:13.141189 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:13.141189 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:13.141189 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:13.141189 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:13.141189 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:13.141189 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:13.141189 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:59:13.141189 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:59:13.141189 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:59:13.142100 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:59:13.142100 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:13.142100 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:13.142100 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:13.142100 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:13.142100 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:13.142100 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:13.142100 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:13.142100 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:13.142100 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:13.142100 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:13.142100 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:13.142100 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:13.142100 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:13.142100 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:13.142100 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:13.142100 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:13.143014 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:59:13.143014 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:59:13.143014 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:59:13.143014 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:13.145071 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 499/991] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:59:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:13.147935 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d77d4-d868-4545-bb94-689b7ad31042 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:13.171085 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805042f1-a42b-4ea3-b38f-0a5f69259918 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:13.181753 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:13.208607 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2349fb-d3c2-44a9-ab0d-8906e75e3315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:13.209297 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2349fb-d3c2-44a9-ab0d-8906e75e3315 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:13.209579 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2349fb-d3c2-44a9-ab0d-8906e75e3315 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:13.209853 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2349fb-d3c2-44a9-ab0d-8906e75e3315 None admin] PATH_INFO: `/v3/services` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:13.210530 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2349fb-d3c2-44a9-ab0d-8906e75e3315 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:13.211897 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2349fb-d3c2-44a9-ab0d-8906e75e3315 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:13.219212 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 493/992] 10.222.0.39 () {56 vars in 1087 bytes} [Mon Jun 20 05:59:13 2022] GET /identity/v3/services => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 05:59:13.258878 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:13.272186 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d77d4-d868-4545-bb94-689b7ad31042 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:13.313136 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb60e8a-113e-4d79-8b54-42b953f8fe7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:13.313925 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb60e8a-113e-4d79-8b54-42b953f8fe7e None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:13.314104 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb60e8a-113e-4d79-8b54-42b953f8fe7e None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:13.314377 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb60e8a-113e-4d79-8b54-42b953f8fe7e None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:13.315119 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb60e8a-113e-4d79-8b54-42b953f8fe7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:13.315424 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb60e8a-113e-4d79-8b54-42b953f8fe7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:13.316838 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb60e8a-113e-4d79-8b54-42b953f8fe7e None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:13.335357 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 500/993] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:59:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:13.336768 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2349fb-d3c2-44a9-ab0d-8906e75e3315 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:13.459294 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2349fb-d3c2-44a9-ab0d-8906e75e3315 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:13.495504 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ffeb3f-ebf7-4902-a41d-350b89592e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:13.496528 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffeb3f-ebf7-4902-a41d-350b89592e6d None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:13.496992 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffeb3f-ebf7-4902-a41d-350b89592e6d None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:13.497444 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffeb3f-ebf7-4902-a41d-350b89592e6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:13.505479 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ffeb3f-ebf7-4902-a41d-350b89592e6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:13.507074 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ffeb3f-ebf7-4902-a41d-350b89592e6d None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:13.523440 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-36ffeb3f-ebf7-4902-a41d-350b89592e6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:59:13.523440 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:13.523440 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:13.523440 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:13.523440 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:13.523440 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:13.523440 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:13.523440 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:13.523440 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:13.523440 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:13.523440 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:13.523440 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:13.523440 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:59:13.523440 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:59:13.523440 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:59:13.524434 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:59:13.524434 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:13.524434 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:13.524434 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:13.524434 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:13.524434 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:13.524434 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:13.524434 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:13.524434 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:13.524434 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:13.524434 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:13.524434 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:13.524434 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:13.524434 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:13.524434 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:13.524434 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:13.524434 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:13.525388 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:59:13.525388 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:59:13.525388 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:59:13.525388 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:59:13.525388 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:59:13.525388 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:59:13.525388 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:59:13.525388 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:59:13.526221 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 494/994] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jun 20 05:59:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:13.531372 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb60e8a-113e-4d79-8b54-42b953f8fe7e None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:13.635563 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb60e8a-113e-4d79-8b54-42b953f8fe7e None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:13.669568 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c25c6f1-5012-4055-8be3-da8a7aa98090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:13.670238 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c25c6f1-5012-4055-8be3-da8a7aa98090 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:13.670608 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c25c6f1-5012-4055-8be3-da8a7aa98090 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:13.671083 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c25c6f1-5012-4055-8be3-da8a7aa98090 None admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:13.671879 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c25c6f1-5012-4055-8be3-da8a7aa98090 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:13.672192 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c25c6f1-5012-4055-8be3-da8a7aa98090 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:13.673648 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c25c6f1-5012-4055-8be3-da8a7aa98090 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:13.691541 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 501/995] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jun 20 05:59:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:13.692773 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ffeb3f-ebf7-4902-a41d-350b89592e6d None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:13.729477 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:13.802217 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ffeb3f-ebf7-4902-a41d-350b89592e6d None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:13.837176 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c390078-d10b-4db6-a04a-e73e9c890e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:13.837835 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c390078-d10b-4db6-a04a-e73e9c890e11 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:13.838122 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c390078-d10b-4db6-a04a-e73e9c890e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:13.838404 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c390078-d10b-4db6-a04a-e73e9c890e11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:13.839239 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c390078-d10b-4db6-a04a-e73e9c890e11 None admin] RBAC: Adding query filter params (role.id=b20a688ed203460d9430dd8aa432756b, scope.project.id=b349043204b34d1794818184ffe6505c, user.id=8c0f131484cb48d289cae1f473ec2fbc) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:13.839613 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c390078-d10b-4db6-a04a-e73e9c890e11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:13.841132 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c390078-d10b-4db6-a04a-e73e9c890e11 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:13.852844 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 495/996] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jun 20 05:59:13 2022] GET /identity/v3/role_assignments?user.id=8c0f131484cb48d289cae1f473ec2fbc&scope.project.id=b349043204b34d1794818184ffe6505c&role.id=b20a688ed203460d9430dd8aa432756b => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:14.308397 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982c664-037a-46fe-9ada-854d7fc56134 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:14.308815 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982c664-037a-46fe-9ada-854d7fc56134 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:14.308998 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982c664-037a-46fe-9ada-854d7fc56134 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:14.310529 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 502/997] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:59:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:14.316138 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4adadb-2f0b-4c07-89d0-36d6c5f315ee None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:14.316433 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4adadb-2f0b-4c07-89d0-36d6c5f315ee None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:14.316737 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4adadb-2f0b-4c07-89d0-36d6c5f315ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:14.333740 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-ac4adadb-2f0b-4c07-89d0-36d6c5f315ee None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:14.334935 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-ac4adadb-2f0b-4c07-89d0-36d6c5f315ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:14.407098 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 496/998] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:14 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:59:14.430572 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b982c664-037a-46fe-9ada-854d7fc56134 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:14.442916 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:14.546758 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b982c664-037a-46fe-9ada-854d7fc56134 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:14.582882 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a7713-bf9a-4210-998f-c9b9075fa15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:14.584041 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a7713-bf9a-4210-998f-c9b9075fa15e None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:14.584559 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a7713-bf9a-4210-998f-c9b9075fa15e None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:14.585131 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a7713-bf9a-4210-998f-c9b9075fa15e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:14.585985 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615a7713-bf9a-4210-998f-c9b9075fa15e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:14.587553 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615a7713-bf9a-4210-998f-c9b9075fa15e None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:14.600462 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-615a7713-bf9a-4210-998f-c9b9075fa15e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 05:59:14.600462 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:14.600462 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:59:14.600462 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:59:14.600462 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:59:14.600462 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:59:14.600462 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:59:14.600462 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:59:14.600462 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 05:59:14.600462 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:14.600462 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:59:14.600462 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:14.600462 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:14.600462 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:14.600462 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:14.600462 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:14.600462 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:14.601509 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:14.601509 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:14.601509 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:14.601509 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:14.601509 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:14.601509 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:14.601509 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:59:14.601509 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:59:14.601509 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:59:14.601509 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:59:14.601509 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:14.601509 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:14.601509 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:14.601509 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:14.601509 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:14.601509 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:14.602375 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:14.602375 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:14.602375 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:14.602375 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:14.602375 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:14.602375 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:14.602375 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:14.602375 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:14.602375 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:14.602375 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:14.602375 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:59:14.602375 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:59:14.602375 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 05:59:14.602375 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:14.602375 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 503/999] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Jun 20 05:59:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:14.610296 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4adadb-2f0b-4c07-89d0-36d6c5f315ee None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:14.638376 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:14.713000 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4adadb-2f0b-4c07-89d0-36d6c5f315ee None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:14.747881 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a99ab8b-6fa6-4cd2-882d-926d710f5b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:14.748856 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99ab8b-6fa6-4cd2-882d-926d710f5b9f None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:14.749348 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99ab8b-6fa6-4cd2-882d-926d710f5b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:14.749811 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99ab8b-6fa6-4cd2-882d-926d710f5b9f None admin] PATH_INFO: `/v3/services` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:14.750711 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a99ab8b-6fa6-4cd2-882d-926d710f5b9f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:14.751201 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a99ab8b-6fa6-4cd2-882d-926d710f5b9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:14.752782 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a99ab8b-6fa6-4cd2-882d-926d710f5b9f None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:14.758375 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 497/1000] 10.222.0.39 () {56 vars in 1122 bytes} [Mon Jun 20 05:59:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:14.763612 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a7713-bf9a-4210-998f-c9b9075fa15e None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:14.843405 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:14.869292 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a7713-bf9a-4210-998f-c9b9075fa15e None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:14.903098 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a5b7ac-71fe-4dc3-8fe3-ce88b9a201a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:14.903767 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5b7ac-71fe-4dc3-8fe3-ce88b9a201a2 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:14.904054 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5b7ac-71fe-4dc3-8fe3-ce88b9a201a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:14.904327 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5b7ac-71fe-4dc3-8fe3-ce88b9a201a2 None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:14.905363 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a5b7ac-71fe-4dc3-8fe3-ce88b9a201a2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:14.905678 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a5b7ac-71fe-4dc3-8fe3-ce88b9a201a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:14.907042 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a5b7ac-71fe-4dc3-8fe3-ce88b9a201a2 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:14.916375 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 504/1001] 10.222.0.39 () {56 vars in 1122 bytes} [Mon Jun 20 05:59:14 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:14.917921 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a99ab8b-6fa6-4cd2-882d-926d710f5b9f None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:15.017479 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:15.027473 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a99ab8b-6fa6-4cd2-882d-926d710f5b9f None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:15.061589 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16caf334-e36f-4f1f-93de-ef18e5b07586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:15.062236 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16caf334-e36f-4f1f-93de-ef18e5b07586 None admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:15.062515 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16caf334-e36f-4f1f-93de-ef18e5b07586 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:15.062784 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16caf334-e36f-4f1f-93de-ef18e5b07586 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:15.063519 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16caf334-e36f-4f1f-93de-ef18e5b07586 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:15.064972 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16caf334-e36f-4f1f-93de-ef18e5b07586 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:15.080937 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 498/1002] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Jun 20 05:59:14 2022] POST /identity/v3/endpoints => generated 325 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:59:15.302054 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86c512-e143-4f4d-8171-8fa85e2ccff5 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:15.302469 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86c512-e143-4f4d-8171-8fa85e2ccff5 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:15.302644 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86c512-e143-4f4d-8171-8fa85e2ccff5 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:15.304146 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 505/1003] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:59:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:15.309137 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22d5e3-6912-4f0d-843a-3b82a7217ecc None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:15.309438 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22d5e3-6912-4f0d-843a-3b82a7217ecc None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:15.309722 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22d5e3-6912-4f0d-843a-3b82a7217ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:15.327703 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-fa22d5e3-6912-4f0d-843a-3b82a7217ecc None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:15.328912 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-fa22d5e3-6912-4f0d-843a-3b82a7217ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:15.403255 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 499/1004] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:15 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:59:15.430672 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b86c512-e143-4f4d-8171-8fa85e2ccff5 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:15.540936 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b86c512-e143-4f4d-8171-8fa85e2ccff5 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:15.574751 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d7ea5-9896-4337-8d6b-a5d20932e9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:15.575484 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d7ea5-9896-4337-8d6b-a5d20932e9ce None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:15.575768 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d7ea5-9896-4337-8d6b-a5d20932e9ce None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:15.576045 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d7ea5-9896-4337-8d6b-a5d20932e9ce None admin] PATH_INFO: `/v3/services/compute` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:15.577311 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8d7ea5-9896-4337-8d6b-a5d20932e9ce None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:15.578800 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8d7ea5-9896-4337-8d6b-a5d20932e9ce None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:15.590630 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-da8d7ea5-9896-4337-8d6b-a5d20932e9ce None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 05:59:15.590630 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:15.590630 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:59:15.590630 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:59:15.590630 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:59:15.590630 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:59:15.590630 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:59:15.590630 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:59:15.590630 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 05:59:15.590630 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:15.590630 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:59:15.590630 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:15.590630 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:15.590630 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:15.590630 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:15.590630 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:15.590630 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:15.591732 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:15.591732 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:15.591732 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:15.591732 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:15.591732 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:15.591732 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:15.591732 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:59:15.591732 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:59:15.591732 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:59:15.591732 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:59:15.591732 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:15.591732 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:15.591732 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:15.591732 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:15.591732 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:15.591732 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:15.593723 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:15.593723 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:15.593723 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:15.593723 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:15.593723 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:15.593723 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:15.593723 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:15.593723 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:15.593723 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:15.593723 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:15.593723 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:59:15.593723 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:59:15.593723 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 05:59:15.593723 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:15.597010 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 506/1005] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jun 20 05:59:15 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:15.598479 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa22d5e3-6912-4f0d-843a-3b82a7217ecc None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:15.676733 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:15.703989 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa22d5e3-6912-4f0d-843a-3b82a7217ecc None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:15.741625 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22922d00-d5d1-4e0c-8b26-e9b91393fa9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:15.742293 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22922d00-d5d1-4e0c-8b26-e9b91393fa9f None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:15.742576 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22922d00-d5d1-4e0c-8b26-e9b91393fa9f None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:15.742849 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22922d00-d5d1-4e0c-8b26-e9b91393fa9f None admin] PATH_INFO: `/v3/services` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:15.743555 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22922d00-d5d1-4e0c-8b26-e9b91393fa9f None admin] RBAC: Adding query filter params (name=compute) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:15.743861 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22922d00-d5d1-4e0c-8b26-e9b91393fa9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:15.745265 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22922d00-d5d1-4e0c-8b26-e9b91393fa9f None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:15.750264 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 500/1006] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Jun 20 05:59:15 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:15.755655 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d7ea5-9896-4337-8d6b-a5d20932e9ce None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:15.758589 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:15.860251 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d7ea5-9896-4337-8d6b-a5d20932e9ce None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:15.893249 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c11873-5346-418b-974c-1dd0b00bb5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:15.893916 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c11873-5346-418b-974c-1dd0b00bb5f5 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:15.894199 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c11873-5346-418b-974c-1dd0b00bb5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:15.894475 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c11873-5346-418b-974c-1dd0b00bb5f5 None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:15.895179 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c11873-5346-418b-974c-1dd0b00bb5f5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:15.895488 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c11873-5346-418b-974c-1dd0b00bb5f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:15.897131 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c11873-5346-418b-974c-1dd0b00bb5f5 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:15.902015 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 507/1007] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Jun 20 05:59:15 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:15.908166 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22922d00-d5d1-4e0c-8b26-e9b91393fa9f None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:15.937771 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb94bc-5a3e-485b-9a1d-6e09b1a6d3fb None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:15.938041 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb94bc-5a3e-485b-9a1d-6e09b1a6d3fb None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:15.938320 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb94bc-5a3e-485b-9a1d-6e09b1a6d3fb None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:15.939698 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 508/1008] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:59:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:59:15.944400 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e670d90b-9898-4158-9430-9d7d113a714c None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:15.944689 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e670d90b-9898-4158-9430-9d7d113a714c None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:15.944992 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e670d90b-9898-4158-9430-9d7d113a714c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:15.962270 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-e670d90b-9898-4158-9430-9d7d113a714c None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:15.963460 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-e670d90b-9898-4158-9430-9d7d113a714c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:16.024168 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22922d00-d5d1-4e0c-8b26-e9b91393fa9f None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:16.036753 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:16.048762 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 509/1009] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:15 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 05:59:16.067840 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a248be49-f70b-4f4b-8af4-e7a859198459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:16.068407 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248be49-f70b-4f4b-8af4-e7a859198459 None admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:16.068786 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248be49-f70b-4f4b-8af4-e7a859198459 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:16.068919 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e670d90b-9898-4158-9430-9d7d113a714c None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:16.069063 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248be49-f70b-4f4b-8af4-e7a859198459 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:16.069923 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a248be49-f70b-4f4b-8af4-e7a859198459 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:16.071469 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a248be49-f70b-4f4b-8af4-e7a859198459 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:16.086321 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:16.100732 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 501/1010] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Jun 20 05:59:15 2022] POST /identity/v3/endpoints => generated 334 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:59:16.187309 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e670d90b-9898-4158-9430-9d7d113a714c None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:16.233363 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2691e869-0185-46b0-b01d-fb195971968f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:16.234193 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691e869-0185-46b0-b01d-fb195971968f None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:16.234473 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691e869-0185-46b0-b01d-fb195971968f None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:16.234744 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691e869-0185-46b0-b01d-fb195971968f None admin] PATH_INFO: `/v3/services/image` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:16.235413 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2691e869-0185-46b0-b01d-fb195971968f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:16.236866 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2691e869-0185-46b0-b01d-fb195971968f None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:16.256368 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-2691e869-0185-46b0-b01d-fb195971968f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 05:59:16.256368 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:16.256368 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:59:16.256368 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:59:16.256368 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:59:16.256368 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:59:16.256368 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:59:16.256368 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:59:16.256368 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 05:59:16.256368 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:16.256368 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:59:16.256368 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:16.256368 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:16.256368 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:16.256368 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:16.256368 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:16.256368 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:16.257694 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:16.257694 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:16.257694 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:16.257694 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:16.257694 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:16.257694 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:16.257694 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:59:16.257694 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:59:16.257694 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:59:16.257694 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:59:16.257694 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:16.257694 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:16.257694 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:16.257694 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:16.257694 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:16.257694 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:16.258753 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:16.258753 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:16.258753 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:16.258753 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:16.258753 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:16.258753 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:16.258753 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:16.258753 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:16.258753 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:16.258753 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:16.258753 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:59:16.258753 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:59:16.258753 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 05:59:16.258753 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:16.262430 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 510/1011] 10.222.0.39 () {56 vars in 1105 bytes} [Mon Jun 20 05:59:16 2022] GET /identity/v3/services/image => generated 86 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:59:16.263576 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a248be49-f70b-4f4b-8af4-e7a859198459 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:16.382572 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a248be49-f70b-4f4b-8af4-e7a859198459 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:16.432192 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d6a81-26ab-47f5-a066-96e6794d2212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:16.432891 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d6a81-26ab-47f5-a066-96e6794d2212 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:16.434007 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d6a81-26ab-47f5-a066-96e6794d2212 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:16.434007 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d6a81-26ab-47f5-a066-96e6794d2212 None admin] PATH_INFO: `/v3/services` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:16.434157 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556d6a81-26ab-47f5-a066-96e6794d2212 None admin] RBAC: Adding query filter params (name=image) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:16.434532 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556d6a81-26ab-47f5-a066-96e6794d2212 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:16.436421 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556d6a81-26ab-47f5-a066-96e6794d2212 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:16.447852 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2691e869-0185-46b0-b01d-fb195971968f None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:16.448895 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 502/1012] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:59:16 2022] GET /identity/v3/services?name=image => generated 122 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:16.529150 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:16.584715 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2691e869-0185-46b0-b01d-fb195971968f None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:16.627404 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07663b7-d0f3-4bc4-b9f1-16a27d28baec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:16.628081 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07663b7-d0f3-4bc4-b9f1-16a27d28baec None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:16.628364 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07663b7-d0f3-4bc4-b9f1-16a27d28baec None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:16.628646 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07663b7-d0f3-4bc4-b9f1-16a27d28baec None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:16.629387 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07663b7-d0f3-4bc4-b9f1-16a27d28baec None admin] RBAC: Adding query filter params (type=image) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:16.629700 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07663b7-d0f3-4bc4-b9f1-16a27d28baec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:16.631065 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07663b7-d0f3-4bc4-b9f1-16a27d28baec None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:16.644815 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 511/1013] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:59:16 2022] GET /identity/v3/services?type=image => generated 122 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:17.257954 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0b1f3-1586-4a91-bbb8-29b0e09fdff4 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:17.258481 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0b1f3-1586-4a91-bbb8-29b0e09fdff4 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:17.258481 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0b1f3-1586-4a91-bbb8-29b0e09fdff4 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:17.260012 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 503/1014] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:59:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:17.265450 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848986a0-d440-440d-bfbc-7c5db00992fc None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:17.265741 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848986a0-d440-440d-bfbc-7c5db00992fc None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:17.266016 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848986a0-d440-440d-bfbc-7c5db00992fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:17.283665 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-848986a0-d440-440d-bfbc-7c5db00992fc None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:17.284991 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-848986a0-d440-440d-bfbc-7c5db00992fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:17.354858 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 512/1015] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:17 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:59:17.379160 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0b1f3-1586-4a91-bbb8-29b0e09fdff4 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:17.450231 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:17.488173 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0b1f3-1586-4a91-bbb8-29b0e09fdff4 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:17.522718 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5357dde7-4a8b-4dfd-b5da-c23e5ebccc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:17.523432 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357dde7-4a8b-4dfd-b5da-c23e5ebccc68 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:17.523713 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357dde7-4a8b-4dfd-b5da-c23e5ebccc68 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:17.523985 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357dde7-4a8b-4dfd-b5da-c23e5ebccc68 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:17.525155 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5357dde7-4a8b-4dfd-b5da-c23e5ebccc68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:17.526581 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5357dde7-4a8b-4dfd-b5da-c23e5ebccc68 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:17.528340 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 504/1016] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:59:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:17.534150 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848986a0-d440-440d-bfbc-7c5db00992fc None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:17.587111 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:17.636644 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848986a0-d440-440d-bfbc-7c5db00992fc None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:17.669210 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb8d802-b248-441d-b83c-2c9345eb99ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:17.669862 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8d802-b248-441d-b83c-2c9345eb99ea None admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:17.670816 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8d802-b248-441d-b83c-2c9345eb99ea None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:17.671328 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8d802-b248-441d-b83c-2c9345eb99ea None admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:17.672042 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb8d802-b248-441d-b83c-2c9345eb99ea None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:17.673471 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb8d802-b248-441d-b83c-2c9345eb99ea None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:17.704740 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 513/1017] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Jun 20 05:59:17 2022] POST /identity/v3/projects => generated 311 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:59:18.343586 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb78c7-3f13-4df0-aca3-acb7b9c2583a None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:18.344119 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb78c7-3f13-4df0-aca3-acb7b9c2583a None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:18.344119 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb78c7-3f13-4df0-aca3-acb7b9c2583a None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:18.345591 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 505/1018] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:59:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:59:18.350907 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c9b04-3d80-42df-bf1d-44d5ddb7c214 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:18.351205 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c9b04-3d80-42df-bf1d-44d5ddb7c214 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:18.351487 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c9b04-3d80-42df-bf1d-44d5ddb7c214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:18.368809 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-864c9b04-3d80-42df-bf1d-44d5ddb7c214 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:18.370002 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-864c9b04-3d80-42df-bf1d-44d5ddb7c214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:18.445352 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 514/1019] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:18 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:59:18.466809 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb78c7-3f13-4df0-aca3-acb7b9c2583a None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:18.581495 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb78c7-3f13-4df0-aca3-acb7b9c2583a None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:18.610868 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:18.617962 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef51db-a829-4a64-b1dc-142d5c780f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:18.618780 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef51db-a829-4a64-b1dc-142d5c780f50 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:18.619065 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef51db-a829-4a64-b1dc-142d5c780f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:18.619338 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef51db-a829-4a64-b1dc-142d5c780f50 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:18.630380 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ef51db-a829-4a64-b1dc-142d5c780f50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:59:18.638438 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-44ef51db-a829-4a64-b1dc-142d5c780f50 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 05:59:18.638438 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:18.638438 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:18.638438 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:18.638438 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:18.638438 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:18.638438 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:18.638438 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:18.638438 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:18.638438 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:18.638438 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:18.638438 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:18.638438 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:59:18.638438 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:59:18.638438 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:59:18.638438 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:59:18.639470 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:59:18.639470 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:59:18.639470 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:59:18.639470 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:59:18.639470 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:18.639470 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:18.639470 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:18.639470 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:18.639470 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:18.639470 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:18.639470 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:18.639470 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:18.639470 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:18.639470 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:18.639470 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:18.639470 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:18.640317 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:18.640317 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:18.640317 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:18.640317 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:18.640317 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:59:18.640317 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:59:18.640317 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:59:18.640317 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:59:18.640317 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:59:18.640317 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:59:18.640317 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 05:59:18.640317 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:59:18.641652 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 506/1020] 10.222.0.39 () {56 vars in 1120 bytes} [Mon Jun 20 05:59:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:18.645647 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c9b04-3d80-42df-bf1d-44d5ddb7c214 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:18.679036 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:18.750830 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c9b04-3d80-42df-bf1d-44d5ddb7c214 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:18.766286 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f293dd3-9841-4923-ad57-347105f13ed1 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:18.766790 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f293dd3-9841-4923-ad57-347105f13ed1 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:18.767072 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f293dd3-9841-4923-ad57-347105f13ed1 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:18.768449 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 507/1021] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:59:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:59:18.773332 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9beb2-00a3-4431-a65a-a0dcc091966a None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:18.773617 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9beb2-00a3-4431-a65a-a0dcc091966a None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:18.773892 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9beb2-00a3-4431-a65a-a0dcc091966a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:18.786975 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e0331-c354-45a9-945f-0e37fea0087b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:18.787674 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e0331-c354-45a9-945f-0e37fea0087b None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:18.787957 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e0331-c354-45a9-945f-0e37fea0087b None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:18.788231 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e0331-c354-45a9-945f-0e37fea0087b None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:18.789003 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49e0331-c354-45a9-945f-0e37fea0087b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:18.789305 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49e0331-c354-45a9-945f-0e37fea0087b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:18.790659 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49e0331-c354-45a9-945f-0e37fea0087b None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:18.792627 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-9cc9beb2-00a3-4431-a65a-a0dcc091966a None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:18.794021 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-9cc9beb2-00a3-4431-a65a-a0dcc091966a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:18.800532 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 515/1022] 10.222.0.39 () {56 vars in 1115 bytes} [Mon Jun 20 05:59:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:18.805980 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e0331-c354-45a9-945f-0e37fea0087b None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:18.874038 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 508/1023] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:18 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 05:59:18.896862 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc9beb2-00a3-4431-a65a-a0dcc091966a None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:18.917725 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:18.926522 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e0331-c354-45a9-945f-0e37fea0087b None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:18.965178 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc3f339-f67d-4fb4-984b-499a45d30c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:18.966547 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3f339-f67d-4fb4-984b-499a45d30c3d None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:18.966982 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3f339-f67d-4fb4-984b-499a45d30c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:18.967267 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3f339-f67d-4fb4-984b-499a45d30c3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:18.980061 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc3f339-f67d-4fb4-984b-499a45d30c3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:18.981790 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc3f339-f67d-4fb4-984b-499a45d30c3d None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:19.001944 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-3fc3f339-f67d-4fb4-984b-499a45d30c3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:59:19.001944 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:19.001944 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:19.001944 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:19.001944 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:19.001944 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:19.001944 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:19.001944 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:19.001944 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:19.001944 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:19.001944 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:19.001944 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:19.001944 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:59:19.001944 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:59:19.001944 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:59:19.002927 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:59:19.002927 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:19.002927 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:19.002927 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:19.002927 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:19.002927 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:19.002927 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:19.002927 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:19.002927 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:19.002927 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:19.002927 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:19.002927 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:19.002927 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:19.002927 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:19.002927 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:19.002927 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:19.002927 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:19.004387 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:59:19.004387 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:59:19.004387 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:59:19.004387 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:19.004387 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 516/1024] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:59:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:59:19.005664 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc9beb2-00a3-4431-a65a-a0dcc091966a None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:19.008653 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc3f339-f67d-4fb4-984b-499a45d30c3d None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:19.027417 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:19.043374 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c6c55-8e9f-4ce6-872c-cd6615c0a582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:19.044040 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c6c55-8e9f-4ce6-872c-cd6615c0a582 None admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:19.044320 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c6c55-8e9f-4ce6-872c-cd6615c0a582 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:19.044593 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c6c55-8e9f-4ce6-872c-cd6615c0a582 None admin] PATH_INFO: `/v3/services` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:19.046844 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7c6c55-8e9f-4ce6-872c-cd6615c0a582 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:19.048221 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7c6c55-8e9f-4ce6-872c-cd6615c0a582 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:19.065903 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 509/1025] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Jun 20 05:59:18 2022] POST /identity/v3/services => generated 242 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 05:59:19.127878 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc3f339-f67d-4fb4-984b-499a45d30c3d None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:19.169725 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb88b9f-759d-479e-bad4-9367fa27ff9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:19.171066 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb88b9f-759d-479e-bad4-9367fa27ff9b None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:19.171351 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb88b9f-759d-479e-bad4-9367fa27ff9b None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:19.171627 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb88b9f-759d-479e-bad4-9367fa27ff9b None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:19.172365 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb88b9f-759d-479e-bad4-9367fa27ff9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:19.172675 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb88b9f-759d-479e-bad4-9367fa27ff9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:19.174105 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb88b9f-759d-479e-bad4-9367fa27ff9b None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:19.188050 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 517/1026] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:59:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:19.193545 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c6c55-8e9f-4ce6-872c-cd6615c0a582 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:19.302974 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c6c55-8e9f-4ce6-872c-cd6615c0a582 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:19.337434 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaee3e0-c626-4861-bb79-6cf86969f745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:19.338229 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaee3e0-c626-4861-bb79-6cf86969f745 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:19.338518 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaee3e0-c626-4861-bb79-6cf86969f745 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:19.338791 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaee3e0-c626-4861-bb79-6cf86969f745 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:19.347293 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaee3e0-c626-4861-bb79-6cf86969f745 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:19.348764 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaee3e0-c626-4861-bb79-6cf86969f745 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:19.364003 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-ccaee3e0-c626-4861-bb79-6cf86969f745 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 05:59:19.364003 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:19.364003 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:19.364003 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:19.364003 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:19.364003 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:19.364003 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:19.364003 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:19.364003 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:19.364003 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:19.364003 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:19.364003 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:19.364003 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:59:19.364003 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:59:19.364003 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:59:19.364003 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:59:19.365662 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:19.365662 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:19.365662 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:59:19.365662 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:59:19.365662 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:59:19.365662 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:59:19.365662 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:19.365662 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:19.365662 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:19.365662 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:19.365662 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:19.365662 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:19.365662 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:19.365662 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:19.365662 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:19.365662 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:19.365662 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:19.365662 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:19.366647 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:19.366647 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:19.366647 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:59:19.366647 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:59:19.366647 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:59:19.366647 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:59:19.366647 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:59:19.366647 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:59:19.366647 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 05:59:19.366647 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:59:19.366647 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 510/1027] 10.222.0.39 () {56 vars in 1093 bytes} [Mon Jun 20 05:59:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:19.375284 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb88b9f-759d-479e-bad4-9367fa27ff9b None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:19.378860 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:19.486522 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb88b9f-759d-479e-bad4-9367fa27ff9b None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:19.521311 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f2f59-25e5-4fcd-9e04-ba58871abefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:19.521989 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f2f59-25e5-4fcd-9e04-ba58871abefc None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:19.522281 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f2f59-25e5-4fcd-9e04-ba58871abefc None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:19.522552 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f2f59-25e5-4fcd-9e04-ba58871abefc None admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:19.523393 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5f2f59-25e5-4fcd-9e04-ba58871abefc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:19.523704 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5f2f59-25e5-4fcd-9e04-ba58871abefc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:19.525154 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5f2f59-25e5-4fcd-9e04-ba58871abefc None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:19.543660 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 518/1028] 10.222.0.39 () {56 vars in 1133 bytes} [Mon Jun 20 05:59:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:19.549860 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaee3e0-c626-4861-bb79-6cf86969f745 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:19.594210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:19.657035 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaee3e0-c626-4861-bb79-6cf86969f745 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:19.690647 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a89cab-0ede-4b99-be09-8a7e162c794c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:19.691300 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a89cab-0ede-4b99-be09-8a7e162c794c None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:19.691585 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a89cab-0ede-4b99-be09-8a7e162c794c None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:19.691862 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a89cab-0ede-4b99-be09-8a7e162c794c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:19.760339 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a89cab-0ede-4b99-be09-8a7e162c794c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:19.761818 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a89cab-0ede-4b99-be09-8a7e162c794c None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:19.783940 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03dd8cd-cf2c-4e56-90db-4ef5f12fcc64 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:19.784473 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03dd8cd-cf2c-4e56-90db-4ef5f12fcc64 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:19.784473 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03dd8cd-cf2c-4e56-90db-4ef5f12fcc64 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:19.785883 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 519/1029] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:59:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:59:19.791055 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6f52c-7628-4a08-8d5f-c764432c0fb1 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:19.791410 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6f52c-7628-4a08-8d5f-c764432c0fb1 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:19.791776 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6f52c-7628-4a08-8d5f-c764432c0fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:19.807586 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:19.808584 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-13e6f52c-7628-4a08-8d5f-c764432c0fb1 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:19.809777 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-13e6f52c-7628-4a08-8d5f-c764432c0fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:19.868275 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:19.874516 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 511/1030] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 05:59:19 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 05:59:19.880066 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a89cab-0ede-4b99-be09-8a7e162c794c None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:19.884205 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 520/1031] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:19 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 05:59:19.908358 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6f52c-7628-4a08-8d5f-c764432c0fb1 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:19.981492 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a89cab-0ede-4b99-be09-8a7e162c794c None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:20.006422 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6f52c-7628-4a08-8d5f-c764432c0fb1 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:20.017789 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e3f3b-e2d5-4510-a912-ac6fc9945027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:20.018580 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e3f3b-e2d5-4510-a912-ac6fc9945027 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:20.018869 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e3f3b-e2d5-4510-a912-ac6fc9945027 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:20.019144 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e3f3b-e2d5-4510-a912-ac6fc9945027 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:20.027470 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:20.031620 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79e3f3b-e2d5-4510-a912-ac6fc9945027 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:20.033128 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79e3f3b-e2d5-4510-a912-ac6fc9945027 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:20.040866 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3e43b-6a04-4bb6-b0b0-0769b5a53c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:20.041660 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3e43b-6a04-4bb6-b0b0-0769b5a53c82 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:20.041942 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3e43b-6a04-4bb6-b0b0-0769b5a53c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:20.042216 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3e43b-6a04-4bb6-b0b0-0769b5a53c82 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:20.043391 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d3e43b-6a04-4bb6-b0b0-0769b5a53c82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:20.045351 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d3e43b-6a04-4bb6-b0b0-0769b5a53c82 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:20.047160 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 521/1032] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:59:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:20.052469 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3e43b-6a04-4bb6-b0b0-0769b5a53c82 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:20.052596 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-c79e3f3b-e2d5-4510-a912-ac6fc9945027 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:59:20.052596 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:20.052596 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:20.052596 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:20.052596 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:20.052596 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:20.052596 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:20.052596 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:20.052596 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:20.052596 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:20.052596 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:20.052596 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:20.052596 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:59:20.052596 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:59:20.052596 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:59:20.053486 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:59:20.053486 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:20.053486 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:20.053486 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:20.053486 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:20.053486 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:20.053486 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:20.053486 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:20.053486 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:20.053486 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:20.053486 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:20.053486 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:20.053486 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:20.053486 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:20.053486 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:20.053486 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:20.053486 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:20.054370 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:59:20.054370 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:59:20.054370 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:59:20.054370 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:59:20.054370 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 512/1033] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:59:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:59:20.059163 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e3f3b-e2d5-4510-a912-ac6fc9945027 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:20.119527 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:20.163114 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e3f3b-e2d5-4510-a912-ac6fc9945027 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:20.167099 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3e43b-6a04-4bb6-b0b0-0769b5a53c82 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:20.202603 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ba814-3583-40ae-8b44-4efdda828e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:20.203242 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ba814-3583-40ae-8b44-4efdda828e97 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:20.203532 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ba814-3583-40ae-8b44-4efdda828e97 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:20.203804 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ba814-3583-40ae-8b44-4efdda828e97 None admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:20.204535 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4ba814-3583-40ae-8b44-4efdda828e97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:20.204872 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4ba814-3583-40ae-8b44-4efdda828e97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:20.206241 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4ba814-3583-40ae-8b44-4efdda828e97 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:20.206360 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4875742c-742a-44d6-9ede-97ef35e0b3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:20.207050 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875742c-742a-44d6-9ede-97ef35e0b3c7 None admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:20.207339 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875742c-742a-44d6-9ede-97ef35e0b3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:20.207617 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875742c-742a-44d6-9ede-97ef35e0b3c7 None admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:20.208337 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4875742c-742a-44d6-9ede-97ef35e0b3c7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:20.209799 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4875742c-742a-44d6-9ede-97ef35e0b3c7 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:20.223201 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 513/1034] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:59:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:20.224069 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ba814-3583-40ae-8b44-4efdda828e97 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:20.233243 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 522/1035] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Jun 20 05:59:20 2022] POST /identity/v3/users => generated 285 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 05:59:20.293290 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:20.347375 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ba814-3583-40ae-8b44-4efdda828e97 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:20.384499 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc4a6bb-83e8-471d-82fd-282f5aff3e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:20.385326 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4a6bb-83e8-471d-82fd-282f5aff3e67 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:20.385602 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4a6bb-83e8-471d-82fd-282f5aff3e67 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:20.385873 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4a6bb-83e8-471d-82fd-282f5aff3e67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:20.392961 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc4a6bb-83e8-471d-82fd-282f5aff3e67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:20.394398 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc4a6bb-83e8-471d-82fd-282f5aff3e67 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:20.409310 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-7dc4a6bb-83e8-471d-82fd-282f5aff3e67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:59:20.409310 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:20.409310 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:20.409310 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:20.409310 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:20.409310 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:20.409310 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:20.409310 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:20.409310 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:20.409310 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:20.409310 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:20.409310 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:20.409310 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:59:20.409310 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:59:20.409310 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:59:20.410234 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:59:20.410234 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:20.410234 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:20.410234 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:20.410234 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:20.410234 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:20.410234 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:20.410234 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:20.410234 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:20.410234 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:20.410234 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:20.410234 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:20.410234 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:20.410234 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:20.410234 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:20.410234 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:20.410234 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:20.411327 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:59:20.411327 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:59:20.411327 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:59:20.411327 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:59:20.411327 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:59:20.411327 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:59:20.411327 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:59:20.411327 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:59:20.411327 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 514/1036] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jun 20 05:59:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:59:20.416267 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4875742c-742a-44d6-9ede-97ef35e0b3c7 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:20.525814 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4875742c-742a-44d6-9ede-97ef35e0b3c7 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:20.540030 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:20.563558 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89389f39-ef47-4636-bbeb-c50487da5b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:20.564223 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89389f39-ef47-4636-bbeb-c50487da5b85 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:20.564504 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89389f39-ef47-4636-bbeb-c50487da5b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:20.564806 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89389f39-ef47-4636-bbeb-c50487da5b85 None admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:20.565596 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89389f39-ef47-4636-bbeb-c50487da5b85 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:20.565908 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89389f39-ef47-4636-bbeb-c50487da5b85 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:20.567333 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89389f39-ef47-4636-bbeb-c50487da5b85 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:20.584722 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 523/1037] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jun 20 05:59:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:20.586570 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc4a6bb-83e8-471d-82fd-282f5aff3e67 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:20.693980 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc4a6bb-83e8-471d-82fd-282f5aff3e67 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:20.707684 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:20.730123 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ba228-48ed-4019-bbee-bddf90f14420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:20.730784 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ba228-48ed-4019-bbee-bddf90f14420 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:20.731068 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ba228-48ed-4019-bbee-bddf90f14420 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:20.731344 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ba228-48ed-4019-bbee-bddf90f14420 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:20.732755 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72ba228-48ed-4019-bbee-bddf90f14420 None admin] RBAC: Adding query filter params (role.id=b20a688ed203460d9430dd8aa432756b, scope.project.id=b349043204b34d1794818184ffe6505c, user.id=3cee106502e54829ad802ee41c9165fa) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:20.733185 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72ba228-48ed-4019-bbee-bddf90f14420 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:20.734681 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72ba228-48ed-4019-bbee-bddf90f14420 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:20.748734 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 515/1038] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jun 20 05:59:20 2022] GET /identity/v3/role_assignments?user.id=3cee106502e54829ad802ee41c9165fa&scope.project.id=b349043204b34d1794818184ffe6505c&role.id=b20a688ed203460d9430dd8aa432756b => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:21.157854 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6f40c-6c44-4857-b1f2-0cac1fde2d46 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:21.158386 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6f40c-6c44-4857-b1f2-0cac1fde2d46 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:21.158386 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6f40c-6c44-4857-b1f2-0cac1fde2d46 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:21.159926 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 524/1039] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:59:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:21.165101 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6901de-3909-4a13-8b85-9cdac98ced4b None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:21.165395 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6901de-3909-4a13-8b85-9cdac98ced4b None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:21.165671 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6901de-3909-4a13-8b85-9cdac98ced4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:21.184853 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-ff6901de-3909-4a13-8b85-9cdac98ced4b None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:21.186211 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-ff6901de-3909-4a13-8b85-9cdac98ced4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:21.259043 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 516/1040] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:21 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:59:21.280049 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d6f40c-6c44-4857-b1f2-0cac1fde2d46 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:21.382848 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d6f40c-6c44-4857-b1f2-0cac1fde2d46 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:21.424939 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a25290e-a6e6-4146-ac94-7be39058d794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:21.425723 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25290e-a6e6-4146-ac94-7be39058d794 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:21.426002 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25290e-a6e6-4146-ac94-7be39058d794 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:21.426275 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25290e-a6e6-4146-ac94-7be39058d794 None admin] PATH_INFO: `/v3/services/image` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:21.426932 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a25290e-a6e6-4146-ac94-7be39058d794 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:21.428299 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a25290e-a6e6-4146-ac94-7be39058d794 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:21.441015 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-5a25290e-a6e6-4146-ac94-7be39058d794 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 05:59:21.441015 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:21.441015 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:59:21.441015 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:59:21.441015 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:59:21.441015 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:59:21.441015 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:59:21.441015 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:59:21.441015 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 05:59:21.441015 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:21.441015 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:59:21.441015 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:21.441015 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:21.441015 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:21.441015 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:21.441015 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:21.441015 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:21.442035 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:21.442035 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:21.442035 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:21.442035 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:21.442035 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:21.442035 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:21.442035 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:59:21.442035 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:59:21.442035 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:59:21.442035 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:59:21.442035 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:21.442035 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:21.442035 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:21.442035 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:21.442035 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:21.442035 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:21.442897 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:21.442897 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:21.442897 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:21.442897 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:21.442897 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:21.442897 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:21.442897 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:21.442897 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:21.442897 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:21.442897 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:21.442897 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:59:21.442897 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:59:21.442897 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 05:59:21.442897 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:21.442897 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 525/1041] 10.222.0.39 () {56 vars in 1105 bytes} [Mon Jun 20 05:59:21 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:21.449909 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6901de-3909-4a13-8b85-9cdac98ced4b None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:21.552719 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6901de-3909-4a13-8b85-9cdac98ced4b None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:21.559855 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:21.587675 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f23ae-ad95-478f-9fd8-3e143e371c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:21.588331 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f23ae-ad95-478f-9fd8-3e143e371c43 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:21.588608 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f23ae-ad95-478f-9fd8-3e143e371c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:21.588903 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f23ae-ad95-478f-9fd8-3e143e371c43 None admin] PATH_INFO: `/v3/services` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:21.589600 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382f23ae-ad95-478f-9fd8-3e143e371c43 None admin] RBAC: Adding query filter params (name=image) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:21.589902 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382f23ae-ad95-478f-9fd8-3e143e371c43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:21.591260 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382f23ae-ad95-478f-9fd8-3e143e371c43 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:21.600775 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 517/1042] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:59:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:21.603005 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a25290e-a6e6-4146-ac94-7be39058d794 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:21.642868 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:21.703644 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a25290e-a6e6-4146-ac94-7be39058d794 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:21.740519 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4ae88f-1367-4065-93c5-84f6a8bab2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:21.741212 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ae88f-1367-4065-93c5-84f6a8bab2ac None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:21.741492 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ae88f-1367-4065-93c5-84f6a8bab2ac None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:21.741765 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ae88f-1367-4065-93c5-84f6a8bab2ac None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:21.742466 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4ae88f-1367-4065-93c5-84f6a8bab2ac None admin] RBAC: Adding query filter params (type=image) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:21.742767 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4ae88f-1367-4065-93c5-84f6a8bab2ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:21.744119 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4ae88f-1367-4065-93c5-84f6a8bab2ac None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:21.753852 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 526/1043] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:59:21 2022] GET /identity/v3/services?type=image => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:21.755108 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f23ae-ad95-478f-9fd8-3e143e371c43 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:21.862274 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f23ae-ad95-478f-9fd8-3e143e371c43 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:21.899722 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d15d0-8804-4893-9589-4bd99ddb8c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:21.900386 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d15d0-8804-4893-9589-4bd99ddb8c41 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:21.900669 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d15d0-8804-4893-9589-4bd99ddb8c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:21.900974 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d15d0-8804-4893-9589-4bd99ddb8c41 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:21.901765 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012d15d0-8804-4893-9589-4bd99ddb8c41 None admin] RBAC: Adding query filter params (interface=public, service_id=08a72e0520b944b98f375732e914c369, region_id=RegionOne) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:21.902077 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012d15d0-8804-4893-9589-4bd99ddb8c41 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:21.903451 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012d15d0-8804-4893-9589-4bd99ddb8c41 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:21.912735 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 518/1044] 10.222.0.39 () {56 vars in 1251 bytes} [Mon Jun 20 05:59:21 2022] GET /identity/v3/endpoints?service_id=08a72e0520b944b98f375732e914c369&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:21.914542 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4ae88f-1367-4065-93c5-84f6a8bab2ac None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:22.016088 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4ae88f-1367-4065-93c5-84f6a8bab2ac None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:22.017561 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:22.051636 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d34ec-7209-47b2-9944-40e6b0c37ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:22.052295 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d34ec-7209-47b2-9944-40e6b0c37ea1 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:22.052575 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d34ec-7209-47b2-9944-40e6b0c37ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:22.052879 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d34ec-7209-47b2-9944-40e6b0c37ea1 None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:22.053556 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d34ec-7209-47b2-9944-40e6b0c37ea1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:22.054903 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d34ec-7209-47b2-9944-40e6b0c37ea1 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:22.062340 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 527/1045] 10.222.0.39 () {56 vars in 1087 bytes} [Mon Jun 20 05:59:21 2022] GET /identity/v3/services => generated 1957 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 05:59:22.420472 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e8f94-d0db-4891-bac7-da1ec113d313 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:22.420842 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e8f94-d0db-4891-bac7-da1ec113d313 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:22.421021 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e8f94-d0db-4891-bac7-da1ec113d313 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:22.422828 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 519/1046] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:59:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:22.429040 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fcac08-c750-4378-a99c-5abdeb888dfb None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:22.429596 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fcac08-c750-4378-a99c-5abdeb888dfb None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:22.429815 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fcac08-c750-4378-a99c-5abdeb888dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:22.452746 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-a8fcac08-c750-4378-a99c-5abdeb888dfb None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:22.454906 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-a8fcac08-c750-4378-a99c-5abdeb888dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:22.525298 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 528/1047] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:22 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:59:22.551194 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e8f94-d0db-4891-bac7-da1ec113d313 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:22.589119 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:22.658249 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e8f94-d0db-4891-bac7-da1ec113d313 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:22.692448 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f8194-988b-4b19-85f4-0c6568d9baf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:22.693188 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f8194-988b-4b19-85f4-0c6568d9baf1 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:22.693475 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f8194-988b-4b19-85f4-0c6568d9baf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:22.693753 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f8194-988b-4b19-85f4-0c6568d9baf1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:22.704983 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341f8194-988b-4b19-85f4-0c6568d9baf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:59:22.712574 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-341f8194-988b-4b19-85f4-0c6568d9baf1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:59:22.712574 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:22.712574 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:22.712574 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:22.712574 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:22.712574 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:22.712574 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:22.712574 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:22.712574 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:22.712574 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:22.712574 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:22.712574 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:22.712574 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:59:22.712574 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:59:22.712574 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:59:22.712574 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:59:22.713643 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:59:22.713643 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:59:22.713643 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:59:22.713643 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:59:22.713643 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:22.713643 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:22.713643 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:22.713643 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:22.713643 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:22.713643 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:22.713643 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:22.713643 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:22.713643 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:22.713643 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:22.713643 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:22.713643 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:22.714483 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:22.714483 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:22.714483 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:22.714483 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:22.714483 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:59:22.714483 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:59:22.714483 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:59:22.714483 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:59:22.714483 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:59:22.714483 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:59:22.714483 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:59:22.714483 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:59:22.714483 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 520/1048] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jun 20 05:59:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:22.720024 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fcac08-c750-4378-a99c-5abdeb888dfb None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:22.819731 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:22.827458 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fcac08-c750-4378-a99c-5abdeb888dfb None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:22.834731 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156c765-ebe0-4968-ba77-8acd7245fafa None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:22.835020 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156c765-ebe0-4968-ba77-8acd7245fafa None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:22.835308 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156c765-ebe0-4968-ba77-8acd7245fafa None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:22.836716 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 521/1049] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:59:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:22.841555 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95a10d-d66c-4ad6-baeb-1ae50221b921 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:22.841842 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95a10d-d66c-4ad6-baeb-1ae50221b921 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:22.842120 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95a10d-d66c-4ad6-baeb-1ae50221b921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:22.859986 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-be95a10d-d66c-4ad6-baeb-1ae50221b921 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:22.861236 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-be95a10d-d66c-4ad6-baeb-1ae50221b921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:22.863362 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd5150-7ff8-416c-aafb-932087c20c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:22.864033 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd5150-7ff8-416c-aafb-932087c20c64 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:22.864309 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd5150-7ff8-416c-aafb-932087c20c64 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:22.864577 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd5150-7ff8-416c-aafb-932087c20c64 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:22.865347 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd5150-7ff8-416c-aafb-932087c20c64 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:22.865651 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd5150-7ff8-416c-aafb-932087c20c64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:22.866998 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd5150-7ff8-416c-aafb-932087c20c64 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:22.880987 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 529/1050] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 05:59:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:22.882653 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd5150-7ff8-416c-aafb-932087c20c64 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:22.937656 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 522/1051] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:22 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 05:59:22.960780 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be95a10d-d66c-4ad6-baeb-1ae50221b921 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:22.988368 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:22.988620 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd5150-7ff8-416c-aafb-932087c20c64 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:23.023872 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab35ac25-c06c-4fec-89f5-4aa46bb4505f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:23.024764 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab35ac25-c06c-4fec-89f5-4aa46bb4505f None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:23.025046 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab35ac25-c06c-4fec-89f5-4aa46bb4505f None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:23.025317 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab35ac25-c06c-4fec-89f5-4aa46bb4505f None admin] PATH_INFO: `/v3/users/d5b7ee60aa194650a1e1d01d3706147a` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:23.040509 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab35ac25-c06c-4fec-89f5-4aa46bb4505f None admin] RBAC: Authorizing `identity:get_user(user_id=d5b7ee60aa194650a1e1d01d3706147a)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:23.041976 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab35ac25-c06c-4fec-89f5-4aa46bb4505f None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:23.043975 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 530/1052] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jun 20 05:59:22 2022] GET /identity/v3/users/d5b7ee60aa194650a1e1d01d3706147a => generated 285 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:23.049320 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab35ac25-c06c-4fec-89f5-4aa46bb4505f None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:23.067900 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:23.073429 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be95a10d-d66c-4ad6-baeb-1ae50221b921 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:23.112547 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99af8af-7022-4a4a-87a3-14aa8d80f6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:23.113408 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99af8af-7022-4a4a-87a3-14aa8d80f6c1 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:23.113693 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99af8af-7022-4a4a-87a3-14aa8d80f6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:23.113972 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99af8af-7022-4a4a-87a3-14aa8d80f6c1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:23.125582 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99af8af-7022-4a4a-87a3-14aa8d80f6c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:59:23.133853 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-e99af8af-7022-4a4a-87a3-14aa8d80f6c1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 05:59:23.133853 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:23.133853 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:23.133853 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:23.133853 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:23.133853 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:23.133853 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:23.133853 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:23.133853 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:23.133853 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:23.133853 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:23.133853 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:23.133853 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:59:23.133853 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:59:23.133853 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:59:23.133853 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:59:23.134813 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:59:23.134813 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:59:23.134813 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:59:23.134813 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:59:23.134813 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:23.134813 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:23.134813 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:23.134813 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:23.134813 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:23.134813 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:23.134813 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:23.134813 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:23.134813 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:23.134813 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:23.134813 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:23.134813 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:23.135672 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:23.135672 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:23.135672 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:23.135672 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:23.135672 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:59:23.135672 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:59:23.135672 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:59:23.135672 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:59:23.135672 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:59:23.135672 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:59:23.135672 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 05:59:23.135672 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:59:23.140791 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 523/1053] 10.222.0.39 () {56 vars in 1120 bytes} [Mon Jun 20 05:59:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:59:23.141706 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99af8af-7022-4a4a-87a3-14aa8d80f6c1 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:23.157868 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab35ac25-c06c-4fec-89f5-4aa46bb4505f None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:23.197472 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b8bfad-65ff-445c-866c-126605853cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:23.198845 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b8bfad-65ff-445c-866c-126605853cae None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:23.199414 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b8bfad-65ff-445c-866c-126605853cae None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:23.199956 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b8bfad-65ff-445c-866c-126605853cae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:23.234698 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:23.256992 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99af8af-7022-4a4a-87a3-14aa8d80f6c1 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:23.277088 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b8bfad-65ff-445c-866c-126605853cae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:23.279002 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b8bfad-65ff-445c-866c-126605853cae None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:23.291634 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea16ef78-15c7-4156-8ce9-eabea9ffb176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:23.292308 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16ef78-15c7-4156-8ce9-eabea9ffb176 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:23.292594 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16ef78-15c7-4156-8ce9-eabea9ffb176 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:23.292904 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16ef78-15c7-4156-8ce9-eabea9ffb176 None admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:23.293652 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea16ef78-15c7-4156-8ce9-eabea9ffb176 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:23.293964 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea16ef78-15c7-4156-8ce9-eabea9ffb176 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:23.295354 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea16ef78-15c7-4156-8ce9-eabea9ffb176 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:23.301976 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:23.304162 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 524/1054] 10.222.0.39 () {56 vars in 1115 bytes} [Mon Jun 20 05:59:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:23.311406 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea16ef78-15c7-4156-8ce9-eabea9ffb176 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:23.395303 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 531/1055] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 05:59:23 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 20 05:59:23.400584 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b8bfad-65ff-445c-866c-126605853cae None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:23.417642 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea16ef78-15c7-4156-8ce9-eabea9ffb176 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:23.460748 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd38e4d-b940-47dd-afa6-5d959f3abcf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:23.461550 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd38e4d-b940-47dd-afa6-5d959f3abcf8 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:23.461863 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd38e4d-b940-47dd-afa6-5d959f3abcf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:23.462108 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd38e4d-b940-47dd-afa6-5d959f3abcf8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:23.473737 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd38e4d-b940-47dd-afa6-5d959f3abcf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:23.475291 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd38e4d-b940-47dd-afa6-5d959f3abcf8 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:23.482810 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:23.495228 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-ebd38e4d-b940-47dd-afa6-5d959f3abcf8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:59:23.495228 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:23.495228 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:23.495228 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:23.495228 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:23.495228 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:23.495228 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:23.495228 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:23.495228 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:23.495228 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:23.495228 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:23.495228 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:23.495228 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:59:23.495228 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:59:23.495228 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:59:23.496118 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:59:23.496118 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:23.496118 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:23.496118 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:23.496118 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:23.496118 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:23.496118 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:23.496118 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:23.496118 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:23.496118 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:23.496118 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:23.496118 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:23.496118 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:23.496118 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:23.496118 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:23.496118 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:23.496118 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:23.497052 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:59:23.497052 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:59:23.497052 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:59:23.497052 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:59:23.497052 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 525/1056] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:59:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:59:23.502857 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd38e4d-b940-47dd-afa6-5d959f3abcf8 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:23.510991 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b8bfad-65ff-445c-866c-126605853cae None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:23.527758 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:23.547155 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7cbd2e-ac1a-4ab6-b2ed-ce212f31d749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:23.548577 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7cbd2e-ac1a-4ab6-b2ed-ce212f31d749 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:23.548990 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7cbd2e-ac1a-4ab6-b2ed-ce212f31d749 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:23.549367 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7cbd2e-ac1a-4ab6-b2ed-ce212f31d749 None admin] PATH_INFO: `/v3/projects/eda9e007cccf48fa93432b6b69e26adf` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:23.550678 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7cbd2e-ac1a-4ab6-b2ed-ce212f31d749 None admin] RBAC: Authorizing `identity:get_project(project_id=eda9e007cccf48fa93432b6b69e26adf)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:23.552202 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7cbd2e-ac1a-4ab6-b2ed-ce212f31d749 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:23.554062 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 532/1057] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jun 20 05:59:23 2022] GET /identity/v3/projects/eda9e007cccf48fa93432b6b69e26adf => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:23.560070 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7cbd2e-ac1a-4ab6-b2ed-ce212f31d749 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:23.609195 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd38e4d-b940-47dd-afa6-5d959f3abcf8 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:23.644171 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f77e3b-95fe-442f-b7a5-8741d1200b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:23.644964 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f77e3b-95fe-442f-b7a5-8741d1200b14 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:23.645246 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f77e3b-95fe-442f-b7a5-8741d1200b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:23.645519 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f77e3b-95fe-442f-b7a5-8741d1200b14 None admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:23.646246 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f77e3b-95fe-442f-b7a5-8741d1200b14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:23.646550 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f77e3b-95fe-442f-b7a5-8741d1200b14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:23.647922 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f77e3b-95fe-442f-b7a5-8741d1200b14 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:23.660384 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 526/1058] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:59:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:23.665880 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f77e3b-95fe-442f-b7a5-8741d1200b14 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:23.673483 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7cbd2e-ac1a-4ab6-b2ed-ce212f31d749 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:23.710825 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644187cb-1216-4a44-af91-f6f3a587ff71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:23.711490 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644187cb-1216-4a44-af91-f6f3a587ff71 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:23.711776 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644187cb-1216-4a44-af91-f6f3a587ff71 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:23.712178 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644187cb-1216-4a44-af91-f6f3a587ff71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:23.713164 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644187cb-1216-4a44-af91-f6f3a587ff71 None admin] RBAC: Adding query filter params (role.id=5a64bd8372704de98e75436ff69e46b3, scope.project.id=eda9e007cccf48fa93432b6b69e26adf, user.id=d5b7ee60aa194650a1e1d01d3706147a) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:23.713481 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644187cb-1216-4a44-af91-f6f3a587ff71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:23.714920 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644187cb-1216-4a44-af91-f6f3a587ff71 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:23.721239 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 533/1059] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jun 20 05:59:23 2022] GET /identity/v3/role_assignments?user.id=d5b7ee60aa194650a1e1d01d3706147a&scope.project.id=eda9e007cccf48fa93432b6b69e26adf&role.id=5a64bd8372704de98e75436ff69e46b3 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:23.725355 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:23.772880 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f77e3b-95fe-442f-b7a5-8741d1200b14 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:23.812209 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d561e-4581-446a-b3b8-35b8e5ab2a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:23.813045 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d561e-4581-446a-b3b8-35b8e5ab2a1e None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:23.813322 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d561e-4581-446a-b3b8-35b8e5ab2a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:23.813599 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d561e-4581-446a-b3b8-35b8e5ab2a1e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:23.821727 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68d561e-4581-446a-b3b8-35b8e5ab2a1e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:23.823446 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68d561e-4581-446a-b3b8-35b8e5ab2a1e None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:23.839360 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-f68d561e-4581-446a-b3b8-35b8e5ab2a1e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 05:59:23.839360 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:23.839360 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:23.839360 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:23.839360 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:23.839360 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:23.839360 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:23.839360 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:23.839360 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:23.839360 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:23.839360 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:23.839360 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:23.839360 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:59:23.839360 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:59:23.839360 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:59:23.839360 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:59:23.840421 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:23.840421 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:23.840421 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:59:23.840421 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:59:23.840421 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:59:23.840421 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:59:23.840421 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:23.840421 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:23.840421 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:23.840421 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:23.840421 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:23.840421 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:23.840421 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:23.840421 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:23.840421 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:23.840421 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:23.840421 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:23.840421 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:23.842059 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:23.842059 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:23.842059 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:59:23.842059 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:59:23.842059 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:59:23.842059 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:59:23.842059 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:59:23.842059 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:59:23.842059 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 05:59:23.842059 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:59:23.842059 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 527/1060] 10.222.0.39 () {56 vars in 1093 bytes} [Mon Jun 20 05:59:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:59:23.848838 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644187cb-1216-4a44-af91-f6f3a587ff71 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:23.902840 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:23.956027 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644187cb-1216-4a44-af91-f6f3a587ff71 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:23.989735 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0163eee8-f694-4fa0-a083-6dc426ae0c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:23.990413 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163eee8-f694-4fa0-a083-6dc426ae0c5f None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:23.990699 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163eee8-f694-4fa0-a083-6dc426ae0c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:23.990975 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163eee8-f694-4fa0-a083-6dc426ae0c5f None admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:23.991811 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0163eee8-f694-4fa0-a083-6dc426ae0c5f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:23.992120 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0163eee8-f694-4fa0-a083-6dc426ae0c5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:23.993571 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0163eee8-f694-4fa0-a083-6dc426ae0c5f None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:24.016447 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 534/1061] 10.222.0.39 () {56 vars in 1133 bytes} [Mon Jun 20 05:59:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:24.018077 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d561e-4581-446a-b3b8-35b8e5ab2a1e None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:24.109018 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f3e21-b911-4c09-8915-a6356a538ce8 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:24.109211 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f3e21-b911-4c09-8915-a6356a538ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:24.109474 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f3e21-b911-4c09-8915-a6356a538ce8 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:24.110834 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 535/1062] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:59:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:59:24.115727 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e1c1a-a058-477d-9236-cd8468f15b55 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:24.116012 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e1c1a-a058-477d-9236-cd8468f15b55 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:24.116285 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e1c1a-a058-477d-9236-cd8468f15b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:24.123924 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d561e-4581-446a-b3b8-35b8e5ab2a1e None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:24.133370 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-cb7e1c1a-a058-477d-9236-cd8468f15b55 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:24.134552 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-cb7e1c1a-a058-477d-9236-cd8468f15b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:24.143606 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:24.162274 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428cbaf1-4456-4bc2-a9f2-48663f5c3c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:24.163064 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cbaf1-4456-4bc2-a9f2-48663f5c3c2f None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:24.163346 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cbaf1-4456-4bc2-a9f2-48663f5c3c2f None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:24.163627 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cbaf1-4456-4bc2-a9f2-48663f5c3c2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:24.175451 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428cbaf1-4456-4bc2-a9f2-48663f5c3c2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:24.177144 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428cbaf1-4456-4bc2-a9f2-48663f5c3c2f None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:24.197864 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-428cbaf1-4456-4bc2-a9f2-48663f5c3c2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:59:24.197864 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:24.197864 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:24.197864 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:24.197864 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:24.197864 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:24.197864 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:24.197864 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:24.197864 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:24.197864 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:24.197864 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:24.197864 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:24.197864 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:59:24.197864 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:59:24.197864 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:59:24.199279 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:59:24.199279 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:24.199279 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:24.199279 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:24.199279 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:24.199279 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:24.199279 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:24.199279 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:24.199279 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:24.199279 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:24.199279 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:24.199279 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:24.199279 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:24.199279 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:24.199279 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:24.199279 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:24.199279 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:24.200257 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:59:24.200257 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:59:24.200257 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:59:24.200257 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:59:24.200257 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 528/1063] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:59:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:24.206302 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428cbaf1-4456-4bc2-a9f2-48663f5c3c2f None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:24.216390 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 536/1064] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:24 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 05:59:24.239954 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e1c1a-a058-477d-9236-cd8468f15b55 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:24.276241 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:24.310966 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428cbaf1-4456-4bc2-a9f2-48663f5c3c2f None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:24.347661 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76c3cc-498d-457e-a04c-abb7dedc9066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:24.348329 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76c3cc-498d-457e-a04c-abb7dedc9066 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:24.348612 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76c3cc-498d-457e-a04c-abb7dedc9066 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:24.348934 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76c3cc-498d-457e-a04c-abb7dedc9066 None admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:24.349664 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b76c3cc-498d-457e-a04c-abb7dedc9066 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:24.349978 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b76c3cc-498d-457e-a04c-abb7dedc9066 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:24.351007 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e1c1a-a058-477d-9236-cd8468f15b55 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:24.351351 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b76c3cc-498d-457e-a04c-abb7dedc9066 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:24.367757 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 529/1065] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:59:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:24.368771 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76c3cc-498d-457e-a04c-abb7dedc9066 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:24.391020 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d4d53-876a-4516-b01d-d0c463b3c827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:24.391816 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d4d53-876a-4516-b01d-d0c463b3c827 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:24.392102 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d4d53-876a-4516-b01d-d0c463b3c827 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:24.392381 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d4d53-876a-4516-b01d-d0c463b3c827 None admin] PATH_INFO: `/v3/services/image` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:24.393066 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27d4d53-876a-4516-b01d-d0c463b3c827 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:24.394438 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27d4d53-876a-4516-b01d-d0c463b3c827 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:24.402439 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:24.407094 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-f27d4d53-876a-4516-b01d-d0c463b3c827 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 05:59:24.407094 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:24.407094 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:59:24.407094 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:59:24.407094 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:59:24.407094 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:59:24.407094 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:59:24.407094 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:59:24.407094 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 05:59:24.407094 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:24.407094 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:59:24.407094 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:24.407094 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:24.407094 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:24.407094 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:24.407094 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:24.407094 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:24.408331 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:24.408331 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:24.408331 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:24.408331 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:24.408331 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:24.408331 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:24.408331 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:59:24.408331 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:59:24.408331 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:59:24.408331 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:59:24.408331 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:24.408331 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:24.408331 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:24.408331 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:24.408331 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:24.408331 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:24.409237 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:24.409237 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:24.409237 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:24.409237 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:24.409237 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:24.409237 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:24.409237 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:24.409237 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:24.409237 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:24.409237 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:24.409237 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:59:24.409237 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:59:24.409237 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 05:59:24.409237 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:24.409237 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 537/1066] 10.222.0.39 () {56 vars in 1105 bytes} [Mon Jun 20 05:59:24 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:59:24.417802 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d4d53-876a-4516-b01d-d0c463b3c827 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:24.486820 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76c3cc-498d-457e-a04c-abb7dedc9066 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:24.522079 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d50e7-6ed2-476b-9ee6-628a4d50f099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:24.522864 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d50e7-6ed2-476b-9ee6-628a4d50f099 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:24.523144 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d50e7-6ed2-476b-9ee6-628a4d50f099 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:24.523413 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d50e7-6ed2-476b-9ee6-628a4d50f099 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:24.528808 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:24.530644 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09d50e7-6ed2-476b-9ee6-628a4d50f099 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:24.532136 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09d50e7-6ed2-476b-9ee6-628a4d50f099 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:24.532744 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d4d53-876a-4516-b01d-d0c463b3c827 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:24.547906 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-c09d50e7-6ed2-476b-9ee6-628a4d50f099 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:59:24.547906 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:24.547906 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:24.547906 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:24.547906 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:24.547906 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:24.547906 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:24.547906 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:24.547906 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:24.547906 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:24.547906 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:24.547906 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:24.547906 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:59:24.547906 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:59:24.547906 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:59:24.549105 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:59:24.549105 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:24.549105 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:24.549105 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:24.549105 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:24.549105 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:24.549105 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:24.549105 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:24.549105 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:24.549105 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:24.549105 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:24.549105 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:24.549105 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:24.549105 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:24.549105 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:24.549105 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:24.549105 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:24.550124 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:59:24.550124 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:59:24.550124 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:59:24.550124 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:59:24.550124 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:59:24.550124 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:59:24.550124 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:59:24.550124 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:59:24.550124 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 530/1067] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jun 20 05:59:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:24.558253 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d50e7-6ed2-476b-9ee6-628a4d50f099 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:24.575608 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4f5fb6-1238-438d-b155-6d54d576d5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:24.577395 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f5fb6-1238-438d-b155-6d54d576d5b7 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:24.577683 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f5fb6-1238-438d-b155-6d54d576d5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:24.577954 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f5fb6-1238-438d-b155-6d54d576d5b7 None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:24.578723 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4f5fb6-1238-438d-b155-6d54d576d5b7 None admin] RBAC: Adding query filter params (name=image) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:24.579121 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4f5fb6-1238-438d-b155-6d54d576d5b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:24.580441 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4f5fb6-1238-438d-b155-6d54d576d5b7 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:24.585497 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 538/1068] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:59:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:24.590961 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4f5fb6-1238-438d-b155-6d54d576d5b7 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:24.664920 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:24.676604 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d50e7-6ed2-476b-9ee6-628a4d50f099 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:24.707422 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4f5fb6-1238-438d-b155-6d54d576d5b7 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:24.715209 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30abac78-b600-4ae5-80ea-e71555329679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:24.715950 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abac78-b600-4ae5-80ea-e71555329679 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:24.716267 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abac78-b600-4ae5-80ea-e71555329679 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:24.716539 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abac78-b600-4ae5-80ea-e71555329679 None admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:24.717512 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30abac78-b600-4ae5-80ea-e71555329679 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:24.717829 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30abac78-b600-4ae5-80ea-e71555329679 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:24.719263 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30abac78-b600-4ae5-80ea-e71555329679 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:24.736169 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 531/1069] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jun 20 05:59:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:24.738219 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30abac78-b600-4ae5-80ea-e71555329679 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:24.743093 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203eb1b5-4288-4a90-a2b2-c7472b9b28a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:24.743759 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203eb1b5-4288-4a90-a2b2-c7472b9b28a8 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:24.744039 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203eb1b5-4288-4a90-a2b2-c7472b9b28a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:24.744311 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203eb1b5-4288-4a90-a2b2-c7472b9b28a8 None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:24.745046 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203eb1b5-4288-4a90-a2b2-c7472b9b28a8 None admin] RBAC: Adding query filter params (type=image) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:24.745351 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203eb1b5-4288-4a90-a2b2-c7472b9b28a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:24.746705 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203eb1b5-4288-4a90-a2b2-c7472b9b28a8 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:24.752559 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 539/1070] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:59:24 2022] GET /identity/v3/services?type=image => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:24.757656 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203eb1b5-4288-4a90-a2b2-c7472b9b28a8 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:24.787345 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:24.852499 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30abac78-b600-4ae5-80ea-e71555329679 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:24.865374 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203eb1b5-4288-4a90-a2b2-c7472b9b28a8 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:24.892438 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff3881-68c9-45a7-b8cf-29eaa53524d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:24.894821 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff3881-68c9-45a7-b8cf-29eaa53524d3 None admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:24.895118 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff3881-68c9-45a7-b8cf-29eaa53524d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:24.895374 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff3881-68c9-45a7-b8cf-29eaa53524d3 None admin] PATH_INFO: `/v3/projects/b349043204b34d1794818184ffe6505c/users/3cee106502e54829ad802ee41c9165fa/roles/b20a688ed203460d9430dd8aa432756b` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:24.898064 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff3881-68c9-45a7-b8cf-29eaa53524d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=b349043204b34d1794818184ffe6505c, user_id=3cee106502e54829ad802ee41c9165fa, role_id=b20a688ed203460d9430dd8aa432756b)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:24.899504 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff3881-68c9-45a7-b8cf-29eaa53524d3 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:24.902640 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee3a40-a8af-46f1-aecd-0306f1050b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:24.903306 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee3a40-a8af-46f1-aecd-0306f1050b90 None admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:24.903583 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee3a40-a8af-46f1-aecd-0306f1050b90 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:24.903922 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee3a40-a8af-46f1-aecd-0306f1050b90 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:24.904793 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ee3a40-a8af-46f1-aecd-0306f1050b90 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:24.907717 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ee3a40-a8af-46f1-aecd-0306f1050b90 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:24.915135 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 532/1071] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jun 20 05:59:24 2022] PUT /identity/v3/projects/b349043204b34d1794818184ffe6505c/users/3cee106502e54829ad802ee41c9165fa/roles/b20a688ed203460d9430dd8aa432756b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 05:59:24.926813 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 540/1072] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Jun 20 05:59:24 2022] POST /identity/v3/endpoints => generated 327 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 05:59:25.771090 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54daab-3d88-4a7e-837a-ce22b3014b9a None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:25.771588 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54daab-3d88-4a7e-837a-ce22b3014b9a None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:25.771588 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54daab-3d88-4a7e-837a-ce22b3014b9a None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:25.773143 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 533/1073] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:59:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:25.778117 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ee3f1-1b46-4bca-84f9-8c5e59ab0515 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:25.778504 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ee3f1-1b46-4bca-84f9-8c5e59ab0515 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:25.779347 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ee3f1-1b46-4bca-84f9-8c5e59ab0515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:25.795925 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-397ee3f1-1b46-4bca-84f9-8c5e59ab0515 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:25.797132 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-397ee3f1-1b46-4bca-84f9-8c5e59ab0515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:25.876620 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 541/1074] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:59:25.899436 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54daab-3d88-4a7e-837a-ce22b3014b9a None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:25.913204 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:26.003684 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54daab-3d88-4a7e-837a-ce22b3014b9a None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:26.038663 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ce52c-6047-4e8f-b409-945802d1a177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:26.039370 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ce52c-6047-4e8f-b409-945802d1a177 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:26.039652 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ce52c-6047-4e8f-b409-945802d1a177 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:26.039927 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ce52c-6047-4e8f-b409-945802d1a177 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:26.051590 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ce52c-6047-4e8f-b409-945802d1a177 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:59:26.059304 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-066ce52c-6047-4e8f-b409-945802d1a177 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:59:26.059304 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:26.059304 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:26.059304 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:26.059304 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:26.059304 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:26.059304 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:26.059304 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:26.059304 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:26.059304 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:26.059304 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:26.059304 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:26.059304 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:59:26.059304 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:59:26.059304 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:59:26.059304 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:59:26.060624 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:59:26.060624 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:59:26.060624 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:59:26.060624 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:59:26.060624 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:26.060624 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:26.060624 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:26.060624 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:26.060624 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:26.060624 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:26.060624 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:26.060624 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:26.060624 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:26.060624 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:26.060624 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:26.060624 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:26.061678 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:26.061678 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:26.061678 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:26.061678 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:26.061678 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:59:26.061678 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:59:26.061678 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:59:26.061678 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:59:26.061678 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:59:26.061678 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:59:26.061678 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:59:26.061678 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:59:26.064783 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 534/1075] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jun 20 05:59:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:26.067023 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ee3f1-1b46-4bca-84f9-8c5e59ab0515 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:26.080314 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:26.175436 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ee3f1-1b46-4bca-84f9-8c5e59ab0515 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:26.212184 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f750a18-e76d-4406-a486-5935abeb09d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:26.212886 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f750a18-e76d-4406-a486-5935abeb09d0 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:26.213171 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f750a18-e76d-4406-a486-5935abeb09d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:26.213439 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f750a18-e76d-4406-a486-5935abeb09d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:26.214176 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f750a18-e76d-4406-a486-5935abeb09d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:26.214479 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f750a18-e76d-4406-a486-5935abeb09d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:26.215832 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f750a18-e76d-4406-a486-5935abeb09d0 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:26.224058 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 542/1076] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 05:59:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:26.229569 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ce52c-6047-4e8f-b409-945802d1a177 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:26.300347 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:26.333252 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ce52c-6047-4e8f-b409-945802d1a177 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:26.366217 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd435b-67fe-489e-8ba8-1f18369a0ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:26.367074 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd435b-67fe-489e-8ba8-1f18369a0ced None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:26.367352 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd435b-67fe-489e-8ba8-1f18369a0ced None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:26.367623 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd435b-67fe-489e-8ba8-1f18369a0ced None admin] PATH_INFO: `/v3/users/d5b7ee60aa194650a1e1d01d3706147a` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:26.368817 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfd435b-67fe-489e-8ba8-1f18369a0ced None admin] RBAC: Authorizing `identity:get_user(user_id=d5b7ee60aa194650a1e1d01d3706147a)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:26.370235 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfd435b-67fe-489e-8ba8-1f18369a0ced None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:26.371992 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 535/1077] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jun 20 05:59:26 2022] GET /identity/v3/users/d5b7ee60aa194650a1e1d01d3706147a => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:26.378226 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f750a18-e76d-4406-a486-5935abeb09d0 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:26.455759 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:26.488559 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f750a18-e76d-4406-a486-5935abeb09d0 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:26.523370 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ca563-cfc6-4c03-8bcc-5cafd7d652fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:26.524226 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ca563-cfc6-4c03-8bcc-5cafd7d652fc None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:26.524503 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ca563-cfc6-4c03-8bcc-5cafd7d652fc None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:26.524799 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ca563-cfc6-4c03-8bcc-5cafd7d652fc None admin] PATH_INFO: `/v3/projects/eda9e007cccf48fa93432b6b69e26adf` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:26.525966 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907ca563-cfc6-4c03-8bcc-5cafd7d652fc None admin] RBAC: Authorizing `identity:get_project(project_id=eda9e007cccf48fa93432b6b69e26adf)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:26.527398 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907ca563-cfc6-4c03-8bcc-5cafd7d652fc None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:26.533941 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 543/1078] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jun 20 05:59:26 2022] GET /identity/v3/projects/eda9e007cccf48fa93432b6b69e26adf => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:26.535031 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd435b-67fe-489e-8ba8-1f18369a0ced None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:26.640676 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd435b-67fe-489e-8ba8-1f18369a0ced None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:26.673930 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac8055a-91d7-431d-b5e6-d4c622a51893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:26.674908 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8055a-91d7-431d-b5e6-d4c622a51893 None admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:26.675189 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8055a-91d7-431d-b5e6-d4c622a51893 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:26.675463 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8055a-91d7-431d-b5e6-d4c622a51893 None admin] PATH_INFO: `/v3/projects/eda9e007cccf48fa93432b6b69e26adf/users/d5b7ee60aa194650a1e1d01d3706147a/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:26.677401 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac8055a-91d7-431d-b5e6-d4c622a51893 None admin] RBAC: Authorizing `identity:create_grant(project_id=eda9e007cccf48fa93432b6b69e26adf, user_id=d5b7ee60aa194650a1e1d01d3706147a, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:26.678821 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac8055a-91d7-431d-b5e6-d4c622a51893 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:26.687812 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:26.694702 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 536/1079] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jun 20 05:59:26 2022] PUT /identity/v3/projects/eda9e007cccf48fa93432b6b69e26adf/users/d5b7ee60aa194650a1e1d01d3706147a/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 05:59:27.019012 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95de5b-c690-4dba-8be6-87f662e4d4f1 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:27.019536 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95de5b-c690-4dba-8be6-87f662e4d4f1 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:27.019536 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95de5b-c690-4dba-8be6-87f662e4d4f1 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:27.020991 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 544/1080] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:59:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:27.026093 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b86d73-cc70-4543-841b-bf245af083d8 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:27.026511 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b86d73-cc70-4543-841b-bf245af083d8 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:27.026674 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b86d73-cc70-4543-841b-bf245af083d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:27.043379 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-61b86d73-cc70-4543-841b-bf245af083d8 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:27.044718 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-61b86d73-cc70-4543-841b-bf245af083d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:27.062417 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13895f6-50fc-4fdf-9a76-2fd8d57696c9 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:27.062733 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13895f6-50fc-4fdf-9a76-2fd8d57696c9 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:27.062969 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13895f6-50fc-4fdf-9a76-2fd8d57696c9 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:27.064465 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 545/1081] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:59:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:59:27.069096 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f738258-b7fd-4f90-9e6e-7a690add9b75 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:27.069399 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f738258-b7fd-4f90-9e6e-7a690add9b75 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:27.069655 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f738258-b7fd-4f90-9e6e-7a690add9b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:27.087399 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-6f738258-b7fd-4f90-9e6e-7a690add9b75 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:27.088591 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-6f738258-b7fd-4f90-9e6e-7a690add9b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:27.124743 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 537/1082] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:59:27.153877 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b86d73-cc70-4543-841b-bf245af083d8 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:27.163421 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 546/1083] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:59:27.185982 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f738258-b7fd-4f90-9e6e-7a690add9b75 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:27.259355 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:27.262446 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b86d73-cc70-4543-841b-bf245af083d8 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:27.290116 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:27.293546 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f738258-b7fd-4f90-9e6e-7a690add9b75 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:27.300347 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6679559a-5b8e-4ea7-8b6e-1ba90f43a783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:27.301199 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679559a-5b8e-4ea7-8b6e-1ba90f43a783 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:27.301486 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679559a-5b8e-4ea7-8b6e-1ba90f43a783 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:27.301764 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679559a-5b8e-4ea7-8b6e-1ba90f43a783 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:27.313607 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6679559a-5b8e-4ea7-8b6e-1ba90f43a783 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:59:27.321749 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-6679559a-5b8e-4ea7-8b6e-1ba90f43a783 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 05:59:27.321749 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:27.321749 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:27.321749 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:27.321749 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:27.321749 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:27.321749 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:27.321749 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:27.321749 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:27.321749 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:27.321749 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:27.321749 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:27.321749 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:59:27.321749 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:59:27.321749 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:59:27.321749 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:59:27.322657 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:59:27.322657 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:59:27.322657 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:59:27.322657 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:59:27.322657 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:27.322657 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:27.322657 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:27.322657 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:27.322657 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:27.322657 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:27.322657 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:27.322657 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:27.322657 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:27.322657 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:27.322657 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:27.322657 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:27.323759 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:27.323759 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:27.323759 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:27.323759 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:27.323759 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:59:27.323759 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:59:27.323759 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:59:27.323759 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:59:27.323759 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:59:27.323759 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:59:27.323759 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 05:59:27.323759 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:59:27.328494 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 538/1084] 10.222.0.39 () {56 vars in 1120 bytes} [Mon Jun 20 05:59:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:27.329333 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6679559a-5b8e-4ea7-8b6e-1ba90f43a783 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:27.336270 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd833c9-6048-49ad-826e-670b05421083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:27.336956 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd833c9-6048-49ad-826e-670b05421083 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:27.337303 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd833c9-6048-49ad-826e-670b05421083 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:27.337587 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd833c9-6048-49ad-826e-670b05421083 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:27.412095 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd833c9-6048-49ad-826e-670b05421083 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:27.413572 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd833c9-6048-49ad-826e-670b05421083 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:27.433821 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6679559a-5b8e-4ea7-8b6e-1ba90f43a783 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:27.475319 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66ce18-8746-431d-aa6b-43a5d4caff48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:27.475992 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66ce18-8746-431d-aa6b-43a5d4caff48 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:27.476277 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66ce18-8746-431d-aa6b-43a5d4caff48 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:27.476553 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66ce18-8746-431d-aa6b-43a5d4caff48 None admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:27.477336 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d66ce18-8746-431d-aa6b-43a5d4caff48 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:27.477644 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d66ce18-8746-431d-aa6b-43a5d4caff48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:27.479014 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d66ce18-8746-431d-aa6b-43a5d4caff48 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:27.493100 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 539/1085] 10.222.0.39 () {56 vars in 1115 bytes} [Mon Jun 20 05:59:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:27.494297 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66ce18-8746-431d-aa6b-43a5d4caff48 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:27.498581 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:27.537844 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 547/1086] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 05:59:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 20 05:59:27.543708 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd833c9-6048-49ad-826e-670b05421083 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:27.554687 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:27.611583 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66ce18-8746-431d-aa6b-43a5d4caff48 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:27.648437 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd833c9-6048-49ad-826e-670b05421083 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:27.651599 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc993caf-fb7d-400d-b9d3-fa41fb95cb99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:27.652401 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc993caf-fb7d-400d-b9d3-fa41fb95cb99 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:27.652685 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc993caf-fb7d-400d-b9d3-fa41fb95cb99 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:27.652998 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc993caf-fb7d-400d-b9d3-fa41fb95cb99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:27.665808 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc993caf-fb7d-400d-b9d3-fa41fb95cb99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:27.667737 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc993caf-fb7d-400d-b9d3-fa41fb95cb99 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:27.684204 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276ac950-0808-4c33-b049-11cc904423a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:27.685206 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ac950-0808-4c33-b049-11cc904423a7 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:27.685490 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ac950-0808-4c33-b049-11cc904423a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:27.685750 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ac950-0808-4c33-b049-11cc904423a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:27.686297 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-bc993caf-fb7d-400d-b9d3-fa41fb95cb99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:59:27.686297 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:27.686297 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:27.686297 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:27.686297 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:27.686297 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:27.686297 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:27.686297 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:27.686297 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:27.686297 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:27.686297 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:27.686297 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:27.686297 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:59:27.686297 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:59:27.686297 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:59:27.687159 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:59:27.687159 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:27.687159 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:27.687159 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:27.687159 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:27.687159 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:27.687159 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:27.687159 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:27.687159 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:27.687159 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:27.687159 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:27.687159 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:27.687159 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:27.687159 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:27.687159 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:27.687159 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:27.687159 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:27.688067 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:59:27.688067 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:59:27.688067 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:59:27.688067 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:59:27.688067 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 540/1087] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:59:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:59:27.692998 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc993caf-fb7d-400d-b9d3-fa41fb95cb99 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:27.699627 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276ac950-0808-4c33-b049-11cc904423a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:27.701109 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276ac950-0808-4c33-b049-11cc904423a7 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:27.718988 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-276ac950-0808-4c33-b049-11cc904423a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:59:27.718988 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:27.718988 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:27.718988 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:27.718988 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:27.718988 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:27.718988 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:27.718988 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:27.718988 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:27.718988 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:27.718988 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:27.718988 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:27.718988 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:59:27.718988 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:59:27.718988 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:59:27.720122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:59:27.720122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:27.720122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:27.720122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:27.720122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:27.720122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:27.720122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:27.720122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:27.720122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:27.720122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:27.720122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:27.720122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:27.720122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:27.720122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:27.720122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:27.720122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:27.720122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:27.721104 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:59:27.721104 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:59:27.721104 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:59:27.721104 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:27.721104 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 548/1088] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:59:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:27.726303 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276ac950-0808-4c33-b049-11cc904423a7 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:27.752416 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:27.813353 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc993caf-fb7d-400d-b9d3-fa41fb95cb99 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:27.814866 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:27.835535 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276ac950-0808-4c33-b049-11cc904423a7 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:27.850779 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1efba-8258-4709-a219-60e62c9af246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:27.851453 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1efba-8258-4709-a219-60e62c9af246 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:27.851736 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1efba-8258-4709-a219-60e62c9af246 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:27.852032 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1efba-8258-4709-a219-60e62c9af246 None admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:27.852761 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e1efba-8258-4709-a219-60e62c9af246 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:27.853076 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e1efba-8258-4709-a219-60e62c9af246 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:27.854448 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e1efba-8258-4709-a219-60e62c9af246 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:27.871947 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f3552-1943-48b2-957b-a74c393d18d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:27.872833 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 541/1089] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:59:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:27.873492 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f3552-1943-48b2-957b-a74c393d18d1 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:27.873751 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1efba-8258-4709-a219-60e62c9af246 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:27.874080 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f3552-1943-48b2-957b-a74c393d18d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:27.874503 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f3552-1943-48b2-957b-a74c393d18d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:27.875407 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05f3552-1943-48b2-957b-a74c393d18d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:27.875861 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05f3552-1943-48b2-957b-a74c393d18d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:27.877404 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05f3552-1943-48b2-957b-a74c393d18d1 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:27.897224 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 549/1090] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:59:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:27.988174 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1efba-8258-4709-a219-60e62c9af246 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:28.025131 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c6cf80-d45d-4da9-bc76-ef7f0749955a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:28.025939 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6cf80-d45d-4da9-bc76-ef7f0749955a None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:28.026226 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6cf80-d45d-4da9-bc76-ef7f0749955a None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:28.026780 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6cf80-d45d-4da9-bc76-ef7f0749955a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:28.035211 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c6cf80-d45d-4da9-bc76-ef7f0749955a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:28.036733 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c6cf80-d45d-4da9-bc76-ef7f0749955a None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:28.051269 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-25c6cf80-d45d-4da9-bc76-ef7f0749955a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 05:59:28.051269 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:28.051269 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:28.051269 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:28.051269 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:28.051269 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:28.051269 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:28.051269 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:28.051269 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:28.051269 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:28.051269 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:28.051269 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:28.051269 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:59:28.051269 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:59:28.051269 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:59:28.051269 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:59:28.052215 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:28.052215 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:28.052215 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:59:28.052215 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:59:28.052215 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:59:28.052215 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:59:28.052215 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:28.052215 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:28.052215 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:28.052215 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:28.052215 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:28.052215 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:28.052215 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:28.052215 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:28.052215 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:28.052215 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:28.052215 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:28.052215 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:28.053211 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:28.053211 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:28.053211 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:59:28.053211 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:59:28.053211 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:59:28.053211 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:59:28.053211 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:59:28.053211 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:59:28.053211 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 05:59:28.053211 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:59:28.053211 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 542/1091] 10.222.0.39 () {56 vars in 1093 bytes} [Mon Jun 20 05:59:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:28.058208 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f3552-1943-48b2-957b-a74c393d18d1 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:28.144372 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:28.164062 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f3552-1943-48b2-957b-a74c393d18d1 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:28.200560 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8f304-2526-43f4-a35d-8c4ce56bb161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:28.201268 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8f304-2526-43f4-a35d-8c4ce56bb161 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:28.201551 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8f304-2526-43f4-a35d-8c4ce56bb161 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:28.201829 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8f304-2526-43f4-a35d-8c4ce56bb161 None admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:28.202696 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa8f304-2526-43f4-a35d-8c4ce56bb161 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:28.203010 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa8f304-2526-43f4-a35d-8c4ce56bb161 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:28.204460 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa8f304-2526-43f4-a35d-8c4ce56bb161 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:28.221517 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 550/1092] 10.222.0.39 () {56 vars in 1133 bytes} [Mon Jun 20 05:59:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:28.227358 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c6cf80-d45d-4da9-bc76-ef7f0749955a None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:28.252615 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:28.328776 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c6cf80-d45d-4da9-bc76-ef7f0749955a None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:28.363096 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d15c68-c1c1-4944-9441-7baf99dd870a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:28.363748 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d15c68-c1c1-4944-9441-7baf99dd870a None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:28.364035 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d15c68-c1c1-4944-9441-7baf99dd870a None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:28.364315 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d15c68-c1c1-4944-9441-7baf99dd870a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:28.430962 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d15c68-c1c1-4944-9441-7baf99dd870a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:28.432327 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d15c68-c1c1-4944-9441-7baf99dd870a None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:28.459250 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:28.534341 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 543/1093] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 05:59:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 05:59:28.539933 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8f304-2526-43f4-a35d-8c4ce56bb161 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:28.645077 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8f304-2526-43f4-a35d-8c4ce56bb161 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:28.677394 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e3941d-0a46-4ada-bcff-618b685b8d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:28.678177 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3941d-0a46-4ada-bcff-618b685b8d7b None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:28.678456 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3941d-0a46-4ada-bcff-618b685b8d7b None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:28.678728 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3941d-0a46-4ada-bcff-618b685b8d7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:28.687755 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:28.689616 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e3941d-0a46-4ada-bcff-618b685b8d7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:28.691410 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e3941d-0a46-4ada-bcff-618b685b8d7b None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:28.711369 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-16e3941d-0a46-4ada-bcff-618b685b8d7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:59:28.711369 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:28.711369 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:28.711369 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:28.711369 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:28.711369 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:28.711369 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:28.711369 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:28.711369 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:28.711369 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:28.711369 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:28.711369 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:28.711369 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:59:28.711369 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:59:28.711369 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:59:28.712391 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:59:28.712391 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:28.712391 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:28.712391 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:28.712391 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:28.712391 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:28.712391 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:28.712391 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:28.712391 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:28.712391 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:28.712391 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:28.712391 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:28.712391 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:28.712391 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:28.712391 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:28.712391 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:28.712391 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:28.713502 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:59:28.713502 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:59:28.713502 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:59:28.713502 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:28.713502 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 551/1094] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:59:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:59:28.718240 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d15c68-c1c1-4944-9441-7baf99dd870a None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:28.758702 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91eb73-cca1-4d15-a513-2c8e393b5c52 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:28.758980 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91eb73-cca1-4d15-a513-2c8e393b5c52 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:28.759263 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91eb73-cca1-4d15-a513-2c8e393b5c52 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:28.760623 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 552/1095] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:59:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:59:28.765621 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78078b4e-6d8c-4b2b-9ae6-2db6218be912 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:28.765905 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78078b4e-6d8c-4b2b-9ae6-2db6218be912 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:28.766175 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78078b4e-6d8c-4b2b-9ae6-2db6218be912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:28.782475 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-78078b4e-6d8c-4b2b-9ae6-2db6218be912 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:28.783772 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-78078b4e-6d8c-4b2b-9ae6-2db6218be912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:28.818228 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d15c68-c1c1-4944-9441-7baf99dd870a None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:28.842106 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:28.851198 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 553/1096] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 05:59:28.854060 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3589a84b-d5b8-4804-9810-97431011e471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:28.854726 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589a84b-d5b8-4804-9810-97431011e471 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:28.855009 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589a84b-d5b8-4804-9810-97431011e471 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:28.855287 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589a84b-d5b8-4804-9810-97431011e471 None admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:28.856017 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3589a84b-d5b8-4804-9810-97431011e471 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:28.856326 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3589a84b-d5b8-4804-9810-97431011e471 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:28.858564 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3589a84b-d5b8-4804-9810-97431011e471 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:28.875183 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 544/1097] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 05:59:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:28.876171 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3589a84b-d5b8-4804-9810-97431011e471 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:28.876280 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78078b4e-6d8c-4b2b-9ae6-2db6218be912 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:28.974870 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78078b4e-6d8c-4b2b-9ae6-2db6218be912 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:28.983199 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3589a84b-d5b8-4804-9810-97431011e471 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:28.998324 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:29.012515 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a42d8cb-a713-422c-a5cf-058e4de2450a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:29.013553 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42d8cb-a713-422c-a5cf-058e4de2450a None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:29.013837 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42d8cb-a713-422c-a5cf-058e4de2450a None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:29.014113 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42d8cb-a713-422c-a5cf-058e4de2450a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:29.016141 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b11a4-eb94-4741-9a8a-d2f7cfec7a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:29.016951 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b11a4-eb94-4741-9a8a-d2f7cfec7a9f None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:29.017230 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b11a4-eb94-4741-9a8a-d2f7cfec7a9f None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:29.017500 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b11a4-eb94-4741-9a8a-d2f7cfec7a9f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:29.024082 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b11a4-eb94-4741-9a8a-d2f7cfec7a9f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:29.024194 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a42d8cb-a713-422c-a5cf-058e4de2450a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:59:29.025542 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b11a4-eb94-4741-9a8a-d2f7cfec7a9f None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:29.031869 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-0a42d8cb-a713-422c-a5cf-058e4de2450a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:59:29.031869 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:29.031869 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:29.031869 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:29.031869 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:29.031869 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:29.031869 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:29.031869 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:29.031869 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:29.031869 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:29.031869 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:29.031869 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:29.031869 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:59:29.031869 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:59:29.031869 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:59:29.031869 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:59:29.032817 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:59:29.032817 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:59:29.032817 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:59:29.032817 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:59:29.032817 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:29.032817 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:29.032817 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:29.032817 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:29.032817 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:29.032817 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:29.032817 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:29.032817 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:29.032817 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:29.032817 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:29.032817 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:29.032817 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:29.033659 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:29.033659 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:29.033659 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:29.033659 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:29.033659 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:59:29.033659 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:59:29.033659 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:59:29.033659 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:59:29.033659 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:59:29.033659 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:59:29.033659 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:59:29.033659 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:29.033659 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 554/1098] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jun 20 05:59:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:29.038912 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a42d8cb-a713-422c-a5cf-058e4de2450a None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:29.039686 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-996b11a4-eb94-4741-9a8a-d2f7cfec7a9f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:59:29.039686 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:29.039686 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:29.039686 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:29.039686 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:29.039686 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:29.039686 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:29.039686 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:29.039686 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:29.039686 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:29.039686 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:29.039686 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:29.039686 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:59:29.039686 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:59:29.039686 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:59:29.040935 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:59:29.040935 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:29.040935 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:29.040935 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:29.040935 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:29.040935 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:29.040935 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:29.040935 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:29.040935 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:29.040935 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:29.040935 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:29.040935 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:29.040935 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:29.040935 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:29.040935 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:29.040935 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:29.040935 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:29.041806 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:59:29.041806 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:59:29.041806 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:59:29.041806 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:59:29.041806 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:59:29.041806 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:59:29.041806 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:59:29.041806 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:59:29.041806 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 545/1099] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jun 20 05:59:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:59:29.046765 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b11a4-eb94-4741-9a8a-d2f7cfec7a9f None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:29.090065 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:29.139413 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a42d8cb-a713-422c-a5cf-058e4de2450a None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:29.147320 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b11a4-eb94-4741-9a8a-d2f7cfec7a9f None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:29.172557 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8341d37c-34f0-41d5-996a-dfd485d11b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:29.173252 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341d37c-34f0-41d5-996a-dfd485d11b9b None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:29.173537 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341d37c-34f0-41d5-996a-dfd485d11b9b None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:29.173822 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341d37c-34f0-41d5-996a-dfd485d11b9b None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:29.174599 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8341d37c-34f0-41d5-996a-dfd485d11b9b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:29.174899 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8341d37c-34f0-41d5-996a-dfd485d11b9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:29.176260 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8341d37c-34f0-41d5-996a-dfd485d11b9b None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:29.182827 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d41bf-624b-4a7d-bd07-28e0d38a7dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:29.183493 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d41bf-624b-4a7d-bd07-28e0d38a7dc8 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:29.183777 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d41bf-624b-4a7d-bd07-28e0d38a7dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:29.184052 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d41bf-624b-4a7d-bd07-28e0d38a7dc8 None admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:29.184484 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 555/1100] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 05:59:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:29.185520 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390d41bf-624b-4a7d-bd07-28e0d38a7dc8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:29.185844 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390d41bf-624b-4a7d-bd07-28e0d38a7dc8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:29.187276 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390d41bf-624b-4a7d-bd07-28e0d38a7dc8 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:29.190458 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8341d37c-34f0-41d5-996a-dfd485d11b9b None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:29.200623 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 546/1101] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jun 20 05:59:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:29.206765 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d41bf-624b-4a7d-bd07-28e0d38a7dc8 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:29.236847 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:29.290274 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8341d37c-34f0-41d5-996a-dfd485d11b9b None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:29.308571 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d41bf-624b-4a7d-bd07-28e0d38a7dc8 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:29.310138 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:29.325108 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05124eac-e4dc-4578-ba1c-f778bdc4a9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:29.326080 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05124eac-e4dc-4578-ba1c-f778bdc4a9ba None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:29.326361 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05124eac-e4dc-4578-ba1c-f778bdc4a9ba None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:29.326639 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05124eac-e4dc-4578-ba1c-f778bdc4a9ba None admin] PATH_INFO: `/v3/users/d5b7ee60aa194650a1e1d01d3706147a` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:29.327850 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05124eac-e4dc-4578-ba1c-f778bdc4a9ba None admin] RBAC: Authorizing `identity:get_user(user_id=d5b7ee60aa194650a1e1d01d3706147a)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:29.329322 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05124eac-e4dc-4578-ba1c-f778bdc4a9ba None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:29.330973 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 556/1102] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jun 20 05:59:29 2022] GET /identity/v3/users/d5b7ee60aa194650a1e1d01d3706147a => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:29.336553 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05124eac-e4dc-4578-ba1c-f778bdc4a9ba None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:29.343549 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83773f86-564e-4ff5-8d5a-5185bf3c21fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:29.344207 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83773f86-564e-4ff5-8d5a-5185bf3c21fd None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:29.344492 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83773f86-564e-4ff5-8d5a-5185bf3c21fd None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:29.344798 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83773f86-564e-4ff5-8d5a-5185bf3c21fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:29.345637 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83773f86-564e-4ff5-8d5a-5185bf3c21fd None admin] RBAC: Adding query filter params (role.id=b20a688ed203460d9430dd8aa432756b, scope.project.id=b349043204b34d1794818184ffe6505c, user.id=3cee106502e54829ad802ee41c9165fa) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:29.345950 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83773f86-564e-4ff5-8d5a-5185bf3c21fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:29.347375 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83773f86-564e-4ff5-8d5a-5185bf3c21fd None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:29.353318 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 547/1103] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jun 20 05:59:29 2022] GET /identity/v3/role_assignments?user.id=3cee106502e54829ad802ee41c9165fa&scope.project.id=b349043204b34d1794818184ffe6505c&role.id=b20a688ed203460d9430dd8aa432756b => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:29.439315 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05124eac-e4dc-4578-ba1c-f778bdc4a9ba None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:29.457346 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:29.480122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe0bbf2-ced2-4b73-b2a1-6d0256eb03ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:29.480802 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0bbf2-ced2-4b73-b2a1-6d0256eb03ef None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:29.481085 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0bbf2-ced2-4b73-b2a1-6d0256eb03ef None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:29.481359 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0bbf2-ced2-4b73-b2a1-6d0256eb03ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:29.551479 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe0bbf2-ced2-4b73-b2a1-6d0256eb03ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:29.552869 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe0bbf2-ced2-4b73-b2a1-6d0256eb03ef None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:29.654393 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 557/1104] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 05:59:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 20 05:59:29.660085 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83773f86-564e-4ff5-8d5a-5185bf3c21fd None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:29.763719 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83773f86-564e-4ff5-8d5a-5185bf3c21fd None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:29.797540 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5619ac-23bc-45cb-aa9b-98fa09476353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:29.798398 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5619ac-23bc-45cb-aa9b-98fa09476353 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:29.798677 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5619ac-23bc-45cb-aa9b-98fa09476353 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:29.798950 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5619ac-23bc-45cb-aa9b-98fa09476353 None admin] PATH_INFO: `/v3/projects/eda9e007cccf48fa93432b6b69e26adf` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:29.800174 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5619ac-23bc-45cb-aa9b-98fa09476353 None admin] RBAC: Authorizing `identity:get_project(project_id=eda9e007cccf48fa93432b6b69e26adf)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:29.801674 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5619ac-23bc-45cb-aa9b-98fa09476353 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:29.803642 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 548/1105] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jun 20 05:59:29 2022] GET /identity/v3/projects/eda9e007cccf48fa93432b6b69e26adf => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:29.809419 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe0bbf2-ced2-4b73-b2a1-6d0256eb03ef None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:29.824026 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:29.911140 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe0bbf2-ced2-4b73-b2a1-6d0256eb03ef None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:29.946622 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc996aa5-f180-4ed0-adf0-1cd15c20525c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:29.947288 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc996aa5-f180-4ed0-adf0-1cd15c20525c None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:29.947573 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc996aa5-f180-4ed0-adf0-1cd15c20525c None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:29.948116 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc996aa5-f180-4ed0-adf0-1cd15c20525c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:29.949045 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc996aa5-f180-4ed0-adf0-1cd15c20525c None admin] RBAC: Adding query filter params (role.id=5a64bd8372704de98e75436ff69e46b3, scope.project.id=eda9e007cccf48fa93432b6b69e26adf, user.id=d5b7ee60aa194650a1e1d01d3706147a) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:29.949365 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc996aa5-f180-4ed0-adf0-1cd15c20525c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:29.951012 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc996aa5-f180-4ed0-adf0-1cd15c20525c None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:29.957045 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 558/1106] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jun 20 05:59:29 2022] GET /identity/v3/role_assignments?user.id=d5b7ee60aa194650a1e1d01d3706147a&scope.project.id=eda9e007cccf48fa93432b6b69e26adf&role.id=5a64bd8372704de98e75436ff69e46b3 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:32.040137 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a4745-4003-406f-a183-98a714cc94e0 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:32.040802 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a4745-4003-406f-a183-98a714cc94e0 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:32.040802 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a4745-4003-406f-a183-98a714cc94e0 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:32.042085 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 549/1107] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:59:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:32.047820 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515af17-5df1-4a5f-a995-59ce71e43047 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:32.048274 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515af17-5df1-4a5f-a995-59ce71e43047 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:32.048374 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515af17-5df1-4a5f-a995-59ce71e43047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:32.065502 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-0515af17-5df1-4a5f-a995-59ce71e43047 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:32.066691 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-0515af17-5df1-4a5f-a995-59ce71e43047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:32.132175 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 559/1108] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:59:32.156959 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13a4745-4003-406f-a183-98a714cc94e0 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:32.191832 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:32.264593 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13a4745-4003-406f-a183-98a714cc94e0 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:32.298460 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb3e42-9b7a-4186-b865-947aaaaa85eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:32.299170 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb3e42-9b7a-4186-b865-947aaaaa85eb None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:32.299447 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb3e42-9b7a-4186-b865-947aaaaa85eb None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:32.299718 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb3e42-9b7a-4186-b865-947aaaaa85eb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:32.300898 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cb3e42-9b7a-4186-b865-947aaaaa85eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:32.302318 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cb3e42-9b7a-4186-b865-947aaaaa85eb None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:32.303925 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 550/1109] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:59:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:32.310104 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0515af17-5df1-4a5f-a995-59ce71e43047 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:32.318123 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:32.406913 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0515af17-5df1-4a5f-a995-59ce71e43047 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:32.439299 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d48e5ad-06d8-4eb3-a115-8ef564ef0366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:32.439953 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48e5ad-06d8-4eb3-a115-8ef564ef0366 None admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:32.440230 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48e5ad-06d8-4eb3-a115-8ef564ef0366 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:32.440499 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48e5ad-06d8-4eb3-a115-8ef564ef0366 None admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:32.441314 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d48e5ad-06d8-4eb3-a115-8ef564ef0366 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:32.442734 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d48e5ad-06d8-4eb3-a115-8ef564ef0366 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:32.463875 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 560/1110] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Jun 20 05:59:32 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 05:59:34.508271 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd948c6-142b-413f-8832-3e8b62a2ae19 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:34.508780 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd948c6-142b-413f-8832-3e8b62a2ae19 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:34.508883 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd948c6-142b-413f-8832-3e8b62a2ae19 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:34.510216 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 551/1111] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:59:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:34.516264 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf99638-07e5-47b7-a03c-186aa5d7a084 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:34.516644 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf99638-07e5-47b7-a03c-186aa5d7a084 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:34.516863 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf99638-07e5-47b7-a03c-186aa5d7a084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:34.533620 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-caf99638-07e5-47b7-a03c-186aa5d7a084 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:34.534809 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-caf99638-07e5-47b7-a03c-186aa5d7a084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:34.589712 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:34.603429 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 561/1112] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:59:34.630319 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd948c6-142b-413f-8832-3e8b62a2ae19 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:34.729319 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd948c6-142b-413f-8832-3e8b62a2ae19 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:34.730732 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:34.763580 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713eb57b-078c-4de3-ba54-8840c90ad2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:34.764411 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713eb57b-078c-4de3-ba54-8840c90ad2c6 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:34.764690 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713eb57b-078c-4de3-ba54-8840c90ad2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:34.764990 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713eb57b-078c-4de3-ba54-8840c90ad2c6 None admin] PATH_INFO: `/v3/roles/844adf3fdfaf458faa6fcbcf641d4182` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:34.766419 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713eb57b-078c-4de3-ba54-8840c90ad2c6 None admin] RBAC: Authorizing `identity:get_role(role_id=844adf3fdfaf458faa6fcbcf641d4182)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:34.767771 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713eb57b-078c-4de3-ba54-8840c90ad2c6 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:34.769151 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 552/1113] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jun 20 05:59:34 2022] GET /identity/v3/roles/844adf3fdfaf458faa6fcbcf641d4182 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:34.774809 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf99638-07e5-47b7-a03c-186aa5d7a084 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:34.870561 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf99638-07e5-47b7-a03c-186aa5d7a084 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:34.905759 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f4523-6c8c-497a-9719-6dc353c2c46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:34.906624 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f4523-6c8c-497a-9719-6dc353c2c46e None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:34.906905 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f4523-6c8c-497a-9719-6dc353c2c46e None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:34.907180 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f4523-6c8c-497a-9719-6dc353c2c46e None admin] PATH_INFO: `/v3/users/6e7eb7e4aa0242f280324cd95f8f69ac` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:34.921402 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38f4523-6c8c-497a-9719-6dc353c2c46e None admin] RBAC: Authorizing `identity:get_user(user_id=6e7eb7e4aa0242f280324cd95f8f69ac)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:34.922842 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38f4523-6c8c-497a-9719-6dc353c2c46e None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:34.924490 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 562/1114] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jun 20 05:59:34 2022] GET /identity/v3/users/6e7eb7e4aa0242f280324cd95f8f69ac => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:34.930336 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713eb57b-078c-4de3-ba54-8840c90ad2c6 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:35.027296 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713eb57b-078c-4de3-ba54-8840c90ad2c6 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:35.061101 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5513ad4-fa2a-4f1c-b22e-2cfe90bf35e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:35.061735 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5513ad4-fa2a-4f1c-b22e-2cfe90bf35e2 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:35.062020 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5513ad4-fa2a-4f1c-b22e-2cfe90bf35e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:35.062295 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5513ad4-fa2a-4f1c-b22e-2cfe90bf35e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:35.100102 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:35.128496 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5513ad4-fa2a-4f1c-b22e-2cfe90bf35e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:35.129957 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5513ad4-fa2a-4f1c-b22e-2cfe90bf35e2 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:35.226940 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 553/1115] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 05:59:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 05:59:35.233387 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f4523-6c8c-497a-9719-6dc353c2c46e None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:35.283060 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:35.331599 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f4523-6c8c-497a-9719-6dc353c2c46e None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:35.364676 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6621068-320e-4df4-85a7-5febc1f44268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:35.365545 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6621068-320e-4df4-85a7-5febc1f44268 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:35.365828 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6621068-320e-4df4-85a7-5febc1f44268 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:35.366104 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6621068-320e-4df4-85a7-5febc1f44268 None admin] PATH_INFO: `/v3/projects/eda9e007cccf48fa93432b6b69e26adf` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:35.367271 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6621068-320e-4df4-85a7-5febc1f44268 None admin] RBAC: Authorizing `identity:get_project(project_id=eda9e007cccf48fa93432b6b69e26adf)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:35.368688 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6621068-320e-4df4-85a7-5febc1f44268 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:35.370395 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 563/1116] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jun 20 05:59:35 2022] GET /identity/v3/projects/eda9e007cccf48fa93432b6b69e26adf => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:35.376444 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5513ad4-fa2a-4f1c-b22e-2cfe90bf35e2 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:35.444192 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:35.476837 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5513ad4-fa2a-4f1c-b22e-2cfe90bf35e2 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:35.509394 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be03e090-8785-43f9-8434-5093fbc09837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:35.510044 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03e090-8785-43f9-8434-5093fbc09837 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:35.510330 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03e090-8785-43f9-8434-5093fbc09837 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:35.510605 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03e090-8785-43f9-8434-5093fbc09837 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:35.511431 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be03e090-8785-43f9-8434-5093fbc09837 None admin] RBAC: Adding query filter params (role.id=844adf3fdfaf458faa6fcbcf641d4182, scope.project.id=eda9e007cccf48fa93432b6b69e26adf, user.id=6e7eb7e4aa0242f280324cd95f8f69ac) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:35.511744 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be03e090-8785-43f9-8434-5093fbc09837 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:35.513859 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be03e090-8785-43f9-8434-5093fbc09837 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:35.519114 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 554/1117] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jun 20 05:59:35 2022] GET /identity/v3/role_assignments?user.id=6e7eb7e4aa0242f280324cd95f8f69ac&scope.project.id=eda9e007cccf48fa93432b6b69e26adf&role.id=844adf3fdfaf458faa6fcbcf641d4182 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:37.562219 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ec8f7-a4e4-4d3f-9dfa-7cd2612c0a5c None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:37.562761 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ec8f7-a4e4-4d3f-9dfa-7cd2612c0a5c None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:37.562761 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ec8f7-a4e4-4d3f-9dfa-7cd2612c0a5c None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:37.564116 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 564/1118] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:37.569444 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf594db8-329e-41ac-9015-ca55a6787a5b None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:37.569867 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf594db8-329e-41ac-9015-ca55a6787a5b None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:37.569998 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf594db8-329e-41ac-9015-ca55a6787a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:37.588174 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-cf594db8-329e-41ac-9015-ca55a6787a5b None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:37.589436 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-cf594db8-329e-41ac-9015-ca55a6787a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:37.663199 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 555/1119] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:59:37.687099 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ec8f7-a4e4-4d3f-9dfa-7cd2612c0a5c None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:37.787229 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ec8f7-a4e4-4d3f-9dfa-7cd2612c0a5c None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:37.804272 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:37.820856 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59c6a0b-d0b9-443c-ac23-fc9a0f4ef6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:37.821696 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c6a0b-d0b9-443c-ac23-fc9a0f4ef6a4 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:37.821975 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c6a0b-d0b9-443c-ac23-fc9a0f4ef6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:37.822503 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c6a0b-d0b9-443c-ac23-fc9a0f4ef6a4 None admin] PATH_INFO: `/v3/roles/844adf3fdfaf458faa6fcbcf641d4182` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:37.823960 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59c6a0b-d0b9-443c-ac23-fc9a0f4ef6a4 None admin] RBAC: Authorizing `identity:get_role(role_id=844adf3fdfaf458faa6fcbcf641d4182)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:37.826000 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59c6a0b-d0b9-443c-ac23-fc9a0f4ef6a4 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:37.827369 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 565/1120] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jun 20 05:59:37 2022] GET /identity/v3/roles/844adf3fdfaf458faa6fcbcf641d4182 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:37.833151 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf594db8-329e-41ac-9015-ca55a6787a5b None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:37.894080 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:37.932295 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf594db8-329e-41ac-9015-ca55a6787a5b None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:37.967786 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c331bf-6ffd-4597-9591-c4b04a64c170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:37.968647 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c331bf-6ffd-4597-9591-c4b04a64c170 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:37.968954 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c331bf-6ffd-4597-9591-c4b04a64c170 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:37.969229 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c331bf-6ffd-4597-9591-c4b04a64c170 None admin] PATH_INFO: `/v3/users/6e7eb7e4aa0242f280324cd95f8f69ac` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:37.970406 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c331bf-6ffd-4597-9591-c4b04a64c170 None admin] RBAC: Authorizing `identity:get_user(user_id=6e7eb7e4aa0242f280324cd95f8f69ac)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:37.971839 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c331bf-6ffd-4597-9591-c4b04a64c170 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:37.973493 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 556/1121] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jun 20 05:59:37 2022] GET /identity/v3/users/6e7eb7e4aa0242f280324cd95f8f69ac => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:37.980167 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59c6a0b-d0b9-443c-ac23-fc9a0f4ef6a4 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:38.075830 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59c6a0b-d0b9-443c-ac23-fc9a0f4ef6a4 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:38.108449 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa5ef63-21c5-4045-a4b1-686830e7cafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:38.109331 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5ef63-21c5-4045-a4b1-686830e7cafc None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:38.109612 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5ef63-21c5-4045-a4b1-686830e7cafc None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:38.109882 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5ef63-21c5-4045-a4b1-686830e7cafc None admin] PATH_INFO: `/v3/projects/eda9e007cccf48fa93432b6b69e26adf` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:38.111045 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa5ef63-21c5-4045-a4b1-686830e7cafc None admin] RBAC: Authorizing `identity:get_project(project_id=eda9e007cccf48fa93432b6b69e26adf)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:38.112456 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa5ef63-21c5-4045-a4b1-686830e7cafc None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:38.114160 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 566/1122] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jun 20 05:59:37 2022] GET /identity/v3/projects/eda9e007cccf48fa93432b6b69e26adf => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:38.120060 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c331bf-6ffd-4597-9591-c4b04a64c170 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:38.217299 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c331bf-6ffd-4597-9591-c4b04a64c170 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:38.245517 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:38.251509 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda4c7b-2234-4b75-90e4-6812f8adbc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:38.252393 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda4c7b-2234-4b75-90e4-6812f8adbc93 None admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:38.252678 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda4c7b-2234-4b75-90e4-6812f8adbc93 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:38.252990 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda4c7b-2234-4b75-90e4-6812f8adbc93 None admin] PATH_INFO: `/v3/projects/eda9e007cccf48fa93432b6b69e26adf/users/6e7eb7e4aa0242f280324cd95f8f69ac/roles/844adf3fdfaf458faa6fcbcf641d4182` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:38.255182 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fda4c7b-2234-4b75-90e4-6812f8adbc93 None admin] RBAC: Authorizing `identity:create_grant(project_id=eda9e007cccf48fa93432b6b69e26adf, user_id=6e7eb7e4aa0242f280324cd95f8f69ac, role_id=844adf3fdfaf458faa6fcbcf641d4182)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:38.256609 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fda4c7b-2234-4b75-90e4-6812f8adbc93 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:38.269393 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 557/1123] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jun 20 05:59:38 2022] PUT /identity/v3/projects/eda9e007cccf48fa93432b6b69e26adf/users/6e7eb7e4aa0242f280324cd95f8f69ac/roles/844adf3fdfaf458faa6fcbcf641d4182 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:59:40.290285 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81161f-148c-4d8c-b153-0ebe7033ced8 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:40.290859 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81161f-148c-4d8c-b153-0ebe7033ced8 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:40.290859 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81161f-148c-4d8c-b153-0ebe7033ced8 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:40.292215 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 567/1124] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:59:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:40.297469 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fb32c-a3e7-4cc5-b9da-4332ce475b25 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:40.297881 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fb32c-a3e7-4cc5-b9da-4332ce475b25 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:40.298030 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fb32c-a3e7-4cc5-b9da-4332ce475b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:40.314406 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-3c0fb32c-a3e7-4cc5-b9da-4332ce475b25 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:40.315595 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-3c0fb32c-a3e7-4cc5-b9da-4332ce475b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:40.382146 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 558/1125] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:59:40.406608 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a81161f-148c-4d8c-b153-0ebe7033ced8 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:40.471868 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:40.517155 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a81161f-148c-4d8c-b153-0ebe7033ced8 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:40.549734 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e64a6-9d76-4cd4-89ab-c7b792cbe854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:40.550515 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e64a6-9d76-4cd4-89ab-c7b792cbe854 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:40.550793 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e64a6-9d76-4cd4-89ab-c7b792cbe854 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:40.551066 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e64a6-9d76-4cd4-89ab-c7b792cbe854 None admin] PATH_INFO: `/v3/roles/844adf3fdfaf458faa6fcbcf641d4182` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:40.552529 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4e64a6-9d76-4cd4-89ab-c7b792cbe854 None admin] RBAC: Authorizing `identity:get_role(role_id=844adf3fdfaf458faa6fcbcf641d4182)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:40.553916 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4e64a6-9d76-4cd4-89ab-c7b792cbe854 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:40.555280 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 568/1126] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jun 20 05:59:40 2022] GET /identity/v3/roles/844adf3fdfaf458faa6fcbcf641d4182 => generated 223 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:40.561617 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0fb32c-a3e7-4cc5-b9da-4332ce475b25 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:40.661851 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0fb32c-a3e7-4cc5-b9da-4332ce475b25 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:40.683233 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:40.695902 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160e6f3c-e6f2-4df9-b552-b7e2e06fc314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:40.696795 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e6f3c-e6f2-4df9-b552-b7e2e06fc314 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:40.697076 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e6f3c-e6f2-4df9-b552-b7e2e06fc314 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:40.697613 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e6f3c-e6f2-4df9-b552-b7e2e06fc314 None admin] PATH_INFO: `/v3/users/6e7eb7e4aa0242f280324cd95f8f69ac` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:40.698782 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160e6f3c-e6f2-4df9-b552-b7e2e06fc314 None admin] RBAC: Authorizing `identity:get_user(user_id=6e7eb7e4aa0242f280324cd95f8f69ac)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:40.700904 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160e6f3c-e6f2-4df9-b552-b7e2e06fc314 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:40.702526 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 559/1127] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jun 20 05:59:40 2022] GET /identity/v3/users/6e7eb7e4aa0242f280324cd95f8f69ac => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:40.708343 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e64a6-9d76-4cd4-89ab-c7b792cbe854 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:40.803806 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e64a6-9d76-4cd4-89ab-c7b792cbe854 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:40.826091 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:40.838316 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9b49be-c80c-4cc1-a50d-c41bb2acacc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:40.838955 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b49be-c80c-4cc1-a50d-c41bb2acacc7 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:40.839236 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b49be-c80c-4cc1-a50d-c41bb2acacc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:40.839509 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b49be-c80c-4cc1-a50d-c41bb2acacc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:40.905679 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9b49be-c80c-4cc1-a50d-c41bb2acacc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:40.907105 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9b49be-c80c-4cc1-a50d-c41bb2acacc7 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:41.006863 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 569/1128] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 05:59:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 05:59:41.013262 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160e6f3c-e6f2-4df9-b552-b7e2e06fc314 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:41.112216 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160e6f3c-e6f2-4df9-b552-b7e2e06fc314 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:41.144692 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5567a8-8505-4d72-9e32-2469baf1e37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:41.145555 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5567a8-8505-4d72-9e32-2469baf1e37a None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:41.145835 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5567a8-8505-4d72-9e32-2469baf1e37a None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:41.146108 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5567a8-8505-4d72-9e32-2469baf1e37a None admin] PATH_INFO: `/v3/projects/eda9e007cccf48fa93432b6b69e26adf` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:41.147258 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5567a8-8505-4d72-9e32-2469baf1e37a None admin] RBAC: Authorizing `identity:get_project(project_id=eda9e007cccf48fa93432b6b69e26adf)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:41.148669 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5567a8-8505-4d72-9e32-2469baf1e37a None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:41.150357 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 560/1129] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jun 20 05:59:41 2022] GET /identity/v3/projects/eda9e007cccf48fa93432b6b69e26adf => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:41.156807 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9b49be-c80c-4cc1-a50d-c41bb2acacc7 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:41.180643 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:41.253866 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9b49be-c80c-4cc1-a50d-c41bb2acacc7 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:41.287785 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4536ee-ba75-4407-b23c-d0c1443a31c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:41.288433 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4536ee-ba75-4407-b23c-d0c1443a31c6 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:41.288734 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4536ee-ba75-4407-b23c-d0c1443a31c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:41.289010 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4536ee-ba75-4407-b23c-d0c1443a31c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:41.291751 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4536ee-ba75-4407-b23c-d0c1443a31c6 None admin] RBAC: Adding query filter params (role.id=844adf3fdfaf458faa6fcbcf641d4182, scope.project.id=eda9e007cccf48fa93432b6b69e26adf, user.id=6e7eb7e4aa0242f280324cd95f8f69ac) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:41.291751 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4536ee-ba75-4407-b23c-d0c1443a31c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:41.291751 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4536ee-ba75-4407-b23c-d0c1443a31c6 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:41.299851 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 570/1130] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jun 20 05:59:41 2022] GET /identity/v3/role_assignments?user.id=6e7eb7e4aa0242f280324cd95f8f69ac&scope.project.id=eda9e007cccf48fa93432b6b69e26adf&role.id=844adf3fdfaf458faa6fcbcf641d4182 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:43.390016 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82868e2b-091b-44c2-bf87-916f08cddbc3 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:43.390594 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82868e2b-091b-44c2-bf87-916f08cddbc3 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:43.390594 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82868e2b-091b-44c2-bf87-916f08cddbc3 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:43.391929 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 561/1131] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:59:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:43.397269 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bdc82a-5849-445e-bb3a-8f34e407cb2a None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:43.397711 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bdc82a-5849-445e-bb3a-8f34e407cb2a None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:43.397816 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bdc82a-5849-445e-bb3a-8f34e407cb2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:43.414692 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-92bdc82a-5849-445e-bb3a-8f34e407cb2a None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:43.415872 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-92bdc82a-5849-445e-bb3a-8f34e407cb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:43.483007 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 571/1132] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 05:59:43.506846 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82868e2b-091b-44c2-bf87-916f08cddbc3 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:43.565442 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:43.608482 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82868e2b-091b-44c2-bf87-916f08cddbc3 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:43.642457 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88242783-dac7-4a63-89e4-29d2eb3f7d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:43.643167 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88242783-dac7-4a63-89e4-29d2eb3f7d97 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:43.643447 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88242783-dac7-4a63-89e4-29d2eb3f7d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:43.643723 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88242783-dac7-4a63-89e4-29d2eb3f7d97 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:43.644902 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88242783-dac7-4a63-89e4-29d2eb3f7d97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:43.646327 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88242783-dac7-4a63-89e4-29d2eb3f7d97 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:43.647938 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 562/1133] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:59:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:43.654209 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bdc82a-5849-445e-bb3a-8f34e407cb2a None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:43.671296 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:43.751944 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bdc82a-5849-445e-bb3a-8f34e407cb2a None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:43.784644 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d3d52-b96a-4f1c-8449-88eed8f6fddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:43.785317 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d3d52-b96a-4f1c-8449-88eed8f6fddf None admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:43.785602 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d3d52-b96a-4f1c-8449-88eed8f6fddf None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:43.785879 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d3d52-b96a-4f1c-8449-88eed8f6fddf None admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:43.786599 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d3d52-b96a-4f1c-8449-88eed8f6fddf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:43.788020 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d3d52-b96a-4f1c-8449-88eed8f6fddf None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:43.813048 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 572/1134] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Jun 20 05:59:43 2022] POST /identity/v3/projects => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:59:45.872349 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb4134-48f0-4975-aad8-891605c3c7eb None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:45.872896 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb4134-48f0-4975-aad8-891605c3c7eb None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:45.872896 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb4134-48f0-4975-aad8-891605c3c7eb None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:45.874223 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 563/1135] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:59:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:45.879479 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266e614-6e91-4bcd-bb24-4b7bd463fbac None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:45.879898 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266e614-6e91-4bcd-bb24-4b7bd463fbac None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:45.880025 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266e614-6e91-4bcd-bb24-4b7bd463fbac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:45.897460 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-7266e614-6e91-4bcd-bb24-4b7bd463fbac None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:45.898645 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-7266e614-6e91-4bcd-bb24-4b7bd463fbac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:45.959410 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:45.968804 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 573/1136] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:59:45.990742 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb4134-48f0-4975-aad8-891605c3c7eb None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:46.089200 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb4134-48f0-4975-aad8-891605c3c7eb None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:46.114718 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:46.124644 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2bf8f8-84ee-44f0-a0bc-3abc1987160b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:46.125388 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2bf8f8-84ee-44f0-a0bc-3abc1987160b None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:46.125668 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2bf8f8-84ee-44f0-a0bc-3abc1987160b None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:46.125941 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2bf8f8-84ee-44f0-a0bc-3abc1987160b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:46.127097 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2bf8f8-84ee-44f0-a0bc-3abc1987160b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:46.128517 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2bf8f8-84ee-44f0-a0bc-3abc1987160b None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:46.130190 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 564/1137] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 05:59:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:46.135821 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266e614-6e91-4bcd-bb24-4b7bd463fbac None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:46.234184 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266e614-6e91-4bcd-bb24-4b7bd463fbac None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:46.266823 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc0296-9b51-4ee1-aaab-542d6a442d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:46.267475 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc0296-9b51-4ee1-aaab-542d6a442d4a None admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:46.267753 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc0296-9b51-4ee1-aaab-542d6a442d4a None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:46.268024 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc0296-9b51-4ee1-aaab-542d6a442d4a None admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:46.268755 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fc0296-9b51-4ee1-aaab-542d6a442d4a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:46.270168 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fc0296-9b51-4ee1-aaab-542d6a442d4a None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:46.288941 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 574/1138] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Jun 20 05:59:46 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:59:48.387390 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980dcff-837e-4fd5-88b8-75240310a684 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:48.387928 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980dcff-837e-4fd5-88b8-75240310a684 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:48.387928 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980dcff-837e-4fd5-88b8-75240310a684 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:48.389333 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 565/1139] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:59:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:48.394650 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a1bde-23d5-4b5d-b04f-03ac05342335 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:48.395080 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a1bde-23d5-4b5d-b04f-03ac05342335 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:48.395185 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a1bde-23d5-4b5d-b04f-03ac05342335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:48.412679 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-dc1a1bde-23d5-4b5d-b04f-03ac05342335 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:48.413888 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-dc1a1bde-23d5-4b5d-b04f-03ac05342335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:48.461235 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:48.480932 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 575/1140] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 05:59:48.504180 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3980dcff-837e-4fd5-88b8-75240310a684 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:48.605363 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3980dcff-837e-4fd5-88b8-75240310a684 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:48.639820 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f3625f-94f0-4257-9e6b-90ea9b6d3618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:48.640603 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3625f-94f0-4257-9e6b-90ea9b6d3618 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:48.640948 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3625f-94f0-4257-9e6b-90ea9b6d3618 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:48.641245 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3625f-94f0-4257-9e6b-90ea9b6d3618 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:48.651892 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f3625f-94f0-4257-9e6b-90ea9b6d3618 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:59:48.660192 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-65f3625f-94f0-4257-9e6b-90ea9b6d3618 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:59:48.660192 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:48.660192 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:48.660192 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:48.660192 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:48.660192 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:48.660192 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:48.660192 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:48.660192 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:48.660192 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:48.660192 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:48.660192 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:48.660192 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:59:48.660192 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:59:48.660192 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:59:48.660192 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:59:48.661458 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:59:48.661458 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:59:48.661458 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:59:48.661458 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:59:48.661458 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:48.661458 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:48.661458 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:48.661458 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:48.661458 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:48.661458 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:48.661458 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:48.661458 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:48.661458 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:48.661458 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:48.661458 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:48.661458 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:48.662568 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:48.662568 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:48.662568 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:48.662568 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:48.662568 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:59:48.662568 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:59:48.662568 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:59:48.662568 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:59:48.662568 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:59:48.662568 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:59:48.662568 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:59:48.662568 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:59:48.662568 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 566/1141] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jun 20 05:59:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:48.667614 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a1bde-23d5-4b5d-b04f-03ac05342335 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:48.763743 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a1bde-23d5-4b5d-b04f-03ac05342335 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:48.796489 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac278a1-b481-45f4-ae03-3719b8c3f560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:48.797174 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac278a1-b481-45f4-ae03-3719b8c3f560 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:48.797456 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac278a1-b481-45f4-ae03-3719b8c3f560 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:48.797729 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac278a1-b481-45f4-ae03-3719b8c3f560 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:48.798462 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac278a1-b481-45f4-ae03-3719b8c3f560 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:48.798766 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac278a1-b481-45f4-ae03-3719b8c3f560 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:48.800115 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac278a1-b481-45f4-ae03-3719b8c3f560 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:48.807865 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 576/1142] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 05:59:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:48.814267 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f3625f-94f0-4257-9e6b-90ea9b6d3618 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:48.869581 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:48.913832 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f3625f-94f0-4257-9e6b-90ea9b6d3618 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:48.947486 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc6e7f4-259d-46ed-894e-f956d3b9e7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:48.948342 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6e7f4-259d-46ed-894e-f956d3b9e7ca None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:48.949473 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6e7f4-259d-46ed-894e-f956d3b9e7ca None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:48.949913 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6e7f4-259d-46ed-894e-f956d3b9e7ca None admin] PATH_INFO: `/v3/users/49c32d13e1de41c8bb1f3167d02c04f7` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:48.962735 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc6e7f4-259d-46ed-894e-f956d3b9e7ca None admin] RBAC: Authorizing `identity:get_user(user_id=49c32d13e1de41c8bb1f3167d02c04f7)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:48.964194 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc6e7f4-259d-46ed-894e-f956d3b9e7ca None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:48.965965 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 567/1143] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jun 20 05:59:48 2022] GET /identity/v3/users/49c32d13e1de41c8bb1f3167d02c04f7 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:48.971749 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac278a1-b481-45f4-ae03-3719b8c3f560 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:49.018760 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:49.071329 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac278a1-b481-45f4-ae03-3719b8c3f560 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:49.103692 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac33f2b-b599-4d5d-a10f-e81d0ac68828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:49.104324 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac33f2b-b599-4d5d-a10f-e81d0ac68828 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:49.104601 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac33f2b-b599-4d5d-a10f-e81d0ac68828 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:49.105423 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac33f2b-b599-4d5d-a10f-e81d0ac68828 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:49.169307 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac33f2b-b599-4d5d-a10f-e81d0ac68828 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:49.170666 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac33f2b-b599-4d5d-a10f-e81d0ac68828 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:49.214486 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:49.272490 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 577/1144] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 05:59:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 05:59:49.278434 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc6e7f4-259d-46ed-894e-f956d3b9e7ca None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:49.375087 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc6e7f4-259d-46ed-894e-f956d3b9e7ca None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:49.388135 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:49.409018 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c47096-6d6c-4919-8958-2ee8157d1ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:49.409861 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c47096-6d6c-4919-8958-2ee8157d1ebc None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:49.410140 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c47096-6d6c-4919-8958-2ee8157d1ebc None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:49.410414 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c47096-6d6c-4919-8958-2ee8157d1ebc None admin] PATH_INFO: `/v3/projects/c31d1c4aba0148d88e00cae45ee0c3f8` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:49.411569 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c47096-6d6c-4919-8958-2ee8157d1ebc None admin] RBAC: Authorizing `identity:get_project(project_id=c31d1c4aba0148d88e00cae45ee0c3f8)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:49.413017 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c47096-6d6c-4919-8958-2ee8157d1ebc None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:49.414690 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 568/1145] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jun 20 05:59:49 2022] GET /identity/v3/projects/c31d1c4aba0148d88e00cae45ee0c3f8 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:49.421478 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac33f2b-b599-4d5d-a10f-e81d0ac68828 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:49.518381 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac33f2b-b599-4d5d-a10f-e81d0ac68828 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:49.550357 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9ffaa-4999-4798-a0eb-208c36ae132f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:49.550996 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9ffaa-4999-4798-a0eb-208c36ae132f None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:49.551274 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9ffaa-4999-4798-a0eb-208c36ae132f None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:49.551547 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9ffaa-4999-4798-a0eb-208c36ae132f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:49.552359 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a9ffaa-4999-4798-a0eb-208c36ae132f None admin] RBAC: Adding query filter params (role.id=5a64bd8372704de98e75436ff69e46b3, scope.project.id=c31d1c4aba0148d88e00cae45ee0c3f8, user.id=49c32d13e1de41c8bb1f3167d02c04f7) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:49.552667 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a9ffaa-4999-4798-a0eb-208c36ae132f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:49.554107 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a9ffaa-4999-4798-a0eb-208c36ae132f None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:49.559979 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 578/1146] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jun 20 05:59:49 2022] GET /identity/v3/role_assignments?user.id=49c32d13e1de41c8bb1f3167d02c04f7&scope.project.id=c31d1c4aba0148d88e00cae45ee0c3f8&role.id=5a64bd8372704de98e75436ff69e46b3 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:51.533080 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46197d-c235-421a-a8fb-2648f3086a8f None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:51.533623 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46197d-c235-421a-a8fb-2648f3086a8f None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:51.533623 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46197d-c235-421a-a8fb-2648f3086a8f None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:51.535006 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 569/1147] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:51.540335 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d3f9a-6fe4-4e25-b7f7-4ce92faa050d None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:51.540750 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d3f9a-6fe4-4e25-b7f7-4ce92faa050d None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:51.540926 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d3f9a-6fe4-4e25-b7f7-4ce92faa050d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:51.557350 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-b25d3f9a-6fe4-4e25-b7f7-4ce92faa050d None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:51.558543 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-b25d3f9a-6fe4-4e25-b7f7-4ce92faa050d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:51.561276 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:51.625673 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 579/1148] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:59:51.648170 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46197d-c235-421a-a8fb-2648f3086a8f None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:51.746825 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46197d-c235-421a-a8fb-2648f3086a8f None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:51.779792 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054fd6b4-aeef-432b-b472-b3f737261bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:51.780558 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054fd6b4-aeef-432b-b472-b3f737261bca None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:51.780864 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054fd6b4-aeef-432b-b472-b3f737261bca None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:51.781135 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054fd6b4-aeef-432b-b472-b3f737261bca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:51.790833 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054fd6b4-aeef-432b-b472-b3f737261bca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:59:51.798933 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-054fd6b4-aeef-432b-b472-b3f737261bca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:59:51.798933 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:51.798933 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:51.798933 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:51.798933 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:51.798933 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:51.798933 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:51.798933 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:51.798933 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:51.798933 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:51.798933 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:51.798933 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:51.798933 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:59:51.798933 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:59:51.798933 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:59:51.798933 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:59:51.800038 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:59:51.800038 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:59:51.800038 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:59:51.800038 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:59:51.800038 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:51.800038 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:51.800038 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:51.800038 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:51.800038 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:51.800038 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:51.800038 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:51.800038 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:51.800038 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:51.800038 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:51.800038 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:51.800038 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:51.800980 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:51.800980 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:51.800980 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:51.800980 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:51.800980 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:59:51.800980 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:59:51.800980 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:59:51.800980 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:59:51.800980 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:59:51.800980 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:59:51.800980 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:59:51.800980 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:59:51.800980 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 570/1149] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jun 20 05:59:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:51.806066 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d3f9a-6fe4-4e25-b7f7-4ce92faa050d None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:51.903133 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d3f9a-6fe4-4e25-b7f7-4ce92faa050d None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:51.936144 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3468b7f0-aa0e-47db-ae86-793e294a80f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:51.936836 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468b7f0-aa0e-47db-ae86-793e294a80f7 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:51.937124 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468b7f0-aa0e-47db-ae86-793e294a80f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:51.937401 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468b7f0-aa0e-47db-ae86-793e294a80f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:51.938151 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3468b7f0-aa0e-47db-ae86-793e294a80f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:51.938458 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3468b7f0-aa0e-47db-ae86-793e294a80f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:51.939824 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3468b7f0-aa0e-47db-ae86-793e294a80f7 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:51.947995 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 580/1150] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 05:59:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:51.954230 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054fd6b4-aeef-432b-b472-b3f737261bca None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:51.995025 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:52.052612 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054fd6b4-aeef-432b-b472-b3f737261bca None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:52.085736 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe269f7-a334-4fa1-b2a8-532ffa31778f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:52.086592 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe269f7-a334-4fa1-b2a8-532ffa31778f None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:52.086875 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe269f7-a334-4fa1-b2a8-532ffa31778f None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:52.087148 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe269f7-a334-4fa1-b2a8-532ffa31778f None admin] PATH_INFO: `/v3/users/49c32d13e1de41c8bb1f3167d02c04f7` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:52.088332 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe269f7-a334-4fa1-b2a8-532ffa31778f None admin] RBAC: Authorizing `identity:get_user(user_id=49c32d13e1de41c8bb1f3167d02c04f7)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:52.090759 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe269f7-a334-4fa1-b2a8-532ffa31778f None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:52.092391 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 571/1151] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jun 20 05:59:51 2022] GET /identity/v3/users/49c32d13e1de41c8bb1f3167d02c04f7 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:52.097991 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3468b7f0-aa0e-47db-ae86-793e294a80f7 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:52.100824 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:52.196216 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3468b7f0-aa0e-47db-ae86-793e294a80f7 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:52.229023 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4c772f-0dc6-444e-bf9f-582b67a8767f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:52.230391 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c772f-0dc6-444e-bf9f-582b67a8767f None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:52.230666 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c772f-0dc6-444e-bf9f-582b67a8767f None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:52.230936 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c772f-0dc6-444e-bf9f-582b67a8767f None admin] PATH_INFO: `/v3/projects/c31d1c4aba0148d88e00cae45ee0c3f8` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:52.232112 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4c772f-0dc6-444e-bf9f-582b67a8767f None admin] RBAC: Authorizing `identity:get_project(project_id=c31d1c4aba0148d88e00cae45ee0c3f8)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:52.233569 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4c772f-0dc6-444e-bf9f-582b67a8767f None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:52.235445 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 581/1152] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jun 20 05:59:52 2022] GET /identity/v3/projects/c31d1c4aba0148d88e00cae45ee0c3f8 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:52.241314 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe269f7-a334-4fa1-b2a8-532ffa31778f None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:52.347444 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe269f7-a334-4fa1-b2a8-532ffa31778f None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:52.356858 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:52.381508 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b202375e-100a-4262-b24c-f5d8320d5b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:52.382382 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202375e-100a-4262-b24c-f5d8320d5b0a None admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:52.382658 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202375e-100a-4262-b24c-f5d8320d5b0a None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:52.382929 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202375e-100a-4262-b24c-f5d8320d5b0a None admin] PATH_INFO: `/v3/projects/c31d1c4aba0148d88e00cae45ee0c3f8/users/49c32d13e1de41c8bb1f3167d02c04f7/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:52.384875 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b202375e-100a-4262-b24c-f5d8320d5b0a None admin] RBAC: Authorizing `identity:create_grant(project_id=c31d1c4aba0148d88e00cae45ee0c3f8, user_id=49c32d13e1de41c8bb1f3167d02c04f7, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:52.386543 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b202375e-100a-4262-b24c-f5d8320d5b0a None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:52.400173 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 572/1153] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jun 20 05:59:52 2022] PUT /identity/v3/projects/c31d1c4aba0148d88e00cae45ee0c3f8/users/49c32d13e1de41c8bb1f3167d02c04f7/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:59:54.473000 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b642bff-b543-49e7-ba79-8a6360c76892 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:54.473421 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b642bff-b543-49e7-ba79-8a6360c76892 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:54.473560 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b642bff-b543-49e7-ba79-8a6360c76892 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:54.474949 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 582/1154] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:54.480596 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f9c45-2d52-4427-b9f5-c3589f7468a9 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:54.481068 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f9c45-2d52-4427-b9f5-c3589f7468a9 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:54.481175 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f9c45-2d52-4427-b9f5-c3589f7468a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:54.498248 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-7a2f9c45-2d52-4427-b9f5-c3589f7468a9 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:54.499437 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-7a2f9c45-2d52-4427-b9f5-c3589f7468a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:54.564991 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 573/1155] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:59:54.589702 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b642bff-b543-49e7-ba79-8a6360c76892 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:54.658137 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:54.688628 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b642bff-b543-49e7-ba79-8a6360c76892 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:54.721831 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ffac2f-3612-44d2-b47f-fb6356b3c1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:54.722545 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ffac2f-3612-44d2-b47f-fb6356b3c1e1 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:54.722828 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ffac2f-3612-44d2-b47f-fb6356b3c1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:54.723105 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ffac2f-3612-44d2-b47f-fb6356b3c1e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:54.734025 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ffac2f-3612-44d2-b47f-fb6356b3c1e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:59:54.741622 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-00ffac2f-3612-44d2-b47f-fb6356b3c1e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:59:54.741622 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:54.741622 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:54.741622 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:54.741622 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:54.741622 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:54.741622 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:54.741622 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:54.741622 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:54.741622 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:54.741622 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:54.741622 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:54.741622 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:59:54.741622 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:59:54.741622 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:59:54.741622 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:59:54.742778 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:59:54.742778 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:59:54.742778 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:59:54.742778 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:59:54.742778 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:54.742778 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:54.742778 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:54.742778 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:54.742778 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:54.742778 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:54.742778 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:54.742778 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:54.742778 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:54.742778 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:54.742778 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:54.742778 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:54.744091 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:54.744091 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:54.744091 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:54.744091 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:54.744091 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:59:54.744091 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:59:54.744091 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:59:54.744091 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:59:54.744091 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:59:54.744091 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:59:54.744091 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:59:54.744091 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:54.744091 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 583/1156] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jun 20 05:59:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:54.749448 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f9c45-2d52-4427-b9f5-c3589f7468a9 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:54.841245 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:54.844679 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f9c45-2d52-4427-b9f5-c3589f7468a9 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:54.880275 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da11b49d-a573-4690-8698-c3ad96bc3cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:54.880954 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11b49d-a573-4690-8698-c3ad96bc3cdd None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:54.881236 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11b49d-a573-4690-8698-c3ad96bc3cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:54.881510 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11b49d-a573-4690-8698-c3ad96bc3cdd None admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:54.882248 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da11b49d-a573-4690-8698-c3ad96bc3cdd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:54.882553 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da11b49d-a573-4690-8698-c3ad96bc3cdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:54.883918 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da11b49d-a573-4690-8698-c3ad96bc3cdd None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:54.892189 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 574/1157] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 05:59:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:54.897831 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ffac2f-3612-44d2-b47f-fb6356b3c1e1 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:54.997925 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ffac2f-3612-44d2-b47f-fb6356b3c1e1 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:55.025951 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:55.032058 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1942f5b0-aeff-4c93-8251-ad58caf82067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:55.032955 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942f5b0-aeff-4c93-8251-ad58caf82067 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:55.033238 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942f5b0-aeff-4c93-8251-ad58caf82067 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:55.033514 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942f5b0-aeff-4c93-8251-ad58caf82067 None admin] PATH_INFO: `/v3/users/49c32d13e1de41c8bb1f3167d02c04f7` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:55.034693 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1942f5b0-aeff-4c93-8251-ad58caf82067 None admin] RBAC: Authorizing `identity:get_user(user_id=49c32d13e1de41c8bb1f3167d02c04f7)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:55.036123 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1942f5b0-aeff-4c93-8251-ad58caf82067 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:55.037771 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 584/1158] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jun 20 05:59:54 2022] GET /identity/v3/users/49c32d13e1de41c8bb1f3167d02c04f7 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:55.044283 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da11b49d-a573-4690-8698-c3ad96bc3cdd None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:55.141099 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da11b49d-a573-4690-8698-c3ad96bc3cdd None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:55.173291 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45591de-fcbb-4278-ba9a-a979d6440b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:55.173926 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45591de-fcbb-4278-ba9a-a979d6440b7b None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:55.174208 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45591de-fcbb-4278-ba9a-a979d6440b7b None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:55.174486 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45591de-fcbb-4278-ba9a-a979d6440b7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:55.202355 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:55.241076 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45591de-fcbb-4278-ba9a-a979d6440b7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:55.242500 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45591de-fcbb-4278-ba9a-a979d6440b7b None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:55.336464 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 575/1159] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 05:59:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 05:59:55.343224 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1942f5b0-aeff-4c93-8251-ad58caf82067 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:55.441178 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1942f5b0-aeff-4c93-8251-ad58caf82067 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:55.475378 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8971ae2-2994-4657-a16f-5199769da173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:55.476231 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8971ae2-2994-4657-a16f-5199769da173 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:55.476513 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8971ae2-2994-4657-a16f-5199769da173 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:55.476822 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8971ae2-2994-4657-a16f-5199769da173 None admin] PATH_INFO: `/v3/projects/c31d1c4aba0148d88e00cae45ee0c3f8` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:55.477999 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8971ae2-2994-4657-a16f-5199769da173 None admin] RBAC: Authorizing `identity:get_project(project_id=c31d1c4aba0148d88e00cae45ee0c3f8)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:55.480455 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8971ae2-2994-4657-a16f-5199769da173 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:55.482189 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 585/1160] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jun 20 05:59:55 2022] GET /identity/v3/projects/c31d1c4aba0148d88e00cae45ee0c3f8 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:55.488263 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45591de-fcbb-4278-ba9a-a979d6440b7b None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:55.545158 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:55.586002 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45591de-fcbb-4278-ba9a-a979d6440b7b None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:55.619815 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6223be-5fda-4735-b8ed-3206596c0e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:55.620444 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6223be-5fda-4735-b8ed-3206596c0e19 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:55.620782 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6223be-5fda-4735-b8ed-3206596c0e19 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:55.621056 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6223be-5fda-4735-b8ed-3206596c0e19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:55.621873 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6223be-5fda-4735-b8ed-3206596c0e19 None admin] RBAC: Adding query filter params (role.id=5a64bd8372704de98e75436ff69e46b3, scope.project.id=c31d1c4aba0148d88e00cae45ee0c3f8, user.id=49c32d13e1de41c8bb1f3167d02c04f7) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:55.622182 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6223be-5fda-4735-b8ed-3206596c0e19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:55.623591 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6223be-5fda-4735-b8ed-3206596c0e19 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:55.629225 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 576/1161] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jun 20 05:59:55 2022] GET /identity/v3/role_assignments?user.id=49c32d13e1de41c8bb1f3167d02c04f7&scope.project.id=c31d1c4aba0148d88e00cae45ee0c3f8&role.id=5a64bd8372704de98e75436ff69e46b3 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:57.679533 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c091919-c2da-4a50-b761-7ef1fd6a241f None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:57.680081 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c091919-c2da-4a50-b761-7ef1fd6a241f None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:57.680081 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c091919-c2da-4a50-b761-7ef1fd6a241f None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:57.681462 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 586/1162] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 05:59:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:57.687382 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922cd29-ed53-4182-8fd1-67cfd646afbb None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:57.687838 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922cd29-ed53-4182-8fd1-67cfd646afbb None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:57.687934 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922cd29-ed53-4182-8fd1-67cfd646afbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:57.705255 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-a922cd29-ed53-4182-8fd1-67cfd646afbb None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:57.706483 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-a922cd29-ed53-4182-8fd1-67cfd646afbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:57.770911 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 577/1163] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:59:57.793214 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c091919-c2da-4a50-b761-7ef1fd6a241f None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:57.857545 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:57.891505 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c091919-c2da-4a50-b761-7ef1fd6a241f None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:57.923483 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800cca1f-79e6-4583-be8c-cdeeba8cb01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:57.924119 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800cca1f-79e6-4583-be8c-cdeeba8cb01e None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:57.924398 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800cca1f-79e6-4583-be8c-cdeeba8cb01e None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:57.924671 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800cca1f-79e6-4583-be8c-cdeeba8cb01e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:57.990484 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800cca1f-79e6-4583-be8c-cdeeba8cb01e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:57.991847 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800cca1f-79e6-4583-be8c-cdeeba8cb01e None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:58.052459 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:58.087262 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 587/1164] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 05:59:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 05:59:58.093856 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a922cd29-ed53-4182-8fd1-67cfd646afbb None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:58.147831 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:58.192937 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a922cd29-ed53-4182-8fd1-67cfd646afbb None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:58.226025 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5981bf-1510-4bc7-9759-6d4bf21b45ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:58.226809 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5981bf-1510-4bc7-9759-6d4bf21b45ea None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:58.227092 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5981bf-1510-4bc7-9759-6d4bf21b45ea None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:58.227367 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5981bf-1510-4bc7-9759-6d4bf21b45ea None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:58.234652 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5981bf-1510-4bc7-9759-6d4bf21b45ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:58.236088 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5981bf-1510-4bc7-9759-6d4bf21b45ea None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:58.250619 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-5c5981bf-1510-4bc7-9759-6d4bf21b45ea None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 20 05:59:58.250619 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:58.250619 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 20 05:59:58.250619 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 20 05:59:58.250619 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:59:58.250619 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:59:58.250619 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:59:58.250619 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:59:58.250619 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 20 05:59:58.250619 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:59:58.250619 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:59:58.250619 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:59:58.250619 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:58.250619 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:58.250619 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:58.250619 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:58.250619 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:58.251855 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:58.251855 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:58.251855 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:58.251855 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:58.251855 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:58.251855 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:58.251855 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:59:58.251855 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:59:58.251855 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:59:58.251855 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:59:58.251855 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:58.251855 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:58.251855 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:58.251855 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:58.251855 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:58.251855 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:58.252949 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:58.252949 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:58.252949 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:58.252949 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:58.252949 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:58.252949 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:58.252949 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:58.252949 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:58.252949 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:58.252949 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:58.252949 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 20 05:59:58.252949 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:59:58.252949 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 20 05:59:58.252949 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 05:59:58.252949 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 578/1165] 10.222.0.39 () {56 vars in 1117 bytes} [Mon Jun 20 05:59:58 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:58.257703 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800cca1f-79e6-4583-be8c-cdeeba8cb01e None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:58.354512 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800cca1f-79e6-4583-be8c-cdeeba8cb01e None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:58.389718 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd195691-afa2-4f28-adc9-c56caa528bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:58.390363 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd195691-afa2-4f28-adc9-c56caa528bbc None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:58.390643 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd195691-afa2-4f28-adc9-c56caa528bbc None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:58.390913 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd195691-afa2-4f28-adc9-c56caa528bbc None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:58.391620 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd195691-afa2-4f28-adc9-c56caa528bbc None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:58.391925 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd195691-afa2-4f28-adc9-c56caa528bbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:58.393309 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd195691-afa2-4f28-adc9-c56caa528bbc None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:58.400219 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 588/1166] 10.222.0.39 () {56 vars in 1115 bytes} [Mon Jun 20 05:59:58 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:00.417547 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb89231-2a4b-4a63-a0e1-04110a1150fb None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:00.418121 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb89231-2a4b-4a63-a0e1-04110a1150fb None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:00.418121 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb89231-2a4b-4a63-a0e1-04110a1150fb None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:00.419495 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 579/1167] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 06:00:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:00.424568 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1a086-a8a0-424d-8ee4-3a4183838a75 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:00.425010 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1a086-a8a0-424d-8ee4-3a4183838a75 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:00.425207 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1a086-a8a0-424d-8ee4-3a4183838a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:00.441507 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-d3a1a086-a8a0-424d-8ee4-3a4183838a75 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:00.442715 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-d3a1a086-a8a0-424d-8ee4-3a4183838a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:00.467277 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:00.509286 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 589/1168] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:00:00.533815 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb89231-2a4b-4a63-a0e1-04110a1150fb None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:00.634522 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb89231-2a4b-4a63-a0e1-04110a1150fb None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:00.648624 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:00.668812 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf36e5b-9290-443f-9f26-47bf83e1787a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:00.669403 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf36e5b-9290-443f-9f26-47bf83e1787a None admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:00.669686 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf36e5b-9290-443f-9f26-47bf83e1787a None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:00.669963 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf36e5b-9290-443f-9f26-47bf83e1787a None admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:00.670700 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf36e5b-9290-443f-9f26-47bf83e1787a None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:00.672067 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf36e5b-9290-443f-9f26-47bf83e1787a None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:00.686867 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 580/1169] 10.222.0.39 () {60 vars in 1138 bytes} [Mon Jun 20 06:00:00 2022] POST /identity/v3/domains => generated 267 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:00:02.735272 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f5177-1b94-4f3f-a5fd-665a6b81760b None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:02.735778 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f5177-1b94-4f3f-a5fd-665a6b81760b None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:02.735778 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f5177-1b94-4f3f-a5fd-665a6b81760b None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:02.737292 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 590/1170] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 06:00:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:02.742573 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150521b3-e543-4fc3-9e0e-96a59526c3f7 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:02.743013 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150521b3-e543-4fc3-9e0e-96a59526c3f7 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:02.743132 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150521b3-e543-4fc3-9e0e-96a59526c3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:02.759750 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-150521b3-e543-4fc3-9e0e-96a59526c3f7 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:02.761675 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-150521b3-e543-4fc3-9e0e-96a59526c3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:02.826144 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 581/1171] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:00:02.850178 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f5177-1b94-4f3f-a5fd-665a6b81760b None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:02.948211 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f5177-1b94-4f3f-a5fd-665a6b81760b None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:02.980173 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8e9652-8d18-46a1-b275-7a4871fc670d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:02.981044 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e9652-8d18-46a1-b275-7a4871fc670d None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:02.981324 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e9652-8d18-46a1-b275-7a4871fc670d None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:02.981593 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e9652-8d18-46a1-b275-7a4871fc670d None admin] PATH_INFO: `/v3/domains/dee1d900b2fc4e8eac2bceb4d406ee03` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:02.991654 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8e9652-8d18-46a1-b275-7a4871fc670d None admin] RBAC: Authorizing `identity:get_domain(domain_id=dee1d900b2fc4e8eac2bceb4d406ee03)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:02.993065 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8e9652-8d18-46a1-b275-7a4871fc670d None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:02.995336 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 591/1172] 10.222.0.39 () {56 vars in 1183 bytes} [Mon Jun 20 06:00:02 2022] GET /identity/v3/domains/dee1d900b2fc4e8eac2bceb4d406ee03 => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:03.001093 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150521b3-e543-4fc3-9e0e-96a59526c3f7 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:03.106869 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150521b3-e543-4fc3-9e0e-96a59526c3f7 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:03.109169 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:03.142556 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff6b2d-5d1b-4e67-9dfc-045f00fa4b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:03.143217 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff6b2d-5d1b-4e67-9dfc-045f00fa4b68 None admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:03.143503 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff6b2d-5d1b-4e67-9dfc-045f00fa4b68 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:03.143779 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff6b2d-5d1b-4e67-9dfc-045f00fa4b68 None admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:03.144488 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ff6b2d-5d1b-4e67-9dfc-045f00fa4b68 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:03.145951 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ff6b2d-5d1b-4e67-9dfc-045f00fa4b68 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:03.169741 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 582/1173] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Jun 20 06:00:03 2022] POST /identity/v3/projects => generated 361 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:00:05.205787 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17a269-fed4-4634-af50-f983616db73e None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:05.206325 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17a269-fed4-4634-af50-f983616db73e None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:05.206325 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17a269-fed4-4634-af50-f983616db73e None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:05.207695 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 592/1174] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 06:00:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:05.212761 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0dc95-dc73-4bba-895a-92f412956efc None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:05.213188 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0dc95-dc73-4bba-895a-92f412956efc None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:05.213300 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0dc95-dc73-4bba-895a-92f412956efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:05.230498 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-89d0dc95-dc73-4bba-895a-92f412956efc None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:05.231665 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-89d0dc95-dc73-4bba-895a-92f412956efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:05.296451 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 583/1175] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:00:05.322742 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17a269-fed4-4634-af50-f983616db73e None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:05.344367 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:05.421554 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17a269-fed4-4634-af50-f983616db73e None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:05.457282 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d1725-fbdb-46af-9df0-7884bc50c10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:05.458080 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d1725-fbdb-46af-9df0-7884bc50c10b None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:05.458359 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d1725-fbdb-46af-9df0-7884bc50c10b None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:05.458631 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d1725-fbdb-46af-9df0-7884bc50c10b None admin] PATH_INFO: `/v3/domains/dee1d900b2fc4e8eac2bceb4d406ee03` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:05.459799 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24d1725-fbdb-46af-9df0-7884bc50c10b None admin] RBAC: Authorizing `identity:get_domain(domain_id=dee1d900b2fc4e8eac2bceb4d406ee03)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:05.461259 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24d1725-fbdb-46af-9df0-7884bc50c10b None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:05.462904 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 593/1176] 10.222.0.39 () {56 vars in 1183 bytes} [Mon Jun 20 06:00:05 2022] GET /identity/v3/domains/dee1d900b2fc4e8eac2bceb4d406ee03 => generated 267 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:00:05.468739 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0dc95-dc73-4bba-895a-92f412956efc None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:05.550796 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:05.566940 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0dc95-dc73-4bba-895a-92f412956efc None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:05.600063 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3bd0f4-0610-48d3-90f1-eb523dc13c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:05.600742 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3bd0f4-0610-48d3-90f1-eb523dc13c13 None admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:05.601037 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3bd0f4-0610-48d3-90f1-eb523dc13c13 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:05.601315 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3bd0f4-0610-48d3-90f1-eb523dc13c13 None admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:05.602028 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3bd0f4-0610-48d3-90f1-eb523dc13c13 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:05.604032 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3bd0f4-0610-48d3-90f1-eb523dc13c13 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:05.623589 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 584/1177] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Jun 20 06:00:05 2022] POST /identity/v3/users => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:00:07.732737 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd505f7-4843-432a-aac2-eba5dc06c08a None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:07.733225 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd505f7-4843-432a-aac2-eba5dc06c08a None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:07.733225 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd505f7-4843-432a-aac2-eba5dc06c08a None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:07.734579 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 594/1178] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 06:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:07.739796 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5a571-dd1e-44a4-bded-b2f3f6f6c187 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:07.740185 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5a571-dd1e-44a4-bded-b2f3f6f6c187 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:07.740346 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5a571-dd1e-44a4-bded-b2f3f6f6c187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:07.757873 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-11c5a571-dd1e-44a4-bded-b2f3f6f6c187 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:07.759057 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-11c5a571-dd1e-44a4-bded-b2f3f6f6c187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:07.824355 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 585/1179] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:00:07.847761 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd505f7-4843-432a-aac2-eba5dc06c08a None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:07.936348 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:07.949609 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd505f7-4843-432a-aac2-eba5dc06c08a None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:07.982611 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e3687c-c7d7-4792-a405-1cdf47a88e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:07.983441 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3687c-c7d7-4792-a405-1cdf47a88e09 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:07.983673 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3687c-c7d7-4792-a405-1cdf47a88e09 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:07.983947 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3687c-c7d7-4792-a405-1cdf47a88e09 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:07.995188 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e3687c-c7d7-4792-a405-1cdf47a88e09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:00:08.002776 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-23e3687c-c7d7-4792-a405-1cdf47a88e09 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:00:08.002776 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:08.002776 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:08.002776 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:08.002776 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:08.002776 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:08.002776 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:08.002776 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:08.002776 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:08.002776 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:08.002776 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:08.002776 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:08.002776 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:00:08.002776 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:00:08.002776 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:00:08.002776 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:00:08.003923 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:00:08.003923 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:00:08.003923 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:00:08.003923 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:00:08.003923 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:08.003923 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:08.003923 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:08.003923 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:08.003923 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:08.003923 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:08.003923 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:08.003923 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:08.003923 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:08.003923 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:08.003923 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:08.003923 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:08.005191 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:08.005191 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:08.005191 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:08.005191 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:08.005191 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:00:08.005191 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:00:08.005191 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:00:08.005191 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:00:08.005191 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:00:08.005191 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:00:08.005191 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:00:08.005191 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:08.005191 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 595/1180] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jun 20 06:00:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:08.009988 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c5a571-dd1e-44a4-bded-b2f3f6f6c187 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:08.082829 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:08.114289 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c5a571-dd1e-44a4-bded-b2f3f6f6c187 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:08.146725 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc46e6-52a1-48a6-97a2-e3e1644e5fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:08.147384 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc46e6-52a1-48a6-97a2-e3e1644e5fc4 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:08.147668 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc46e6-52a1-48a6-97a2-e3e1644e5fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:08.147946 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc46e6-52a1-48a6-97a2-e3e1644e5fc4 None admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:08.148714 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fc46e6-52a1-48a6-97a2-e3e1644e5fc4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:08.149029 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fc46e6-52a1-48a6-97a2-e3e1644e5fc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:08.151028 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fc46e6-52a1-48a6-97a2-e3e1644e5fc4 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:08.158976 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 586/1181] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 06:00:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:00:08.164764 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e3687c-c7d7-4792-a405-1cdf47a88e09 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:08.262570 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e3687c-c7d7-4792-a405-1cdf47a88e09 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:08.295587 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdfd1a1-590b-4104-91bf-bcdbf7243135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:08.296432 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfd1a1-590b-4104-91bf-bcdbf7243135 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:08.296726 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfd1a1-590b-4104-91bf-bcdbf7243135 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:08.297007 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfd1a1-590b-4104-91bf-bcdbf7243135 None admin] PATH_INFO: `/v3/users/8d914622120f423ea8e22d1a8d7948fb` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:08.309712 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdfd1a1-590b-4104-91bf-bcdbf7243135 None admin] RBAC: Authorizing `identity:get_user(user_id=8d914622120f423ea8e22d1a8d7948fb)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:08.311142 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdfd1a1-590b-4104-91bf-bcdbf7243135 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:08.312787 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 596/1182] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jun 20 06:00:08 2022] GET /identity/v3/users/8d914622120f423ea8e22d1a8d7948fb => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:08.318616 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc46e6-52a1-48a6-97a2-e3e1644e5fc4 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:08.425059 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc46e6-52a1-48a6-97a2-e3e1644e5fc4 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:08.458659 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a3d711-3c8c-4f43-b49f-b62334cdebeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:08.459314 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3d711-3c8c-4f43-b49f-b62334cdebeb None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:08.459596 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3d711-3c8c-4f43-b49f-b62334cdebeb None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:08.459874 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3d711-3c8c-4f43-b49f-b62334cdebeb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:08.463762 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:08.528030 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a3d711-3c8c-4f43-b49f-b62334cdebeb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:08.529432 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a3d711-3c8c-4f43-b49f-b62334cdebeb None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:08.625941 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 587/1183] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 06:00:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 06:00:08.632323 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdfd1a1-590b-4104-91bf-bcdbf7243135 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:08.640971 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:08.730189 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdfd1a1-590b-4104-91bf-bcdbf7243135 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:08.763395 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e7a62-56ac-445e-8490-e943768ed7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:08.764278 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e7a62-56ac-445e-8490-e943768ed7b4 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:08.764560 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e7a62-56ac-445e-8490-e943768ed7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:08.764867 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e7a62-56ac-445e-8490-e943768ed7b4 None admin] PATH_INFO: `/v3/projects/2df86162ccf14da182ef7f74df53edc6` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:08.766042 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e7a62-56ac-445e-8490-e943768ed7b4 None admin] RBAC: Authorizing `identity:get_project(project_id=2df86162ccf14da182ef7f74df53edc6)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:08.767465 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e7a62-56ac-445e-8490-e943768ed7b4 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:08.769192 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 597/1184] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jun 20 06:00:08 2022] GET /identity/v3/projects/2df86162ccf14da182ef7f74df53edc6 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:08.775536 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a3d711-3c8c-4f43-b49f-b62334cdebeb None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:08.809735 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:08.875526 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a3d711-3c8c-4f43-b49f-b62334cdebeb None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:08.908931 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae56d1b1-fc27-48f0-b4a2-18fc97c7648c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:08.909583 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56d1b1-fc27-48f0-b4a2-18fc97c7648c None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:08.909867 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56d1b1-fc27-48f0-b4a2-18fc97c7648c None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:08.910143 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56d1b1-fc27-48f0-b4a2-18fc97c7648c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:08.910975 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae56d1b1-fc27-48f0-b4a2-18fc97c7648c None admin] RBAC: Adding query filter params (role.id=5a64bd8372704de98e75436ff69e46b3, scope.project.id=2df86162ccf14da182ef7f74df53edc6, user.id=8d914622120f423ea8e22d1a8d7948fb) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:08.911290 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae56d1b1-fc27-48f0-b4a2-18fc97c7648c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:08.912727 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae56d1b1-fc27-48f0-b4a2-18fc97c7648c None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:08.918608 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 588/1185] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jun 20 06:00:08 2022] GET /identity/v3/role_assignments?user.id=8d914622120f423ea8e22d1a8d7948fb&scope.project.id=2df86162ccf14da182ef7f74df53edc6&role.id=5a64bd8372704de98e75436ff69e46b3 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:10.926406 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52bac96-0b6b-4b9b-9b10-585736e88907 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:10.926932 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52bac96-0b6b-4b9b-9b10-585736e88907 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:10.926932 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52bac96-0b6b-4b9b-9b10-585736e88907 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:10.928244 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 598/1186] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 06:00:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:10.934321 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12c54c-92a9-439c-985d-2d3e3c4a8c9d None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:10.934772 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12c54c-92a9-439c-985d-2d3e3c4a8c9d None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:10.934866 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12c54c-92a9-439c-985d-2d3e3c4a8c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:10.951881 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-7f12c54c-92a9-439c-985d-2d3e3c4a8c9d None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:10.953097 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-7f12c54c-92a9-439c-985d-2d3e3c4a8c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:11.018386 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 589/1187] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:00:11.041304 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52bac96-0b6b-4b9b-9b10-585736e88907 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:11.115279 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:11.140457 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52bac96-0b6b-4b9b-9b10-585736e88907 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:11.173506 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0358f-f989-48f9-8907-78d389f73dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:11.174276 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0358f-f989-48f9-8907-78d389f73dd2 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:11.174560 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0358f-f989-48f9-8907-78d389f73dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:11.174836 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0358f-f989-48f9-8907-78d389f73dd2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:11.185568 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da0358f-f989-48f9-8907-78d389f73dd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:00:11.193138 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-0da0358f-f989-48f9-8907-78d389f73dd2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:00:11.193138 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:11.193138 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:11.193138 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:11.193138 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:11.193138 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:11.193138 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:11.193138 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:11.193138 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:11.193138 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:11.193138 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:11.193138 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:11.193138 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:00:11.193138 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:00:11.193138 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:00:11.193138 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:00:11.194243 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:00:11.194243 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:00:11.194243 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:00:11.194243 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:00:11.194243 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:11.194243 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:11.194243 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:11.194243 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:11.194243 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:11.194243 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:11.194243 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:11.194243 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:11.194243 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:11.194243 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:11.194243 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:11.194243 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:11.195454 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:11.195454 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:11.195454 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:11.195454 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:11.195454 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:00:11.195454 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:00:11.195454 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:00:11.195454 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:00:11.195454 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:00:11.195454 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:00:11.195454 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:00:11.195454 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:11.195454 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 599/1188] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jun 20 06:00:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:11.201400 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12c54c-92a9-439c-985d-2d3e3c4a8c9d None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:11.228873 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:11.299494 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12c54c-92a9-439c-985d-2d3e3c4a8c9d None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:11.334083 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e26e8a-3203-49da-b865-612857ed1a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:11.334738 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e26e8a-3203-49da-b865-612857ed1a12 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:11.335021 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e26e8a-3203-49da-b865-612857ed1a12 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:11.335295 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e26e8a-3203-49da-b865-612857ed1a12 None admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:11.336033 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e26e8a-3203-49da-b865-612857ed1a12 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:11.336340 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e26e8a-3203-49da-b865-612857ed1a12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:11.338318 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e26e8a-3203-49da-b865-612857ed1a12 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:11.346154 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 590/1189] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 06:00:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:11.351781 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0358f-f989-48f9-8907-78d389f73dd2 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:11.449023 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0358f-f989-48f9-8907-78d389f73dd2 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:11.482015 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb0f79-b765-4ab9-bc65-e0ca5071ae36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:11.482865 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb0f79-b765-4ab9-bc65-e0ca5071ae36 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:11.483141 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb0f79-b765-4ab9-bc65-e0ca5071ae36 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:11.483412 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb0f79-b765-4ab9-bc65-e0ca5071ae36 None admin] PATH_INFO: `/v3/users/8d914622120f423ea8e22d1a8d7948fb` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:11.484577 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fb0f79-b765-4ab9-bc65-e0ca5071ae36 None admin] RBAC: Authorizing `identity:get_user(user_id=8d914622120f423ea8e22d1a8d7948fb)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:11.486016 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fb0f79-b765-4ab9-bc65-e0ca5071ae36 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:11.487626 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 600/1190] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jun 20 06:00:11 2022] GET /identity/v3/users/8d914622120f423ea8e22d1a8d7948fb => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:11.493263 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e26e8a-3203-49da-b865-612857ed1a12 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:11.581090 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:11.591183 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e26e8a-3203-49da-b865-612857ed1a12 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:11.624278 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15315549-e0ea-4a51-88f7-207c0eea9fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:11.625139 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15315549-e0ea-4a51-88f7-207c0eea9fd9 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:11.625419 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15315549-e0ea-4a51-88f7-207c0eea9fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:11.625692 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15315549-e0ea-4a51-88f7-207c0eea9fd9 None admin] PATH_INFO: `/v3/projects/2df86162ccf14da182ef7f74df53edc6` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:11.626850 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15315549-e0ea-4a51-88f7-207c0eea9fd9 None admin] RBAC: Authorizing `identity:get_project(project_id=2df86162ccf14da182ef7f74df53edc6)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:11.628262 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15315549-e0ea-4a51-88f7-207c0eea9fd9 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:11.629958 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 591/1191] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jun 20 06:00:11 2022] GET /identity/v3/projects/2df86162ccf14da182ef7f74df53edc6 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:11.636329 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb0f79-b765-4ab9-bc65-e0ca5071ae36 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:11.639190 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:11.734068 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb0f79-b765-4ab9-bc65-e0ca5071ae36 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:11.767990 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c472b8-cfb9-4c0e-8ff4-74d296742a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:11.768894 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c472b8-cfb9-4c0e-8ff4-74d296742a40 None admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:11.769176 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c472b8-cfb9-4c0e-8ff4-74d296742a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:11.769447 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c472b8-cfb9-4c0e-8ff4-74d296742a40 None admin] PATH_INFO: `/v3/projects/2df86162ccf14da182ef7f74df53edc6/users/8d914622120f423ea8e22d1a8d7948fb/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:11.771363 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c472b8-cfb9-4c0e-8ff4-74d296742a40 None admin] RBAC: Authorizing `identity:create_grant(project_id=2df86162ccf14da182ef7f74df53edc6, user_id=8d914622120f423ea8e22d1a8d7948fb, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:11.772802 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c472b8-cfb9-4c0e-8ff4-74d296742a40 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:11.785437 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 601/1192] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jun 20 06:00:11 2022] PUT /identity/v3/projects/2df86162ccf14da182ef7f74df53edc6/users/8d914622120f423ea8e22d1a8d7948fb/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:00:13.766749 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d87381-c08c-4a03-93d1-f2ced95cf04b None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:13.767586 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d87381-c08c-4a03-93d1-f2ced95cf04b None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:13.767869 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d87381-c08c-4a03-93d1-f2ced95cf04b None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:13.769317 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 592/1193] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 06:00:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:13.774514 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e879a12-4212-4069-8545-ce2451f9ae0f None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:13.775419 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e879a12-4212-4069-8545-ce2451f9ae0f None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:13.775662 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e879a12-4212-4069-8545-ce2451f9ae0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:13.791850 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-4e879a12-4212-4069-8545-ce2451f9ae0f None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:13.793063 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-4e879a12-4212-4069-8545-ce2451f9ae0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:13.848018 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:13.859460 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 602/1194] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:00:13.882869 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d87381-c08c-4a03-93d1-f2ced95cf04b None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:13.981852 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d87381-c08c-4a03-93d1-f2ced95cf04b None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:14.014684 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40770692-4073-4882-9844-cd7f7ecb3730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:14.015457 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40770692-4073-4882-9844-cd7f7ecb3730 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:14.015740 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40770692-4073-4882-9844-cd7f7ecb3730 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:14.016016 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40770692-4073-4882-9844-cd7f7ecb3730 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:14.026451 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40770692-4073-4882-9844-cd7f7ecb3730 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:00:14.033918 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-40770692-4073-4882-9844-cd7f7ecb3730 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:00:14.033918 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:14.033918 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:14.033918 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:14.033918 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:14.033918 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:14.033918 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:14.033918 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:14.033918 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:14.033918 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:14.033918 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:14.033918 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:14.033918 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:00:14.033918 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:00:14.033918 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:00:14.033918 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:00:14.034983 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:00:14.034983 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:00:14.034983 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:00:14.034983 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:00:14.034983 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:14.034983 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:14.034983 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:14.034983 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:14.034983 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:14.034983 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:14.034983 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:14.034983 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:14.034983 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:14.034983 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:14.034983 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:14.034983 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:14.035846 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:14.035846 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:14.035846 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:14.035846 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:14.035846 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:00:14.035846 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:00:14.035846 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:00:14.035846 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:00:14.035846 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:00:14.035846 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:00:14.035846 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:00:14.035846 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 06:00:14.035846 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 593/1195] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jun 20 06:00:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:14.041009 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e879a12-4212-4069-8545-ce2451f9ae0f None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:14.135484 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e879a12-4212-4069-8545-ce2451f9ae0f None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:14.167175 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcdf82b-1206-4def-976a-d5f77a53c870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:14.167832 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcdf82b-1206-4def-976a-d5f77a53c870 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:14.168112 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcdf82b-1206-4def-976a-d5f77a53c870 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:14.168382 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcdf82b-1206-4def-976a-d5f77a53c870 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:14.169147 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcdf82b-1206-4def-976a-d5f77a53c870 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:14.169454 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcdf82b-1206-4def-976a-d5f77a53c870 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:14.170791 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcdf82b-1206-4def-976a-d5f77a53c870 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:14.178505 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 603/1196] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 06:00:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:14.185057 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40770692-4073-4882-9844-cd7f7ecb3730 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:14.206291 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:14.285296 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40770692-4073-4882-9844-cd7f7ecb3730 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:14.317120 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec219285-1004-43be-baa3-091c8587d2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:14.317960 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec219285-1004-43be-baa3-091c8587d2a5 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:14.318235 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec219285-1004-43be-baa3-091c8587d2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:14.318502 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec219285-1004-43be-baa3-091c8587d2a5 None admin] PATH_INFO: `/v3/users/8d914622120f423ea8e22d1a8d7948fb` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:14.319662 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec219285-1004-43be-baa3-091c8587d2a5 None admin] RBAC: Authorizing `identity:get_user(user_id=8d914622120f423ea8e22d1a8d7948fb)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:14.321962 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec219285-1004-43be-baa3-091c8587d2a5 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:14.323569 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 594/1197] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jun 20 06:00:14 2022] GET /identity/v3/users/8d914622120f423ea8e22d1a8d7948fb => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:14.329246 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcdf82b-1206-4def-976a-d5f77a53c870 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:14.382208 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:14.425552 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcdf82b-1206-4def-976a-d5f77a53c870 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:14.459091 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b91b0d-6172-4fb6-99d0-de5512b840c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:14.459738 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b91b0d-6172-4fb6-99d0-de5512b840c0 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:14.460019 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b91b0d-6172-4fb6-99d0-de5512b840c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:14.460294 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b91b0d-6172-4fb6-99d0-de5512b840c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:14.525661 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b91b0d-6172-4fb6-99d0-de5512b840c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:14.527101 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b91b0d-6172-4fb6-99d0-de5512b840c0 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:14.578773 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:14.623421 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 604/1198] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 06:00:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 06:00:14.629215 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec219285-1004-43be-baa3-091c8587d2a5 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:14.711383 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:14.726127 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec219285-1004-43be-baa3-091c8587d2a5 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:14.762929 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceba406d-9bff-4eae-8750-5e1e0b4e622d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:14.764297 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba406d-9bff-4eae-8750-5e1e0b4e622d None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:14.764587 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba406d-9bff-4eae-8750-5e1e0b4e622d None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:14.764914 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba406d-9bff-4eae-8750-5e1e0b4e622d None admin] PATH_INFO: `/v3/projects/2df86162ccf14da182ef7f74df53edc6` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:14.766084 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceba406d-9bff-4eae-8750-5e1e0b4e622d None admin] RBAC: Authorizing `identity:get_project(project_id=2df86162ccf14da182ef7f74df53edc6)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:14.767556 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceba406d-9bff-4eae-8750-5e1e0b4e622d None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:14.769299 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 595/1199] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jun 20 06:00:14 2022] GET /identity/v3/projects/2df86162ccf14da182ef7f74df53edc6 => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:14.775723 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b91b0d-6172-4fb6-99d0-de5512b840c0 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:14.873883 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b91b0d-6172-4fb6-99d0-de5512b840c0 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:14.906321 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba804478-862a-4048-8676-214e5da8dafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:14.906967 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba804478-862a-4048-8676-214e5da8dafd None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:14.907243 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba804478-862a-4048-8676-214e5da8dafd None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:14.907514 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba804478-862a-4048-8676-214e5da8dafd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:14.908325 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba804478-862a-4048-8676-214e5da8dafd None admin] RBAC: Adding query filter params (role.id=5a64bd8372704de98e75436ff69e46b3, scope.project.id=2df86162ccf14da182ef7f74df53edc6, user.id=8d914622120f423ea8e22d1a8d7948fb) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:14.908631 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba804478-862a-4048-8676-214e5da8dafd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:14.910086 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba804478-862a-4048-8676-214e5da8dafd None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:14.916311 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 605/1200] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jun 20 06:00:14 2022] GET /identity/v3/role_assignments?user.id=8d914622120f423ea8e22d1a8d7948fb&scope.project.id=2df86162ccf14da182ef7f74df53edc6&role.id=5a64bd8372704de98e75436ff69e46b3 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:24.757404 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=23 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:24.913138 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=91 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:10.030219 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d3919-bc34-4782-b87c-9031c705c590 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:10.030219 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d3919-bc34-4782-b87c-9031c705c590 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:10.030219 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d3919-bc34-4782-b87c-9031c705c590 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:10.031293 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 596/1201] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 06:01:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:10.037496 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94950190-76a0-4049-bf61-48a1ae3ae480 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:10.038290 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94950190-76a0-4049-bf61-48a1ae3ae480 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:10.038738 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94950190-76a0-4049-bf61-48a1ae3ae480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:10.057102 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-94950190-76a0-4049-bf61-48a1ae3ae480 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:10.058300 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-94950190-76a0-4049-bf61-48a1ae3ae480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:10.149155 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 606/1202] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:01:10.175041 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d3919-bc34-4782-b87c-9031c705c590 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:10.326763 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d3919-bc34-4782-b87c-9031c705c590 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:10.372102 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e508b0dc-4c5d-42d4-a0d9-66136f2ee155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:10.372922 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508b0dc-4c5d-42d4-a0d9-66136f2ee155 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:10.373204 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508b0dc-4c5d-42d4-a0d9-66136f2ee155 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:10.373482 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508b0dc-4c5d-42d4-a0d9-66136f2ee155 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:10.386499 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e508b0dc-4c5d-42d4-a0d9-66136f2ee155 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:10.388206 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e508b0dc-4c5d-42d4-a0d9-66136f2ee155 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:10.416741 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-e508b0dc-4c5d-42d4-a0d9-66136f2ee155 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:10.416741 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:10.416741 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:10.416741 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:10.416741 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:10.416741 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:10.416741 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:10.416741 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:10.416741 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:10.416741 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:10.416741 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:10.416741 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:10.416741 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:01:10.416741 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:01:10.416741 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:01:10.417771 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:01:10.417771 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:10.417771 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:10.417771 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:10.417771 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:10.417771 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:10.417771 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:10.417771 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:10.417771 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:10.417771 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:10.417771 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:10.417771 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:10.417771 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:10.417771 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:10.417771 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:10.417771 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:10.417771 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:10.418759 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:01:10.418759 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:01:10.418759 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:10.418759 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 06:01:10.418759 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 597/1203] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:10.419505 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94950190-76a0-4049-bf61-48a1ae3ae480 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:10.552598 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94950190-76a0-4049-bf61-48a1ae3ae480 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:10.601742 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:10.610983 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f9479-bace-41f7-b4ba-06f503c2611e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:10.611666 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f9479-bace-41f7-b4ba-06f503c2611e None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:10.611945 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f9479-bace-41f7-b4ba-06f503c2611e None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:10.612220 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f9479-bace-41f7-b4ba-06f503c2611e None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:10.612999 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2f9479-bace-41f7-b4ba-06f503c2611e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:10.613307 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2f9479-bace-41f7-b4ba-06f503c2611e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:10.614835 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2f9479-bace-41f7-b4ba-06f503c2611e None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:10.633103 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 607/1204] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 06:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:10.637505 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e508b0dc-4c5d-42d4-a0d9-66136f2ee155 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:10.709509 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:10.772842 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e508b0dc-4c5d-42d4-a0d9-66136f2ee155 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:10.822838 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f3fbfc-df01-498f-b4bf-fcc782982921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:10.823488 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3fbfc-df01-498f-b4bf-fcc782982921 None admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:10.823763 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3fbfc-df01-498f-b4bf-fcc782982921 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:10.824037 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3fbfc-df01-498f-b4bf-fcc782982921 None admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:10.824792 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f3fbfc-df01-498f-b4bf-fcc782982921 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:10.826216 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f3fbfc-df01-498f-b4bf-fcc782982921 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:10.848601 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 598/1205] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Jun 20 06:01:10 2022] POST /identity/v3/users => generated 251 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:01:13.068500 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1c12a-9287-4257-9ea7-3a5833898e8a None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:13.069288 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1c12a-9287-4257-9ea7-3a5833898e8a None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:13.069288 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1c12a-9287-4257-9ea7-3a5833898e8a None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:13.070467 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 608/1206] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 06:01:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:13.076341 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae536248-97d3-41da-9b25-2f5e5687294a None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:13.076795 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae536248-97d3-41da-9b25-2f5e5687294a None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:13.076931 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae536248-97d3-41da-9b25-2f5e5687294a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:13.093753 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-ae536248-97d3-41da-9b25-2f5e5687294a None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:13.094929 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-ae536248-97d3-41da-9b25-2f5e5687294a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:13.174320 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 599/1207] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:01:13.199390 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d1c12a-9287-4257-9ea7-3a5833898e8a None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:13.321669 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d1c12a-9287-4257-9ea7-3a5833898e8a None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:13.374970 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497e5fb-fd33-45d0-af86-ef246e4502b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:13.375759 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497e5fb-fd33-45d0-af86-ef246e4502b6 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:13.376043 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497e5fb-fd33-45d0-af86-ef246e4502b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:13.376321 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497e5fb-fd33-45d0-af86-ef246e4502b6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:13.400796 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a497e5fb-fd33-45d0-af86-ef246e4502b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:01:13.408647 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-a497e5fb-fd33-45d0-af86-ef246e4502b6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 06:01:13.408647 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:13.408647 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:13.408647 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:13.408647 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:13.408647 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:13.408647 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:13.408647 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:13.408647 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:13.408647 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:13.408647 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:13.408647 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:13.408647 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:01:13.408647 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:01:13.408647 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:01:13.408647 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:01:13.409808 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:01:13.409808 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:01:13.409808 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:01:13.409808 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:01:13.409808 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:13.409808 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:13.409808 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:13.409808 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:13.409808 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:13.409808 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:13.409808 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:13.409808 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:13.409808 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:13.409808 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:13.409808 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:13.409808 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:13.411037 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:13.411037 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:13.411037 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:13.411037 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:13.411037 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:01:13.411037 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:01:13.411037 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:01:13.411037 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:01:13.411037 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:01:13.411037 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:01:13.411037 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 06:01:13.411037 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:13.411037 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 609/1208] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jun 20 06:01:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 06:01:13.416214 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae536248-97d3-41da-9b25-2f5e5687294a None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:13.473261 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:13.559531 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae536248-97d3-41da-9b25-2f5e5687294a None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:13.601891 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2629c77-ba57-48a2-836e-78ccf3c9b36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:13.602479 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2629c77-ba57-48a2-836e-78ccf3c9b36b None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:13.602765 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2629c77-ba57-48a2-836e-78ccf3c9b36b None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:13.603072 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2629c77-ba57-48a2-836e-78ccf3c9b36b None admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:13.603787 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2629c77-ba57-48a2-836e-78ccf3c9b36b None admin] RBAC: Adding query filter params (name=service) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:13.604089 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2629c77-ba57-48a2-836e-78ccf3c9b36b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:13.605490 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2629c77-ba57-48a2-836e-78ccf3c9b36b None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:13.618847 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 600/1209] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jun 20 06:01:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:13.620136 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497e5fb-fd33-45d0-af86-ef246e4502b6 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:13.685547 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:13.747859 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497e5fb-fd33-45d0-af86-ef246e4502b6 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:13.787787 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb804811-eb35-4b86-884f-4e3e2c7bb099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:13.788875 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb804811-eb35-4b86-884f-4e3e2c7bb099 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:13.789306 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb804811-eb35-4b86-884f-4e3e2c7bb099 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:13.789740 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb804811-eb35-4b86-884f-4e3e2c7bb099 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:13.800531 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb804811-eb35-4b86-884f-4e3e2c7bb099 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:13.802368 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb804811-eb35-4b86-884f-4e3e2c7bb099 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:13.821504 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-cb804811-eb35-4b86-884f-4e3e2c7bb099 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:13.821504 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:13.821504 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:13.821504 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:13.821504 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:13.821504 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:13.821504 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:13.821504 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:13.821504 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:13.821504 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:13.821504 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:13.821504 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:13.821504 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:01:13.821504 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:01:13.821504 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:01:13.823146 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:01:13.823146 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:13.823146 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:13.823146 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:13.823146 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:13.823146 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:13.823146 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:13.823146 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:13.823146 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:13.823146 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:13.823146 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:13.823146 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:13.823146 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:13.823146 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:13.823146 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:13.823146 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:13.823146 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:13.824372 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:01:13.824372 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:01:13.824372 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:13.824372 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:13.824372 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 610/1210] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:13.828344 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2629c77-ba57-48a2-836e-78ccf3c9b36b None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:13.933048 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2629c77-ba57-48a2-836e-78ccf3c9b36b None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:13.934703 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:13.973596 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac041fa-1d66-4bad-bc35-8976b565ffcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:13.974267 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac041fa-1d66-4bad-bc35-8976b565ffcb None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:13.974553 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac041fa-1d66-4bad-bc35-8976b565ffcb None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:13.974826 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac041fa-1d66-4bad-bc35-8976b565ffcb None admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:13.975549 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac041fa-1d66-4bad-bc35-8976b565ffcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:13.975855 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac041fa-1d66-4bad-bc35-8976b565ffcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:13.977256 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac041fa-1d66-4bad-bc35-8976b565ffcb None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:13.989613 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 601/1211] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 06:01:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:13.995416 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb804811-eb35-4b86-884f-4e3e2c7bb099 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:14.115243 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb804811-eb35-4b86-884f-4e3e2c7bb099 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:14.117147 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:14.155614 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e01cca-e5f0-44eb-932e-7c28e57c9156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:14.156490 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e01cca-e5f0-44eb-932e-7c28e57c9156 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:14.156799 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e01cca-e5f0-44eb-932e-7c28e57c9156 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:14.157072 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e01cca-e5f0-44eb-932e-7c28e57c9156 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:14.165054 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e01cca-e5f0-44eb-932e-7c28e57c9156 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:14.166700 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e01cca-e5f0-44eb-932e-7c28e57c9156 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:14.184254 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-29e01cca-e5f0-44eb-932e-7c28e57c9156 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 20 06:01:14.184254 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:14.184254 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:14.184254 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:14.184254 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:14.184254 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:14.184254 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:14.184254 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:14.184254 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:14.184254 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:14.184254 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:14.184254 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:14.184254 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 06:01:14.184254 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 06:01:14.184254 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 06:01:14.184254 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 06:01:14.185669 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:14.185669 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:14.185669 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 06:01:14.185669 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:01:14.185669 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 06:01:14.185669 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:01:14.185669 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:14.185669 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:14.185669 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:14.185669 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:14.185669 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:14.185669 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:14.185669 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:14.185669 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:14.185669 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:14.185669 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:14.185669 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:14.185669 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:14.186635 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:14.186635 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:14.186635 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 06:01:14.186635 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 06:01:14.186635 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 06:01:14.186635 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 06:01:14.186635 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 06:01:14.186635 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 06:01:14.186635 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 20 06:01:14.186635 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:14.186635 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 611/1212] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:14.192230 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac041fa-1d66-4bad-bc35-8976b565ffcb None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:14.322351 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac041fa-1d66-4bad-bc35-8976b565ffcb None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:14.360607 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef599ae-3a58-4ad4-aa0b-9f086af3b28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:14.361317 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef599ae-3a58-4ad4-aa0b-9f086af3b28d None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:14.361607 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef599ae-3a58-4ad4-aa0b-9f086af3b28d None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:14.361884 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef599ae-3a58-4ad4-aa0b-9f086af3b28d None admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:14.362737 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef599ae-3a58-4ad4-aa0b-9f086af3b28d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:14.363575 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef599ae-3a58-4ad4-aa0b-9f086af3b28d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:14.365748 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef599ae-3a58-4ad4-aa0b-9f086af3b28d None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:14.385348 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 602/1213] 10.222.0.39 () {56 vars in 1143 bytes} [Mon Jun 20 06:01:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:14.391008 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e01cca-e5f0-44eb-932e-7c28e57c9156 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:14.521291 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e01cca-e5f0-44eb-932e-7c28e57c9156 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:14.571390 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d772f-e7ef-4f52-bd24-af6dec984d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:14.571390 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d772f-e7ef-4f52-bd24-af6dec984d65 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:14.571390 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d772f-e7ef-4f52-bd24-af6dec984d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:14.571390 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d772f-e7ef-4f52-bd24-af6dec984d65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:14.620021 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:14.662417 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d772f-e7ef-4f52-bd24-af6dec984d65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:14.663953 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d772f-e7ef-4f52-bd24-af6dec984d65 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:14.789290 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 612/1214] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 06:01:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 06:01:14.790718 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef599ae-3a58-4ad4-aa0b-9f086af3b28d None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:14.813439 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:14.902770 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef599ae-3a58-4ad4-aa0b-9f086af3b28d None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:14.942360 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe67086-1a74-4ad6-b97a-a34d17905ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:14.943380 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe67086-1a74-4ad6-b97a-a34d17905ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:14.943761 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe67086-1a74-4ad6-b97a-a34d17905ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:14.944129 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe67086-1a74-4ad6-b97a-a34d17905ca5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:14.954729 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe67086-1a74-4ad6-b97a-a34d17905ca5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:14.956294 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe67086-1a74-4ad6-b97a-a34d17905ca5 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:14.974548 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-bbe67086-1a74-4ad6-b97a-a34d17905ca5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:14.974548 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:14.974548 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:14.974548 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:14.974548 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:14.974548 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:14.974548 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:14.974548 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:14.974548 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:14.974548 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:14.974548 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:14.974548 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:14.974548 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:01:14.974548 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:01:14.974548 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:01:14.975634 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:01:14.975634 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:14.975634 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:14.975634 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:14.975634 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:14.975634 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:14.975634 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:14.975634 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:14.975634 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:14.975634 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:14.975634 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:14.975634 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:14.975634 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:14.975634 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:14.975634 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:14.975634 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:14.975634 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:14.976535 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:01:14.976535 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:01:14.976535 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:14.976535 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 06:01:14.976535 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 603/1215] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:14.982053 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d772f-e7ef-4f52-bd24-af6dec984d65 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:15.064980 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:15.109999 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d772f-e7ef-4f52-bd24-af6dec984d65 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:15.150351 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d4d0a-f0d1-4781-ab6b-55f69a99e165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:15.151114 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d4d0a-f0d1-4781-ab6b-55f69a99e165 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:15.151313 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d4d0a-f0d1-4781-ab6b-55f69a99e165 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:15.151663 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d4d0a-f0d1-4781-ab6b-55f69a99e165 None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:15.152562 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d4d0a-f0d1-4781-ab6b-55f69a99e165 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:15.152958 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d4d0a-f0d1-4781-ab6b-55f69a99e165 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:15.154456 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d4d0a-f0d1-4781-ab6b-55f69a99e165 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:15.168024 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 613/1216] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 06:01:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:01:15.173586 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe67086-1a74-4ad6-b97a-a34d17905ca5 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:15.263236 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:15.312352 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe67086-1a74-4ad6-b97a-a34d17905ca5 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:15.363512 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a67b0-cb7d-484c-b9f1-3f093637122c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:15.363512 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a67b0-cb7d-484c-b9f1-3f093637122c None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:15.363948 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a67b0-cb7d-484c-b9f1-3f093637122c None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:15.364103 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a67b0-cb7d-484c-b9f1-3f093637122c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:15.372420 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a67b0-cb7d-484c-b9f1-3f093637122c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:15.374056 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a67b0-cb7d-484c-b9f1-3f093637122c None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:15.389775 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-431a67b0-cb7d-484c-b9f1-3f093637122c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:01:15.389775 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:15.389775 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:15.389775 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:15.389775 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:15.389775 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:15.389775 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:15.389775 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:15.389775 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:15.389775 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:15.389775 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:15.389775 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:15.389775 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 06:01:15.389775 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 06:01:15.389775 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 06:01:15.391720 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 06:01:15.391720 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:15.391720 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:15.391720 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:15.391720 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:15.391720 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:15.391720 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:15.391720 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:15.391720 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:15.391720 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:15.391720 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:15.391720 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:15.391720 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:15.391720 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:15.391720 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:15.391720 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:15.391720 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:15.392772 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 06:01:15.392772 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 06:01:15.392772 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 06:01:15.392772 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 06:01:15.392772 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 06:01:15.392772 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 06:01:15.392772 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:01:15.392772 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 06:01:15.392772 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 604/1217] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jun 20 06:01:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:15.398586 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d4d0a-f0d1-4781-ab6b-55f69a99e165 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:15.534061 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d4d0a-f0d1-4781-ab6b-55f69a99e165 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:15.564383 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:15.578787 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863efdf3-d5fa-4dd2-b4a8-266698ea3284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:15.579490 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863efdf3-d5fa-4dd2-b4a8-266698ea3284 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:15.579936 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863efdf3-d5fa-4dd2-b4a8-266698ea3284 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:15.580167 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863efdf3-d5fa-4dd2-b4a8-266698ea3284 None admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:15.581164 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863efdf3-d5fa-4dd2-b4a8-266698ea3284 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:15.581475 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863efdf3-d5fa-4dd2-b4a8-266698ea3284 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:15.582956 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863efdf3-d5fa-4dd2-b4a8-266698ea3284 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:15.604494 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 614/1218] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jun 20 06:01:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:15.606177 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a67b0-cb7d-484c-b9f1-3f093637122c None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:15.719128 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a67b0-cb7d-484c-b9f1-3f093637122c None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:15.755863 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:15.762534 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a9ff25-3d19-4188-93ea-39acc42b5e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:15.763451 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9ff25-3d19-4188-93ea-39acc42b5e6f None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:15.764454 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9ff25-3d19-4188-93ea-39acc42b5e6f None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:15.765392 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9ff25-3d19-4188-93ea-39acc42b5e6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:15.766844 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a9ff25-3d19-4188-93ea-39acc42b5e6f None admin] RBAC: Adding query filter params (role.id=b7e86f43512c42bfa0d069e3e6fb97c5, scope.project.id=b349043204b34d1794818184ffe6505c, user.id=6f0f9248178049cda6571fa365a21225) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:15.767212 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a9ff25-3d19-4188-93ea-39acc42b5e6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:15.769277 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a9ff25-3d19-4188-93ea-39acc42b5e6f None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:15.788746 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 605/1219] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jun 20 06:01:15 2022] GET /identity/v3/role_assignments?user.id=6f0f9248178049cda6571fa365a21225&scope.project.id=b349043204b34d1794818184ffe6505c&role.id=b7e86f43512c42bfa0d069e3e6fb97c5 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:18.152409 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198d0cc-cab3-4079-8124-1b4e3903ce68 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:18.152995 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198d0cc-cab3-4079-8124-1b4e3903ce68 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:18.153105 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198d0cc-cab3-4079-8124-1b4e3903ce68 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:18.154790 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 615/1220] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 06:01:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:18.161549 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ad93b-577e-489a-8c3c-9fb52d3b41cc None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:18.162039 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ad93b-577e-489a-8c3c-9fb52d3b41cc None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:18.162340 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ad93b-577e-489a-8c3c-9fb52d3b41cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:18.183064 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-c37ad93b-577e-489a-8c3c-9fb52d3b41cc None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:18.184686 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-c37ad93b-577e-489a-8c3c-9fb52d3b41cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:18.266143 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 606/1221] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:01:18.299908 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3198d0cc-cab3-4079-8124-1b4e3903ce68 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:18.415885 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3198d0cc-cab3-4079-8124-1b4e3903ce68 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:18.453591 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c3da2-c3f7-4639-bc71-e09268f4337e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:18.454598 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c3da2-c3f7-4639-bc71-e09268f4337e None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:18.455011 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c3da2-c3f7-4639-bc71-e09268f4337e None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:18.455357 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c3da2-c3f7-4639-bc71-e09268f4337e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:18.467714 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07c3da2-c3f7-4639-bc71-e09268f4337e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:01:18.475524 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-b07c3da2-c3f7-4639-bc71-e09268f4337e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 06:01:18.475524 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:18.475524 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:18.475524 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:18.475524 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:18.475524 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:18.475524 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:18.475524 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:18.475524 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:18.475524 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:18.475524 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:18.475524 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:18.475524 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:01:18.475524 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:01:18.475524 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:01:18.475524 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:01:18.477235 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:01:18.477235 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:01:18.477235 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:01:18.477235 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:01:18.477235 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:18.477235 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:18.477235 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:18.477235 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:18.477235 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:18.477235 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:18.477235 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:18.477235 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:18.477235 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:18.477235 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:18.477235 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:18.477235 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:18.478274 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:18.478274 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:18.478274 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:18.478274 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:18.478274 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:01:18.478274 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:01:18.478274 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:01:18.478274 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:01:18.478274 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:01:18.478274 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:01:18.478274 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 06:01:18.478274 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:18.478274 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 616/1222] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jun 20 06:01:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:18.483043 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37ad93b-577e-489a-8c3c-9fb52d3b41cc None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:18.597337 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37ad93b-577e-489a-8c3c-9fb52d3b41cc None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:18.622600 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:18.634657 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d5155-f6fb-485a-ac06-bf8c8784f009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:18.635379 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d5155-f6fb-485a-ac06-bf8c8784f009 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:18.635665 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d5155-f6fb-485a-ac06-bf8c8784f009 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:18.635939 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d5155-f6fb-485a-ac06-bf8c8784f009 None admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:18.636683 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d5155-f6fb-485a-ac06-bf8c8784f009 None admin] RBAC: Adding query filter params (name=service) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:18.637040 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d5155-f6fb-485a-ac06-bf8c8784f009 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:18.638602 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d5155-f6fb-485a-ac06-bf8c8784f009 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:18.647380 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 607/1223] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jun 20 06:01:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:18.653030 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c3da2-c3f7-4639-bc71-e09268f4337e None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:18.696587 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:18.755642 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c3da2-c3f7-4639-bc71-e09268f4337e None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:18.790814 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5f254-fa6e-40df-943c-cfc79c87329b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:18.791853 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5f254-fa6e-40df-943c-cfc79c87329b None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:18.792141 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5f254-fa6e-40df-943c-cfc79c87329b None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:18.792420 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5f254-fa6e-40df-943c-cfc79c87329b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:18.804795 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e5f254-fa6e-40df-943c-cfc79c87329b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:18.806307 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e5f254-fa6e-40df-943c-cfc79c87329b None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:18.824931 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-46e5f254-fa6e-40df-943c-cfc79c87329b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:18.824931 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:18.824931 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:18.824931 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:18.824931 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:18.824931 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:18.824931 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:18.824931 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:18.824931 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:18.824931 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:18.824931 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:18.824931 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:18.824931 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:01:18.824931 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:01:18.824931 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:01:18.825912 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:01:18.825912 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:18.825912 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:18.825912 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:18.825912 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:18.825912 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:18.825912 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:18.825912 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:18.825912 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:18.825912 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:18.825912 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:18.825912 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:18.825912 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:18.825912 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:18.825912 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:18.825912 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:18.825912 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:18.826804 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:01:18.826804 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:01:18.826804 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:18.826804 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:18.826804 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 617/1224] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:18.833331 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d5155-f6fb-485a-ac06-bf8c8784f009 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:18.939523 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d5155-f6fb-485a-ac06-bf8c8784f009 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:18.976339 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f890c3-5369-4129-aa42-9acb8a52ee9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:18.977060 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f890c3-5369-4129-aa42-9acb8a52ee9a None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:18.977404 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f890c3-5369-4129-aa42-9acb8a52ee9a None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:18.977727 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f890c3-5369-4129-aa42-9acb8a52ee9a None admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:18.978529 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f890c3-5369-4129-aa42-9acb8a52ee9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:18.978864 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f890c3-5369-4129-aa42-9acb8a52ee9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:18.980313 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f890c3-5369-4129-aa42-9acb8a52ee9a None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:18.999196 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 608/1225] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 06:01:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:19.000615 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5f254-fa6e-40df-943c-cfc79c87329b None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:19.104623 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:19.111548 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5f254-fa6e-40df-943c-cfc79c87329b None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:19.147962 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a6b16-5f59-4c3c-a23d-687b6c696024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:19.148799 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a6b16-5f59-4c3c-a23d-687b6c696024 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:19.149086 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a6b16-5f59-4c3c-a23d-687b6c696024 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:19.149363 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a6b16-5f59-4c3c-a23d-687b6c696024 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:19.157396 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4a6b16-5f59-4c3c-a23d-687b6c696024 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:19.158959 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4a6b16-5f59-4c3c-a23d-687b6c696024 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:19.174108 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-bd4a6b16-5f59-4c3c-a23d-687b6c696024 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 20 06:01:19.174108 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:19.174108 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:19.174108 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:19.174108 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:19.174108 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:19.174108 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:19.174108 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:19.174108 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:19.174108 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:19.174108 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:19.174108 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:19.174108 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 06:01:19.174108 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 06:01:19.174108 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 06:01:19.174108 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 06:01:19.175123 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:19.175123 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:19.175123 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 06:01:19.175123 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:01:19.175123 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 06:01:19.175123 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:01:19.175123 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:19.175123 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:19.175123 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:19.175123 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:19.175123 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:19.175123 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:19.175123 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:19.175123 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:19.175123 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:19.175123 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:19.175123 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:19.175123 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:19.176740 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:19.176740 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:19.176740 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 06:01:19.176740 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 06:01:19.176740 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 06:01:19.176740 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 06:01:19.176740 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 06:01:19.176740 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 06:01:19.176740 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 20 06:01:19.176740 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:19.176740 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 618/1226] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:19.182226 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f890c3-5369-4129-aa42-9acb8a52ee9a None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:19.248390 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:19.315480 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f890c3-5369-4129-aa42-9acb8a52ee9a None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:19.359675 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c27f658-97ef-4170-aebb-58abe4eac81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:19.361010 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27f658-97ef-4170-aebb-58abe4eac81f None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:19.361383 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27f658-97ef-4170-aebb-58abe4eac81f None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:19.361893 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27f658-97ef-4170-aebb-58abe4eac81f None admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:19.363664 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c27f658-97ef-4170-aebb-58abe4eac81f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:19.364289 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c27f658-97ef-4170-aebb-58abe4eac81f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:19.365937 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c27f658-97ef-4170-aebb-58abe4eac81f None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:19.389952 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 609/1227] 10.222.0.39 () {56 vars in 1143 bytes} [Mon Jun 20 06:01:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:19.395675 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a6b16-5f59-4c3c-a23d-687b6c696024 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:19.527909 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a6b16-5f59-4c3c-a23d-687b6c696024 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:19.572689 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e80f4-84c4-4d08-870d-278c277778a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:19.573568 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e80f4-84c4-4d08-870d-278c277778a3 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:19.573890 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e80f4-84c4-4d08-870d-278c277778a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:19.574246 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e80f4-84c4-4d08-870d-278c277778a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:19.592799 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782e80f4-84c4-4d08-870d-278c277778a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:19.594845 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782e80f4-84c4-4d08-870d-278c277778a3 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:19.616619 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-782e80f4-84c4-4d08-870d-278c277778a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:19.616619 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:19.616619 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:19.616619 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:19.616619 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:19.616619 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:19.616619 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:19.616619 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:19.616619 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:19.616619 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:19.616619 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:19.616619 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:19.616619 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:01:19.616619 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:01:19.616619 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:01:19.617675 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:01:19.617675 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:19.617675 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:19.617675 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:19.617675 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:19.617675 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:19.617675 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:19.617675 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:19.617675 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:19.617675 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:19.617675 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:19.617675 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:19.617675 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:19.617675 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:19.617675 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:19.617675 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:19.617675 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:19.618610 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:01:19.618610 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:01:19.618610 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:19.618610 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:19.618849 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 619/1228] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:19.625133 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c27f658-97ef-4170-aebb-58abe4eac81f None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:19.754753 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c27f658-97ef-4170-aebb-58abe4eac81f None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:19.757877 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:19.801958 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ddc7f-a0ff-4a7a-a99a-be94680fc5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:19.802817 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ddc7f-a0ff-4a7a-a99a-be94680fc5a3 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:19.803307 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ddc7f-a0ff-4a7a-a99a-be94680fc5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:19.803591 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ddc7f-a0ff-4a7a-a99a-be94680fc5a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:19.804392 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ddc7f-a0ff-4a7a-a99a-be94680fc5a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:19.804815 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ddc7f-a0ff-4a7a-a99a-be94680fc5a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:19.806370 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ddc7f-a0ff-4a7a-a99a-be94680fc5a3 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:19.822138 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 610/1229] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 06:01:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:19.829313 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e80f4-84c4-4d08-870d-278c277778a3 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:19.843240 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:19.975498 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e80f4-84c4-4d08-870d-278c277778a3 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:20.019286 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8ee403-87ee-44f0-a613-74f985ab70aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:20.020454 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ee403-87ee-44f0-a613-74f985ab70aa None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:20.020773 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ee403-87ee-44f0-a613-74f985ab70aa None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:20.021343 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ee403-87ee-44f0-a613-74f985ab70aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:20.031246 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8ee403-87ee-44f0-a613-74f985ab70aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:20.032692 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8ee403-87ee-44f0-a613-74f985ab70aa None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:20.048642 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-7e8ee403-87ee-44f0-a613-74f985ab70aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:01:20.048642 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:20.048642 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:20.048642 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:20.048642 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:20.048642 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:20.048642 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:20.048642 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:20.048642 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:20.048642 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:20.048642 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:20.048642 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:20.048642 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 06:01:20.048642 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 06:01:20.048642 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 06:01:20.049797 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 06:01:20.049797 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:20.049797 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:20.049797 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:20.049797 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:20.049797 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:20.049797 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:20.049797 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:20.049797 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:20.049797 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:20.049797 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:20.049797 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:20.049797 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:20.049797 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:20.049797 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:20.049797 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:20.049797 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:20.051593 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 06:01:20.051593 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 06:01:20.051593 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 06:01:20.051593 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 06:01:20.051593 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 06:01:20.051593 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 06:01:20.051593 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:01:20.051593 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:20.057025 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 620/1230] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jun 20 06:01:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:20.059151 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ddc7f-a0ff-4a7a-a99a-be94680fc5a3 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:20.184309 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ddc7f-a0ff-4a7a-a99a-be94680fc5a3 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:20.228115 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5673f4-5010-480a-a2d1-f69462251379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:20.228829 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5673f4-5010-480a-a2d1-f69462251379 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:20.229178 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5673f4-5010-480a-a2d1-f69462251379 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:20.229460 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5673f4-5010-480a-a2d1-f69462251379 None admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:20.230192 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5673f4-5010-480a-a2d1-f69462251379 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:20.230498 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5673f4-5010-480a-a2d1-f69462251379 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:20.231930 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5673f4-5010-480a-a2d1-f69462251379 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:20.245079 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 611/1231] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jun 20 06:01:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:01:20.251919 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8ee403-87ee-44f0-a613-74f985ab70aa None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:20.325753 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:20.369245 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8ee403-87ee-44f0-a613-74f985ab70aa None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:20.412666 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272ae991-67b8-4950-8acd-a63075c890f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:20.413559 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ae991-67b8-4950-8acd-a63075c890f1 None admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:20.413834 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ae991-67b8-4950-8acd-a63075c890f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:20.414095 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ae991-67b8-4950-8acd-a63075c890f1 None admin] PATH_INFO: `/v3/projects/b349043204b34d1794818184ffe6505c/users/6f0f9248178049cda6571fa365a21225/roles/b7e86f43512c42bfa0d069e3e6fb97c5` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:20.429512 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272ae991-67b8-4950-8acd-a63075c890f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=b349043204b34d1794818184ffe6505c, user_id=6f0f9248178049cda6571fa365a21225, role_id=b7e86f43512c42bfa0d069e3e6fb97c5)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:20.430952 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272ae991-67b8-4950-8acd-a63075c890f1 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:20.445049 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 621/1232] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jun 20 06:01:20 2022] PUT /identity/v3/projects/b349043204b34d1794818184ffe6505c/users/6f0f9248178049cda6571fa365a21225/roles/b7e86f43512c42bfa0d069e3e6fb97c5 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:01:22.598403 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397730b-ef27-41fe-b257-1bfe12c33def None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:22.598961 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397730b-ef27-41fe-b257-1bfe12c33def None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:22.598961 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397730b-ef27-41fe-b257-1bfe12c33def None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:22.600325 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 612/1233] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 06:01:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:22.605495 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49576dfa-9349-439c-bb86-37e3f22ef5da None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:22.605880 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49576dfa-9349-439c-bb86-37e3f22ef5da None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:22.606061 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49576dfa-9349-439c-bb86-37e3f22ef5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:22.625063 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-49576dfa-9349-439c-bb86-37e3f22ef5da None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:22.626274 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-49576dfa-9349-439c-bb86-37e3f22ef5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:22.702627 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 622/1234] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:01:22.727850 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a397730b-ef27-41fe-b257-1bfe12c33def None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:22.755701 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:22.844896 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a397730b-ef27-41fe-b257-1bfe12c33def None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:22.887421 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceac6cc-adc1-4cbf-98bf-9fcfcd02b86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:22.888624 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceac6cc-adc1-4cbf-98bf-9fcfcd02b86d None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:22.888904 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceac6cc-adc1-4cbf-98bf-9fcfcd02b86d None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:22.889197 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceac6cc-adc1-4cbf-98bf-9fcfcd02b86d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:22.900677 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceac6cc-adc1-4cbf-98bf-9fcfcd02b86d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:01:22.909741 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-3ceac6cc-adc1-4cbf-98bf-9fcfcd02b86d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 06:01:22.909741 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:22.909741 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:22.909741 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:22.909741 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:22.909741 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:22.909741 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:22.909741 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:22.909741 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:22.909741 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:22.909741 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:22.909741 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:22.909741 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:01:22.909741 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:01:22.909741 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:01:22.909741 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:01:22.910948 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:01:22.910948 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:01:22.910948 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:01:22.910948 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:01:22.910948 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:22.910948 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:22.910948 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:22.910948 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:22.910948 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:22.910948 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:22.910948 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:22.910948 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:22.910948 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:22.910948 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:22.910948 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:22.910948 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:22.917577 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:22.917577 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:22.917577 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:22.917577 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:22.917577 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:01:22.917577 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:01:22.917577 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:01:22.917577 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:01:22.917577 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:01:22.917577 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:01:22.917577 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 06:01:22.917577 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 06:01:22.917577 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 613/1235] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jun 20 06:01:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:22.919378 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49576dfa-9349-439c-bb86-37e3f22ef5da None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:22.980304 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:23.047403 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49576dfa-9349-439c-bb86-37e3f22ef5da None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:23.086194 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3daf292-8cdb-4a0d-be4b-a20458263cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:23.086870 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3daf292-8cdb-4a0d-be4b-a20458263cda None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:23.087146 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3daf292-8cdb-4a0d-be4b-a20458263cda None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:23.087422 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3daf292-8cdb-4a0d-be4b-a20458263cda None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:23.088168 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3daf292-8cdb-4a0d-be4b-a20458263cda None admin] RBAC: Adding query filter params (name=service) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:23.088476 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3daf292-8cdb-4a0d-be4b-a20458263cda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:23.089886 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3daf292-8cdb-4a0d-be4b-a20458263cda None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:23.104124 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 623/1236] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jun 20 06:01:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:23.105593 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceac6cc-adc1-4cbf-98bf-9fcfcd02b86d None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:23.199573 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:23.216969 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceac6cc-adc1-4cbf-98bf-9fcfcd02b86d None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:23.268333 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e2f92d-e599-48d9-9296-8fc693690ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:23.269722 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2f92d-e599-48d9-9296-8fc693690ed2 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:23.270076 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2f92d-e599-48d9-9296-8fc693690ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:23.270357 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2f92d-e599-48d9-9296-8fc693690ed2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:23.283021 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e2f92d-e599-48d9-9296-8fc693690ed2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:23.284991 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e2f92d-e599-48d9-9296-8fc693690ed2 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:23.305676 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-e0e2f92d-e599-48d9-9296-8fc693690ed2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:23.305676 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:23.305676 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:23.305676 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:23.305676 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:23.305676 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:23.305676 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:23.305676 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:23.305676 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:23.305676 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:23.305676 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:23.305676 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:23.305676 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:01:23.305676 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:01:23.305676 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:01:23.306782 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:01:23.306782 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:23.306782 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:23.306782 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:23.306782 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:23.306782 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:23.306782 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:23.306782 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:23.306782 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:23.306782 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:23.306782 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:23.306782 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:23.306782 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:23.306782 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:23.306782 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:23.306782 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:23.306782 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:23.307846 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:01:23.307846 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:01:23.307846 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:23.307846 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 06:01:23.307846 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 614/1237] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:23.314188 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3daf292-8cdb-4a0d-be4b-a20458263cda None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:23.421784 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3daf292-8cdb-4a0d-be4b-a20458263cda None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:23.432754 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:23.462611 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bfc0ad-b82c-4623-bee5-12df38d7c670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:23.463479 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bfc0ad-b82c-4623-bee5-12df38d7c670 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:23.463846 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bfc0ad-b82c-4623-bee5-12df38d7c670 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:23.464199 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bfc0ad-b82c-4623-bee5-12df38d7c670 None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:23.465365 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bfc0ad-b82c-4623-bee5-12df38d7c670 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:23.465678 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bfc0ad-b82c-4623-bee5-12df38d7c670 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:23.467526 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bfc0ad-b82c-4623-bee5-12df38d7c670 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:23.482781 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 624/1238] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 06:01:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:01:23.490056 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e2f92d-e599-48d9-9296-8fc693690ed2 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:23.607080 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e2f92d-e599-48d9-9296-8fc693690ed2 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:23.646904 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb74408-81f5-4210-a192-dca64ae9fef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:23.647806 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb74408-81f5-4210-a192-dca64ae9fef0 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:23.648216 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb74408-81f5-4210-a192-dca64ae9fef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:23.648497 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb74408-81f5-4210-a192-dca64ae9fef0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:23.651910 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:23.658357 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb74408-81f5-4210-a192-dca64ae9fef0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:23.660350 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb74408-81f5-4210-a192-dca64ae9fef0 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:23.676480 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-ebb74408-81f5-4210-a192-dca64ae9fef0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 20 06:01:23.676480 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:23.676480 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:23.676480 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:23.676480 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:23.676480 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:23.676480 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:23.676480 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:23.676480 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:23.676480 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:23.676480 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:23.676480 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:23.676480 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 06:01:23.676480 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 06:01:23.676480 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 06:01:23.676480 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 06:01:23.677576 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:23.677576 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:23.677576 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 06:01:23.677576 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:01:23.677576 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 06:01:23.677576 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:01:23.677576 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:23.677576 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:23.677576 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:23.677576 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:23.677576 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:23.677576 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:23.677576 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:23.677576 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:23.677576 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:23.677576 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:23.677576 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:23.677576 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:23.678534 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:23.678534 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:23.678534 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 06:01:23.678534 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 06:01:23.678534 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 06:01:23.678534 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 06:01:23.678534 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 06:01:23.678534 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 06:01:23.678534 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 20 06:01:23.678534 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 06:01:23.678534 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 615/1239] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:23.684180 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bfc0ad-b82c-4623-bee5-12df38d7c670 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:23.802436 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bfc0ad-b82c-4623-bee5-12df38d7c670 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:23.845713 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d3311f-848d-4b78-9b7e-62bec3490173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:23.846438 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3311f-848d-4b78-9b7e-62bec3490173 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:23.847265 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3311f-848d-4b78-9b7e-62bec3490173 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:23.847613 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3311f-848d-4b78-9b7e-62bec3490173 None admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:23.848613 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d3311f-848d-4b78-9b7e-62bec3490173 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:23.848979 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d3311f-848d-4b78-9b7e-62bec3490173 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:23.850513 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d3311f-848d-4b78-9b7e-62bec3490173 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:23.870863 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 625/1240] 10.222.0.39 () {56 vars in 1143 bytes} [Mon Jun 20 06:01:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:23.876861 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb74408-81f5-4210-a192-dca64ae9fef0 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:23.989966 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb74408-81f5-4210-a192-dca64ae9fef0 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:24.026658 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d731260-7703-490a-a899-10c2d4035f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:24.027469 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d731260-7703-490a-a899-10c2d4035f73 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:24.027773 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d731260-7703-490a-a899-10c2d4035f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:24.028077 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d731260-7703-490a-a899-10c2d4035f73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:24.101078 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:24.108219 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d731260-7703-490a-a899-10c2d4035f73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:24.109697 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d731260-7703-490a-a899-10c2d4035f73 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:24.222781 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 616/1241] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 06:01:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 06:01:24.229226 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d3311f-848d-4b78-9b7e-62bec3490173 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:24.262161 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:24.344629 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d3311f-848d-4b78-9b7e-62bec3490173 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:24.388896 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10fab21-0100-43aa-aaf8-849b6d731376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:24.389961 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10fab21-0100-43aa-aaf8-849b6d731376 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:24.389961 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10fab21-0100-43aa-aaf8-849b6d731376 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:24.390238 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10fab21-0100-43aa-aaf8-849b6d731376 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:24.402773 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10fab21-0100-43aa-aaf8-849b6d731376 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:24.404222 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10fab21-0100-43aa-aaf8-849b6d731376 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:24.422656 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-f10fab21-0100-43aa-aaf8-849b6d731376 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:24.422656 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:24.422656 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:24.422656 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:24.422656 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:24.422656 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:24.422656 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:24.422656 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:24.422656 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:24.422656 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:24.422656 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:24.422656 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:24.422656 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:01:24.422656 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:01:24.422656 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:01:24.423983 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:01:24.423983 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:24.423983 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:24.423983 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:24.423983 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:24.423983 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:24.423983 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:24.423983 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:24.423983 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:24.423983 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:24.423983 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:24.423983 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:24.423983 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:24.423983 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:24.423983 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:24.423983 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:24.423983 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:24.425594 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:01:24.425594 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:01:24.425594 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:24.425594 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:24.425594 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 626/1242] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 06:01:24.430543 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d731260-7703-490a-a899-10c2d4035f73 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:24.539704 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:24.547536 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d731260-7703-490a-a899-10c2d4035f73 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:24.586877 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394d0d74-48d2-4047-b51e-ce0460f5e32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:24.587539 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d0d74-48d2-4047-b51e-ce0460f5e32b None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:24.587821 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d0d74-48d2-4047-b51e-ce0460f5e32b None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:24.588096 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d0d74-48d2-4047-b51e-ce0460f5e32b None admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:24.588850 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394d0d74-48d2-4047-b51e-ce0460f5e32b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:24.589159 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394d0d74-48d2-4047-b51e-ce0460f5e32b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:24.590525 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394d0d74-48d2-4047-b51e-ce0460f5e32b None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:24.603109 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 617/1243] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 06:01:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:24.608794 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10fab21-0100-43aa-aaf8-849b6d731376 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:24.693844 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:24.716236 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10fab21-0100-43aa-aaf8-849b6d731376 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:24.755404 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff84da7-a821-4c0d-8831-49b78fc68d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:24.756472 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff84da7-a821-4c0d-8831-49b78fc68d1d None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:24.756862 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff84da7-a821-4c0d-8831-49b78fc68d1d None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:24.757144 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff84da7-a821-4c0d-8831-49b78fc68d1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:24.764641 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff84da7-a821-4c0d-8831-49b78fc68d1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:24.766173 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff84da7-a821-4c0d-8831-49b78fc68d1d None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:24.782351 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-0ff84da7-a821-4c0d-8831-49b78fc68d1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:01:24.782351 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:24.782351 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:24.782351 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:24.782351 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:24.782351 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:24.782351 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:24.782351 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:24.782351 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:24.782351 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:24.782351 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:24.782351 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:24.782351 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 06:01:24.782351 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 06:01:24.782351 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 06:01:24.784001 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 06:01:24.784001 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:24.784001 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:24.784001 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:24.784001 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:24.784001 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:24.784001 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:24.784001 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:24.784001 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:24.784001 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:24.784001 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:24.784001 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:24.784001 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:24.784001 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:24.784001 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:24.784001 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:24.784001 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:24.786010 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 06:01:24.786010 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 06:01:24.786010 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 06:01:24.786010 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 06:01:24.786010 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 06:01:24.786010 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 06:01:24.786010 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:01:24.786010 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:24.786010 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 627/1244] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jun 20 06:01:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 06:01:24.790491 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394d0d74-48d2-4047-b51e-ce0460f5e32b None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:24.911786 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394d0d74-48d2-4047-b51e-ce0460f5e32b None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:24.950909 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0812fb1c-72ba-4a72-81f6-479da2f122cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:24.951607 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812fb1c-72ba-4a72-81f6-479da2f122cc None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:24.952011 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812fb1c-72ba-4a72-81f6-479da2f122cc None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:24.952214 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812fb1c-72ba-4a72-81f6-479da2f122cc None admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:24.953237 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0812fb1c-72ba-4a72-81f6-479da2f122cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:24.953565 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0812fb1c-72ba-4a72-81f6-479da2f122cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:24.955096 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0812fb1c-72ba-4a72-81f6-479da2f122cc None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:24.969335 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 618/1245] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jun 20 06:01:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:24.976029 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff84da7-a821-4c0d-8831-49b78fc68d1d None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:25.085572 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff84da7-a821-4c0d-8831-49b78fc68d1d None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:25.125761 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8322c5a0-5add-415f-8071-b2385a410c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:25.126420 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322c5a0-5add-415f-8071-b2385a410c97 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:25.126702 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322c5a0-5add-415f-8071-b2385a410c97 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:25.127043 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322c5a0-5add-415f-8071-b2385a410c97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:25.128600 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8322c5a0-5add-415f-8071-b2385a410c97 None admin] RBAC: Adding query filter params (role.id=b7e86f43512c42bfa0d069e3e6fb97c5, scope.project.id=b349043204b34d1794818184ffe6505c, user.id=6f0f9248178049cda6571fa365a21225) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:25.129039 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8322c5a0-5add-415f-8071-b2385a410c97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:25.130809 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8322c5a0-5add-415f-8071-b2385a410c97 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:25.152729 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 628/1246] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jun 20 06:01:24 2022] GET /identity/v3/role_assignments?user.id=6f0f9248178049cda6571fa365a21225&scope.project.id=b349043204b34d1794818184ffe6505c&role.id=b7e86f43512c42bfa0d069e3e6fb97c5 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:27.561537 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d753f4f-6e4f-4319-9d10-116ebaec7969 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:27.562088 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d753f4f-6e4f-4319-9d10-116ebaec7969 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:27.562088 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d753f4f-6e4f-4319-9d10-116ebaec7969 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:27.563452 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 619/1247] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 06:01:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:27.569554 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17087631-69eb-43ff-b85f-50ff82dc7219 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:27.570002 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17087631-69eb-43ff-b85f-50ff82dc7219 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:27.570274 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17087631-69eb-43ff-b85f-50ff82dc7219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:27.575438 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:27.589653 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-17087631-69eb-43ff-b85f-50ff82dc7219 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:27.591015 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-17087631-69eb-43ff-b85f-50ff82dc7219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:27.677441 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 629/1248] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:01:27.702812 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d753f4f-6e4f-4319-9d10-116ebaec7969 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:27.722656 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:27.833157 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d753f4f-6e4f-4319-9d10-116ebaec7969 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:27.881439 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a948a55a-2a72-440c-8558-dd14b00a3f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:27.882637 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948a55a-2a72-440c-8558-dd14b00a3f75 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:27.883096 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948a55a-2a72-440c-8558-dd14b00a3f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:27.883560 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948a55a-2a72-440c-8558-dd14b00a3f75 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:27.895037 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a948a55a-2a72-440c-8558-dd14b00a3f75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:01:27.903263 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-a948a55a-2a72-440c-8558-dd14b00a3f75 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:01:27.903263 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:27.903263 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:27.903263 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:27.903263 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:27.903263 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:27.903263 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:27.903263 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:27.903263 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:27.903263 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:27.903263 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:27.903263 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:27.903263 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:01:27.903263 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:01:27.903263 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:01:27.903263 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:01:27.904422 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:01:27.904422 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:01:27.904422 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:01:27.904422 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:01:27.904422 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:27.904422 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:27.904422 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:27.904422 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:27.904422 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:27.904422 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:27.904422 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:27.904422 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:27.904422 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:27.904422 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:27.904422 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:27.904422 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:27.905402 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:27.905402 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:27.905402 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:27.905402 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:27.905402 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:01:27.905402 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:01:27.905402 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:01:27.905402 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:01:27.905402 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:01:27.905402 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:01:27.905402 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:01:27.905402 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 06:01:27.905402 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 620/1249] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jun 20 06:01:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:27.911204 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17087631-69eb-43ff-b85f-50ff82dc7219 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:28.034648 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17087631-69eb-43ff-b85f-50ff82dc7219 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:28.074891 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:28.081601 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e08cf7-443b-42f9-8d66-6746098de7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:28.082351 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e08cf7-443b-42f9-8d66-6746098de7f1 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:28.082748 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e08cf7-443b-42f9-8d66-6746098de7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:28.083061 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e08cf7-443b-42f9-8d66-6746098de7f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:28.084306 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e08cf7-443b-42f9-8d66-6746098de7f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:28.084923 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e08cf7-443b-42f9-8d66-6746098de7f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:28.087557 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e08cf7-443b-42f9-8d66-6746098de7f1 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:28.098941 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 630/1250] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 06:01:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:01:28.105472 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a948a55a-2a72-440c-8558-dd14b00a3f75 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:28.198969 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:28.231696 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a948a55a-2a72-440c-8558-dd14b00a3f75 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:28.286483 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310b15e-bee7-4c96-a5aa-5a2bc0283985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:28.287633 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310b15e-bee7-4c96-a5aa-5a2bc0283985 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:28.288063 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310b15e-bee7-4c96-a5aa-5a2bc0283985 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:28.288398 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310b15e-bee7-4c96-a5aa-5a2bc0283985 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:28.305624 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e310b15e-bee7-4c96-a5aa-5a2bc0283985 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:28.307114 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e310b15e-bee7-4c96-a5aa-5a2bc0283985 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:28.325304 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-e310b15e-bee7-4c96-a5aa-5a2bc0283985 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:28.325304 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:28.325304 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:28.325304 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:28.325304 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:28.325304 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:28.325304 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:28.325304 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:28.325304 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:28.325304 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:28.325304 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:28.325304 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:28.325304 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:01:28.325304 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:01:28.325304 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:01:28.326333 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:01:28.326333 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:28.326333 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:28.326333 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:28.326333 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:28.326333 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:28.326333 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:28.326333 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:28.326333 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:28.326333 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:28.326333 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:28.326333 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:28.326333 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:28.326333 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:28.326333 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:28.326333 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:28.326333 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:28.327291 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:01:28.327291 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:01:28.327291 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:28.327291 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 06:01:28.327878 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 621/1251] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:28.333852 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e08cf7-443b-42f9-8d66-6746098de7f1 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:28.452831 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e08cf7-443b-42f9-8d66-6746098de7f1 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:28.498290 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd17fd43-4409-4598-9720-b6ffcd826610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:28.498964 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd17fd43-4409-4598-9720-b6ffcd826610 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:28.499252 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd17fd43-4409-4598-9720-b6ffcd826610 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:28.499521 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd17fd43-4409-4598-9720-b6ffcd826610 None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:28.500247 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd17fd43-4409-4598-9720-b6ffcd826610 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:28.500554 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd17fd43-4409-4598-9720-b6ffcd826610 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:28.501949 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd17fd43-4409-4598-9720-b6ffcd826610 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:28.518069 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 631/1252] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 06:01:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:01:28.524307 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310b15e-bee7-4c96-a5aa-5a2bc0283985 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:28.637176 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310b15e-bee7-4c96-a5aa-5a2bc0283985 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:28.669653 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:28.679625 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16745860-3017-496a-9804-27eeaa754377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:28.680639 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16745860-3017-496a-9804-27eeaa754377 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:28.681041 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16745860-3017-496a-9804-27eeaa754377 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:28.681360 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16745860-3017-496a-9804-27eeaa754377 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:28.689999 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16745860-3017-496a-9804-27eeaa754377 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:28.692209 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16745860-3017-496a-9804-27eeaa754377 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:28.707423 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-16745860-3017-496a-9804-27eeaa754377 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 20 06:01:28.707423 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:28.707423 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:28.707423 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:28.707423 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:28.707423 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:28.707423 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:28.707423 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:28.707423 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:28.707423 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:28.707423 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:28.707423 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:28.707423 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 06:01:28.707423 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 06:01:28.707423 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 06:01:28.707423 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 06:01:28.708491 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:28.708491 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:28.708491 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 06:01:28.708491 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:01:28.708491 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 06:01:28.708491 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:01:28.708491 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:28.708491 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:28.708491 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:28.708491 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:28.708491 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:28.708491 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:28.708491 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:28.708491 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:28.708491 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:28.708491 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:28.708491 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:28.708491 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:28.709546 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:28.709546 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:28.709546 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 06:01:28.709546 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 06:01:28.709546 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 06:01:28.709546 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 06:01:28.709546 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 06:01:28.709546 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 06:01:28.709546 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 20 06:01:28.709546 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 06:01:28.709546 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 622/1253] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:28.715182 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd17fd43-4409-4598-9720-b6ffcd826610 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:28.777011 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:28.825178 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd17fd43-4409-4598-9720-b6ffcd826610 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:28.865747 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b79f64-b730-4743-aaa4-fd127bd872c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:28.866428 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b79f64-b730-4743-aaa4-fd127bd872c8 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:28.866711 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b79f64-b730-4743-aaa4-fd127bd872c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:28.866993 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b79f64-b730-4743-aaa4-fd127bd872c8 None admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:28.867870 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b79f64-b730-4743-aaa4-fd127bd872c8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:28.868185 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b79f64-b730-4743-aaa4-fd127bd872c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:28.869648 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b79f64-b730-4743-aaa4-fd127bd872c8 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:28.888774 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 632/1254] 10.222.0.39 () {56 vars in 1143 bytes} [Mon Jun 20 06:01:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:28.896026 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16745860-3017-496a-9804-27eeaa754377 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:29.005436 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16745860-3017-496a-9804-27eeaa754377 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:29.044127 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58768349-0799-4934-9139-0b2a425b47b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:29.045099 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58768349-0799-4934-9139-0b2a425b47b8 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:29.045386 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58768349-0799-4934-9139-0b2a425b47b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:29.045746 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58768349-0799-4934-9139-0b2a425b47b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:29.114653 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:29.129190 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58768349-0799-4934-9139-0b2a425b47b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:29.130642 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58768349-0799-4934-9139-0b2a425b47b8 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:29.241787 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 623/1255] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 06:01:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 20 06:01:29.249117 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b79f64-b730-4743-aaa4-fd127bd872c8 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:29.375964 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b79f64-b730-4743-aaa4-fd127bd872c8 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:29.396566 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:29.421363 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641071d0-0175-4953-848e-d44bfdb51ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:29.422159 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641071d0-0175-4953-848e-d44bfdb51ab6 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:29.422442 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641071d0-0175-4953-848e-d44bfdb51ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:29.422719 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641071d0-0175-4953-848e-d44bfdb51ab6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:29.434530 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641071d0-0175-4953-848e-d44bfdb51ab6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:29.436454 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641071d0-0175-4953-848e-d44bfdb51ab6 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:29.458444 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-641071d0-0175-4953-848e-d44bfdb51ab6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:29.458444 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:29.458444 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:29.458444 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:29.458444 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:29.458444 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:29.458444 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:29.458444 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:29.458444 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:29.458444 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:29.458444 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:29.458444 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:29.458444 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:01:29.458444 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:01:29.458444 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:01:29.460399 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:01:29.460399 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:29.460399 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:29.460399 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:29.460399 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:29.460399 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:29.460399 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:29.460399 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:29.460399 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:29.460399 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:29.460399 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:29.460399 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:29.460399 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:29.460399 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:29.460399 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:29.460399 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:29.460399 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:29.461712 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:01:29.461712 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:01:29.461712 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:29.461712 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:29.461712 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 633/1256] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:29.466524 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58768349-0799-4934-9139-0b2a425b47b8 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:29.568889 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:29.583860 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58768349-0799-4934-9139-0b2a425b47b8 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:29.621631 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b7b251-2572-4207-97f1-f60ad936de75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:29.622641 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7b251-2572-4207-97f1-f60ad936de75 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:29.622993 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7b251-2572-4207-97f1-f60ad936de75 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:29.623274 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7b251-2572-4207-97f1-f60ad936de75 None admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:29.624220 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b7b251-2572-4207-97f1-f60ad936de75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:29.624621 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b7b251-2572-4207-97f1-f60ad936de75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:29.626516 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b7b251-2572-4207-97f1-f60ad936de75 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:29.642390 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 624/1257] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 06:01:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:29.648840 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641071d0-0175-4953-848e-d44bfdb51ab6 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:29.757009 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641071d0-0175-4953-848e-d44bfdb51ab6 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:29.797918 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d8f48-8a0a-43e0-9b96-fe161445d04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:29.798742 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d8f48-8a0a-43e0-9b96-fe161445d04e None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:29.799026 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d8f48-8a0a-43e0-9b96-fe161445d04e None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:29.799528 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d8f48-8a0a-43e0-9b96-fe161445d04e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:29.807922 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1d8f48-8a0a-43e0-9b96-fe161445d04e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:29.809437 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1d8f48-8a0a-43e0-9b96-fe161445d04e None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:29.825816 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-ae1d8f48-8a0a-43e0-9b96-fe161445d04e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:01:29.825816 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:29.825816 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:29.825816 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:29.825816 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:29.825816 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:29.825816 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:29.825816 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:29.825816 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:29.825816 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:29.825816 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:29.825816 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:29.825816 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 06:01:29.825816 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 06:01:29.825816 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 06:01:29.826793 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 06:01:29.826793 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:29.826793 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:29.826793 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:29.826793 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:29.826793 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:29.826793 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:29.826793 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:29.826793 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:29.826793 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:29.826793 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:29.826793 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:29.826793 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:29.826793 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:29.826793 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:29.826793 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:29.826793 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:29.827747 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 06:01:29.827747 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 06:01:29.827747 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 06:01:29.827747 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 06:01:29.827747 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 06:01:29.827747 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 06:01:29.827747 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:01:29.827747 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:29.827747 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 634/1258] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jun 20 06:01:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:29.836029 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b7b251-2572-4207-97f1-f60ad936de75 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:29.943377 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b7b251-2572-4207-97f1-f60ad936de75 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:29.979450 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d37b0d4-1ca9-40fa-951f-387bceb9240a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:29.980343 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37b0d4-1ca9-40fa-951f-387bceb9240a None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:29.980625 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37b0d4-1ca9-40fa-951f-387bceb9240a None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:29.980930 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37b0d4-1ca9-40fa-951f-387bceb9240a None admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:29.981763 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d37b0d4-1ca9-40fa-951f-387bceb9240a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:29.982038 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d37b0d4-1ca9-40fa-951f-387bceb9240a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:29.983498 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d37b0d4-1ca9-40fa-951f-387bceb9240a None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:29.997840 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 625/1259] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jun 20 06:01:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:30.004019 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d8f48-8a0a-43e0-9b96-fe161445d04e None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:30.032176 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:30.111954 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d8f48-8a0a-43e0-9b96-fe161445d04e None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:30.148044 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba9e9b-555b-43dc-9eef-610494f40192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:30.148786 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba9e9b-555b-43dc-9eef-610494f40192 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:30.149064 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba9e9b-555b-43dc-9eef-610494f40192 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:30.149335 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba9e9b-555b-43dc-9eef-610494f40192 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:30.150226 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ba9e9b-555b-43dc-9eef-610494f40192 None admin] RBAC: Adding query filter params (role.id=5a64bd8372704de98e75436ff69e46b3, scope.project.id=b349043204b34d1794818184ffe6505c, user.id=6f0f9248178049cda6571fa365a21225) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:30.150537 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ba9e9b-555b-43dc-9eef-610494f40192 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:30.152072 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ba9e9b-555b-43dc-9eef-610494f40192 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:30.158498 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 635/1260] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jun 20 06:01:30 2022] GET /identity/v3/role_assignments?user.id=6f0f9248178049cda6571fa365a21225&scope.project.id=b349043204b34d1794818184ffe6505c&role.id=5a64bd8372704de98e75436ff69e46b3 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:32.188820 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f335b-467a-4ea0-9f29-6d5f3d132c1c None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:32.189353 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f335b-467a-4ea0-9f29-6d5f3d132c1c None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:32.189466 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f335b-467a-4ea0-9f29-6d5f3d132c1c None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:32.192089 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 626/1261] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 06:01:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:32.197348 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a696805-44e3-4822-87cd-9d83f7d388d2 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:32.197755 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a696805-44e3-4822-87cd-9d83f7d388d2 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:32.197912 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a696805-44e3-4822-87cd-9d83f7d388d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:32.215627 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-1a696805-44e3-4822-87cd-9d83f7d388d2 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:32.217551 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-1a696805-44e3-4822-87cd-9d83f7d388d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:32.296202 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 636/1262] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:01:32.320364 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114f335b-467a-4ea0-9f29-6d5f3d132c1c None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:32.331666 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:32.420464 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114f335b-467a-4ea0-9f29-6d5f3d132c1c None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:32.454215 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51874f4-c554-4abb-a933-f6fba50958e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:32.454994 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51874f4-c554-4abb-a933-f6fba50958e8 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:32.455274 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51874f4-c554-4abb-a933-f6fba50958e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:32.455559 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51874f4-c554-4abb-a933-f6fba50958e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:32.465595 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51874f4-c554-4abb-a933-f6fba50958e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:01:32.473430 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-b51874f4-c554-4abb-a933-f6fba50958e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:01:32.473430 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:32.473430 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:32.473430 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:32.473430 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:32.473430 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:32.473430 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:32.473430 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:32.473430 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:32.473430 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:32.473430 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:32.473430 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:32.473430 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:01:32.473430 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:01:32.473430 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:01:32.473430 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:01:32.474558 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:01:32.474558 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:01:32.474558 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:01:32.474558 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:01:32.474558 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:32.474558 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:32.474558 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:32.474558 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:32.474558 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:32.474558 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:32.474558 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:32.474558 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:32.474558 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:32.474558 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:32.474558 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:32.474558 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:32.480435 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:32.480435 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:32.480435 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:32.480435 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:32.480435 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:01:32.480435 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:01:32.480435 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:01:32.480435 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:01:32.480435 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:01:32.480435 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:01:32.480435 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:01:32.480435 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 06:01:32.480435 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 627/1263] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jun 20 06:01:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:32.481345 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a696805-44e3-4822-87cd-9d83f7d388d2 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:32.498994 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:32.579246 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a696805-44e3-4822-87cd-9d83f7d388d2 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:32.612408 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dbe4d6-2a20-4498-a62e-2143b9a441a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:32.613099 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dbe4d6-2a20-4498-a62e-2143b9a441a7 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:32.613381 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dbe4d6-2a20-4498-a62e-2143b9a441a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:32.613650 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dbe4d6-2a20-4498-a62e-2143b9a441a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:32.614382 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dbe4d6-2a20-4498-a62e-2143b9a441a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:32.614682 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dbe4d6-2a20-4498-a62e-2143b9a441a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:32.616036 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dbe4d6-2a20-4498-a62e-2143b9a441a7 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:32.623828 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 637/1264] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 06:01:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:32.629677 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51874f4-c554-4abb-a933-f6fba50958e8 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:32.696064 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:32.729296 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51874f4-c554-4abb-a933-f6fba50958e8 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:32.761995 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c3b9a7-8acc-4319-9a5c-ead33a0e5ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:32.762855 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3b9a7-8acc-4319-9a5c-ead33a0e5ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:32.763144 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3b9a7-8acc-4319-9a5c-ead33a0e5ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:32.763415 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3b9a7-8acc-4319-9a5c-ead33a0e5ed6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:32.773660 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c3b9a7-8acc-4319-9a5c-ead33a0e5ed6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:32.775125 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c3b9a7-8acc-4319-9a5c-ead33a0e5ed6 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:32.792164 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-58c3b9a7-8acc-4319-9a5c-ead33a0e5ed6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:32.792164 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:32.792164 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:32.792164 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:32.792164 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:32.792164 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:32.792164 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:32.792164 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:32.792164 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:32.792164 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:32.792164 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:32.792164 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:32.792164 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:01:32.792164 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:01:32.792164 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:01:32.793260 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:01:32.793260 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:32.793260 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:32.793260 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:32.793260 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:32.793260 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:32.793260 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:32.793260 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:32.793260 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:32.793260 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:32.793260 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:32.793260 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:32.793260 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:32.793260 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:32.793260 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:32.793260 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:32.793260 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:32.794447 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:01:32.794447 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:01:32.794447 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:32.794447 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 06:01:32.794447 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 628/1265] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:32.799808 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dbe4d6-2a20-4498-a62e-2143b9a441a7 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:32.878548 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:32.897005 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dbe4d6-2a20-4498-a62e-2143b9a441a7 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:32.930043 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d20f7b-c793-49a9-8d5c-2d4630627d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:32.930747 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d20f7b-c793-49a9-8d5c-2d4630627d2c None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:32.931037 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d20f7b-c793-49a9-8d5c-2d4630627d2c None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:32.931309 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d20f7b-c793-49a9-8d5c-2d4630627d2c None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:32.932018 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d20f7b-c793-49a9-8d5c-2d4630627d2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:32.932322 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d20f7b-c793-49a9-8d5c-2d4630627d2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:32.933694 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d20f7b-c793-49a9-8d5c-2d4630627d2c None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:32.945379 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 638/1266] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 06:01:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:32.951053 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c3b9a7-8acc-4319-9a5c-ead33a0e5ed6 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:33.050200 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c3b9a7-8acc-4319-9a5c-ead33a0e5ed6 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:33.069223 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:33.084982 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f3417b-10b4-4305-bdb4-a14afcb7f084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:33.085779 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3417b-10b4-4305-bdb4-a14afcb7f084 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:33.086065 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3417b-10b4-4305-bdb4-a14afcb7f084 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:33.086338 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3417b-10b4-4305-bdb4-a14afcb7f084 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:33.093877 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f3417b-10b4-4305-bdb4-a14afcb7f084 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:33.095366 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f3417b-10b4-4305-bdb4-a14afcb7f084 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:33.110589 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-18f3417b-10b4-4305-bdb4-a14afcb7f084 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 20 06:01:33.110589 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:33.110589 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:33.110589 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:33.110589 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:33.110589 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:33.110589 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:33.110589 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:33.110589 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:33.110589 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:33.110589 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:33.110589 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:33.110589 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 06:01:33.110589 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 06:01:33.110589 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 06:01:33.110589 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 06:01:33.111730 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:33.111730 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:33.111730 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 06:01:33.111730 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:01:33.111730 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 06:01:33.111730 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:01:33.111730 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:33.111730 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:33.111730 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:33.111730 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:33.111730 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:33.111730 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:33.111730 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:33.111730 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:33.111730 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:33.111730 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:33.111730 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:33.111730 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:33.112909 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:33.112909 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:33.112909 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 06:01:33.112909 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 06:01:33.112909 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 06:01:33.112909 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 06:01:33.112909 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 06:01:33.112909 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 06:01:33.112909 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 20 06:01:33.112909 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 06:01:33.112909 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 629/1267] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:33.119232 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d20f7b-c793-49a9-8d5c-2d4630627d2c None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:33.219159 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d20f7b-c793-49a9-8d5c-2d4630627d2c None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:33.260322 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c1bb5-1b8d-44ec-af72-8fed514f34e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:33.261452 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c1bb5-1b8d-44ec-af72-8fed514f34e6 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:33.261744 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c1bb5-1b8d-44ec-af72-8fed514f34e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:33.262027 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c1bb5-1b8d-44ec-af72-8fed514f34e6 None admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:33.262873 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67c1bb5-1b8d-44ec-af72-8fed514f34e6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:33.263192 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67c1bb5-1b8d-44ec-af72-8fed514f34e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:33.264644 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67c1bb5-1b8d-44ec-af72-8fed514f34e6 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:33.274309 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:33.285251 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 639/1268] 10.222.0.39 () {56 vars in 1143 bytes} [Mon Jun 20 06:01:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:33.290901 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f3417b-10b4-4305-bdb4-a14afcb7f084 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:33.387949 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f3417b-10b4-4305-bdb4-a14afcb7f084 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:33.419998 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062fe6a-ee9c-475a-a09e-b507f4fddf47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:33.420796 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062fe6a-ee9c-475a-a09e-b507f4fddf47 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:33.421079 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062fe6a-ee9c-475a-a09e-b507f4fddf47 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:33.421352 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062fe6a-ee9c-475a-a09e-b507f4fddf47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:33.431606 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0062fe6a-ee9c-475a-a09e-b507f4fddf47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:33.433053 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0062fe6a-ee9c-475a-a09e-b507f4fddf47 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:33.450408 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-0062fe6a-ee9c-475a-a09e-b507f4fddf47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:33.450408 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:33.450408 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:33.450408 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:33.450408 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:33.450408 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:33.450408 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:33.450408 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:33.450408 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:33.450408 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:33.450408 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:33.450408 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:33.450408 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:01:33.450408 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:01:33.450408 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:01:33.451479 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:01:33.451479 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:33.451479 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:33.451479 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:33.451479 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:33.451479 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:33.451479 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:33.451479 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:33.451479 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:33.451479 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:33.451479 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:33.451479 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:33.451479 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:33.451479 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:33.451479 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:33.451479 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:33.451479 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:33.452393 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:01:33.452393 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:01:33.452393 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:33.452393 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 06:01:33.452393 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 630/1269] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:33.457860 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c1bb5-1b8d-44ec-af72-8fed514f34e6 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:33.554239 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c1bb5-1b8d-44ec-af72-8fed514f34e6 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:33.587244 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc658d-4308-4f9e-8c9e-427be0eb5d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:33.587897 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc658d-4308-4f9e-8c9e-427be0eb5d96 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:33.588174 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc658d-4308-4f9e-8c9e-427be0eb5d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:33.588445 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc658d-4308-4f9e-8c9e-427be0eb5d96 None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:33.589188 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bc658d-4308-4f9e-8c9e-427be0eb5d96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:33.589490 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bc658d-4308-4f9e-8c9e-427be0eb5d96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:33.590833 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bc658d-4308-4f9e-8c9e-427be0eb5d96 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:33.602129 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 640/1270] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 06:01:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:33.607771 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062fe6a-ee9c-475a-a09e-b507f4fddf47 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:33.639315 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:33.707500 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062fe6a-ee9c-475a-a09e-b507f4fddf47 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:33.740203 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d91408-96b2-4ca8-b8be-193bd38f9785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:33.741002 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d91408-96b2-4ca8-b8be-193bd38f9785 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:33.741283 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d91408-96b2-4ca8-b8be-193bd38f9785 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:33.741556 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d91408-96b2-4ca8-b8be-193bd38f9785 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:33.747927 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d91408-96b2-4ca8-b8be-193bd38f9785 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:33.749386 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d91408-96b2-4ca8-b8be-193bd38f9785 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:33.763266 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-c6d91408-96b2-4ca8-b8be-193bd38f9785 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:01:33.763266 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:33.763266 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:33.763266 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:33.763266 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:33.763266 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:33.763266 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:33.763266 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:33.763266 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:33.763266 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:33.763266 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:33.763266 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:33.763266 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 06:01:33.763266 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 06:01:33.763266 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 06:01:33.764354 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 06:01:33.764354 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:33.764354 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:33.764354 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:33.764354 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:33.764354 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:33.764354 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:33.764354 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:33.764354 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:33.764354 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:33.764354 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:33.764354 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:33.764354 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:33.764354 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:33.764354 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:33.764354 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:33.764354 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:33.765555 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 06:01:33.765555 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 06:01:33.765555 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 06:01:33.765555 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 06:01:33.765555 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 06:01:33.765555 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 06:01:33.765555 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:01:33.765555 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 06:01:33.765555 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 631/1271] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jun 20 06:01:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:33.770717 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc658d-4308-4f9e-8c9e-427be0eb5d96 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:33.827033 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:33.869516 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc658d-4308-4f9e-8c9e-427be0eb5d96 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:33.902093 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef912118-1928-49b8-b05c-c92550b0dce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:33.902690 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef912118-1928-49b8-b05c-c92550b0dce3 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:33.902971 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef912118-1928-49b8-b05c-c92550b0dce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:33.903247 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef912118-1928-49b8-b05c-c92550b0dce3 None admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:33.904033 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef912118-1928-49b8-b05c-c92550b0dce3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:33.904343 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef912118-1928-49b8-b05c-c92550b0dce3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:33.905793 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef912118-1928-49b8-b05c-c92550b0dce3 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:33.918106 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 641/1272] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jun 20 06:01:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:33.924009 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d91408-96b2-4ca8-b8be-193bd38f9785 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:34.011774 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:34.021899 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d91408-96b2-4ca8-b8be-193bd38f9785 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:34.054718 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831db0bf-af7e-435d-8c15-9842dd39e975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:34.055581 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831db0bf-af7e-435d-8c15-9842dd39e975 None admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:34.055859 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831db0bf-af7e-435d-8c15-9842dd39e975 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:34.056130 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831db0bf-af7e-435d-8c15-9842dd39e975 None admin] PATH_INFO: `/v3/projects/b349043204b34d1794818184ffe6505c/users/6f0f9248178049cda6571fa365a21225/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:34.058064 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831db0bf-af7e-435d-8c15-9842dd39e975 None admin] RBAC: Authorizing `identity:create_grant(project_id=b349043204b34d1794818184ffe6505c, user_id=6f0f9248178049cda6571fa365a21225, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:34.059481 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831db0bf-af7e-435d-8c15-9842dd39e975 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:34.072112 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 632/1273] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jun 20 06:01:33 2022] PUT /identity/v3/projects/b349043204b34d1794818184ffe6505c/users/6f0f9248178049cda6571fa365a21225/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:01:36.056916 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dbfd58-43fc-4f72-b53e-227d5cf9c27f None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:36.057472 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dbfd58-43fc-4f72-b53e-227d5cf9c27f None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:36.057472 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dbfd58-43fc-4f72-b53e-227d5cf9c27f None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:36.058830 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 642/1274] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 06:01:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:36.063952 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ab7d3-8de9-4e72-a167-7c32e6a18ad3 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:36.064426 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ab7d3-8de9-4e72-a167-7c32e6a18ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:36.064597 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ab7d3-8de9-4e72-a167-7c32e6a18ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:36.082097 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-c71ab7d3-8de9-4e72-a167-7c32e6a18ad3 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:36.083279 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-c71ab7d3-8de9-4e72-a167-7c32e6a18ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:36.163391 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 633/1275] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 06:01:36.186907 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dbfd58-43fc-4f72-b53e-227d5cf9c27f None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:36.296824 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dbfd58-43fc-4f72-b53e-227d5cf9c27f None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:36.315411 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:36.333121 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c4187-a483-4127-92ab-f19fc98f2245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:36.333915 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c4187-a483-4127-92ab-f19fc98f2245 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:36.334221 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c4187-a483-4127-92ab-f19fc98f2245 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:36.334500 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c4187-a483-4127-92ab-f19fc98f2245 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:36.344480 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01c4187-a483-4127-92ab-f19fc98f2245 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:01:36.352844 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-d01c4187-a483-4127-92ab-f19fc98f2245 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:01:36.352844 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:36.352844 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:36.352844 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:36.352844 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:36.352844 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:36.352844 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:36.352844 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:36.352844 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:36.352844 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:36.352844 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:36.352844 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:36.352844 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:01:36.352844 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:01:36.352844 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:01:36.352844 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:01:36.353945 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:01:36.353945 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:01:36.353945 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:01:36.353945 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:01:36.353945 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:36.353945 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:36.353945 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:36.353945 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:36.353945 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:36.353945 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:36.353945 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:36.353945 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:36.353945 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:36.353945 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:36.353945 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:36.353945 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:36.354824 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:36.354824 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:36.354824 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:36.354824 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:36.354824 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:01:36.354824 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:01:36.354824 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:01:36.354824 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:01:36.354824 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:01:36.354824 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:01:36.354824 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:01:36.354824 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:36.354824 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 643/1276] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jun 20 06:01:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:36.359993 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ab7d3-8de9-4e72-a167-7c32e6a18ad3 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:36.440646 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:36.462264 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ab7d3-8de9-4e72-a167-7c32e6a18ad3 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:36.497293 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89432e19-35c9-4468-a090-68ca1444dd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:36.497951 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89432e19-35c9-4468-a090-68ca1444dd72 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:36.498234 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89432e19-35c9-4468-a090-68ca1444dd72 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:36.498509 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89432e19-35c9-4468-a090-68ca1444dd72 None admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:36.499252 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89432e19-35c9-4468-a090-68ca1444dd72 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:36.499558 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89432e19-35c9-4468-a090-68ca1444dd72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:36.500966 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89432e19-35c9-4468-a090-68ca1444dd72 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:36.509406 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 634/1277] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jun 20 06:01:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:36.515120 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c4187-a483-4127-92ab-f19fc98f2245 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:36.615128 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c4187-a483-4127-92ab-f19fc98f2245 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:36.647417 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d77987-91b1-418c-bed3-64ab73b9dbc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:36.648194 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d77987-91b1-418c-bed3-64ab73b9dbc7 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:36.648475 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d77987-91b1-418c-bed3-64ab73b9dbc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:36.648775 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d77987-91b1-418c-bed3-64ab73b9dbc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:36.659944 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d77987-91b1-418c-bed3-64ab73b9dbc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:36.661414 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d77987-91b1-418c-bed3-64ab73b9dbc7 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:36.678470 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-08d77987-91b1-418c-bed3-64ab73b9dbc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:36.678470 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:36.678470 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:36.678470 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:36.678470 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:36.678470 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:36.678470 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:36.678470 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:36.678470 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:36.678470 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:36.678470 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:36.678470 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:36.678470 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:01:36.678470 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:01:36.678470 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:01:36.679510 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:01:36.679510 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:36.679510 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:36.679510 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:36.679510 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:36.679510 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:36.679510 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:36.679510 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:36.679510 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:36.679510 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:36.679510 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:36.679510 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:36.679510 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:36.679510 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:36.679510 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:36.679510 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:36.679510 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:36.680615 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:01:36.680615 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:01:36.680615 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:36.680615 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:36.680615 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 644/1278] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:36.685318 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89432e19-35c9-4468-a090-68ca1444dd72 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:36.782791 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89432e19-35c9-4468-a090-68ca1444dd72 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:36.816075 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996c32d-5f24-4142-befd-bcd1c7ba375d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:36.817000 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996c32d-5f24-4142-befd-bcd1c7ba375d None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:36.817287 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996c32d-5f24-4142-befd-bcd1c7ba375d None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:36.817565 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996c32d-5f24-4142-befd-bcd1c7ba375d None admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:36.818281 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8996c32d-5f24-4142-befd-bcd1c7ba375d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:36.818595 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8996c32d-5f24-4142-befd-bcd1c7ba375d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:36.819954 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8996c32d-5f24-4142-befd-bcd1c7ba375d None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:36.831507 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 635/1279] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 06:01:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:36.836907 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d77987-91b1-418c-bed3-64ab73b9dbc7 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:36.867328 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:36.937241 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d77987-91b1-418c-bed3-64ab73b9dbc7 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:36.970160 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac36948f-702c-48e0-bb5f-e54268f00f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:36.971323 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36948f-702c-48e0-bb5f-e54268f00f8e None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:36.971605 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36948f-702c-48e0-bb5f-e54268f00f8e None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:36.971878 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36948f-702c-48e0-bb5f-e54268f00f8e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:36.979075 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac36948f-702c-48e0-bb5f-e54268f00f8e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:36.980495 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac36948f-702c-48e0-bb5f-e54268f00f8e None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:36.995406 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-ac36948f-702c-48e0-bb5f-e54268f00f8e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 20 06:01:36.995406 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:36.995406 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:36.995406 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:36.995406 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:36.995406 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:36.995406 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:36.995406 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:36.995406 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:36.995406 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:36.995406 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:36.995406 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:36.995406 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 06:01:36.995406 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 06:01:36.995406 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 06:01:36.995406 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 06:01:36.996508 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:36.996508 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:36.996508 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 06:01:36.996508 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:01:36.996508 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 06:01:36.996508 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:01:36.996508 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:36.996508 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:36.996508 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:36.996508 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:36.996508 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:36.996508 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:36.996508 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:36.996508 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:36.996508 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:36.996508 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:36.996508 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:36.996508 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:36.997802 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:36.997802 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:36.997802 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 06:01:36.997802 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 06:01:36.997802 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 06:01:36.997802 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 06:01:36.997802 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 06:01:36.997802 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 06:01:36.997802 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 20 06:01:36.997802 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:36.997802 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 645/1280] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:37.002311 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996c32d-5f24-4142-befd-bcd1c7ba375d None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:37.006215 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:37.102700 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996c32d-5f24-4142-befd-bcd1c7ba375d None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:37.138588 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c330f81-de8e-4947-af09-1fa7b0dcf374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:37.139188 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c330f81-de8e-4947-af09-1fa7b0dcf374 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:37.139472 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c330f81-de8e-4947-af09-1fa7b0dcf374 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:37.139747 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c330f81-de8e-4947-af09-1fa7b0dcf374 None admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:37.140587 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c330f81-de8e-4947-af09-1fa7b0dcf374 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:37.140923 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c330f81-de8e-4947-af09-1fa7b0dcf374 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:37.142349 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c330f81-de8e-4947-af09-1fa7b0dcf374 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:37.161358 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 636/1281] 10.222.0.39 () {56 vars in 1143 bytes} [Mon Jun 20 06:01:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:37.166851 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac36948f-702c-48e0-bb5f-e54268f00f8e None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:37.260872 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:37.271664 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac36948f-702c-48e0-bb5f-e54268f00f8e None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:37.304210 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8337f3-d4bd-4ebf-bd43-8b1e1cc8f5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:37.304878 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8337f3-d4bd-4ebf-bd43-8b1e1cc8f5b5 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:37.305160 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8337f3-d4bd-4ebf-bd43-8b1e1cc8f5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:37.305433 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8337f3-d4bd-4ebf-bd43-8b1e1cc8f5b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:37.370193 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8337f3-d4bd-4ebf-bd43-8b1e1cc8f5b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:37.371628 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8337f3-d4bd-4ebf-bd43-8b1e1cc8f5b5 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:37.459009 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:37.469430 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 646/1282] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jun 20 06:01:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 06:01:37.475169 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c330f81-de8e-4947-af09-1fa7b0dcf374 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:37.535291 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:37.573891 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c330f81-de8e-4947-af09-1fa7b0dcf374 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:37.608204 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1e5cff-7db1-4d8f-9678-f58ffc7ae6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:37.609007 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e5cff-7db1-4d8f-9678-f58ffc7ae6f4 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:37.609290 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e5cff-7db1-4d8f-9678-f58ffc7ae6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:37.609564 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e5cff-7db1-4d8f-9678-f58ffc7ae6f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:37.620219 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1e5cff-7db1-4d8f-9678-f58ffc7ae6f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:37.621685 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1e5cff-7db1-4d8f-9678-f58ffc7ae6f4 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:37.638842 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-0b1e5cff-7db1-4d8f-9678-f58ffc7ae6f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:37.638842 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:37.638842 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:37.638842 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:37.638842 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:37.638842 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:37.638842 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:37.638842 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:37.638842 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:37.638842 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:37.638842 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:37.638842 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:37.638842 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:01:37.638842 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:01:37.638842 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:01:37.639898 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:01:37.639898 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:37.639898 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:37.639898 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:37.639898 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:37.639898 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:37.639898 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:37.639898 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:37.639898 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:37.639898 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:37.639898 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:37.639898 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:37.639898 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:37.639898 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:37.639898 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:37.639898 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:37.639898 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:37.641257 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:01:37.641257 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:01:37.641257 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:37.641257 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 06:01:37.641257 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 637/1283] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:37.646181 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8337f3-d4bd-4ebf-bd43-8b1e1cc8f5b5 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:37.743561 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8337f3-d4bd-4ebf-bd43-8b1e1cc8f5b5 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:37.777011 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d685d9-4fc0-417a-af89-239e6958db8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:37.777661 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d685d9-4fc0-417a-af89-239e6958db8d None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:37.777941 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d685d9-4fc0-417a-af89-239e6958db8d None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:37.778216 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d685d9-4fc0-417a-af89-239e6958db8d None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:37.778930 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d685d9-4fc0-417a-af89-239e6958db8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:37.779237 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d685d9-4fc0-417a-af89-239e6958db8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:37.780598 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d685d9-4fc0-417a-af89-239e6958db8d None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:37.791987 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 647/1284] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jun 20 06:01:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:37.797462 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1e5cff-7db1-4d8f-9678-f58ffc7ae6f4 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:37.893474 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1e5cff-7db1-4d8f-9678-f58ffc7ae6f4 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:37.907517 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:37.927449 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b594ae-b839-459c-922c-963e9fb431e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:37.928220 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b594ae-b839-459c-922c-963e9fb431e8 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:37.928496 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b594ae-b839-459c-922c-963e9fb431e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:37.928798 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b594ae-b839-459c-922c-963e9fb431e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:37.935182 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b594ae-b839-459c-922c-963e9fb431e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:37.936603 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b594ae-b839-459c-922c-963e9fb431e8 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:37.950817 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application [None req-97b594ae-b839-459c-922c-963e9fb431e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:01:37.950817 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:37.950817 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:37.950817 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:37.950817 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:37.950817 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:37.950817 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:37.950817 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:37.950817 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:37.950817 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:37.950817 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:37.950817 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:37.950817 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 06:01:37.950817 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 06:01:37.950817 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 06:01:37.951871 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 06:01:37.951871 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:37.951871 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:37.951871 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:37.951871 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:37.951871 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:37.951871 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:37.951871 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:37.951871 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:37.951871 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:37.951871 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:37.951871 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:37.951871 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:37.951871 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:37.951871 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:37.951871 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:37.951871 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:37.953019 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 06:01:37.953019 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 06:01:37.953019 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 06:01:37.953019 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 06:01:37.953019 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 06:01:37.953019 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 06:01:37.953019 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:01:37.953019 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: ERROR keystone.server.flask.application Jun 20 06:01:37.953019 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 638/1285] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jun 20 06:01:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:37.958405 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d685d9-4fc0-417a-af89-239e6958db8d None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:38.007089 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:38.055847 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d685d9-4fc0-417a-af89-239e6958db8d None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:38.088505 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66fa31-c712-40bd-b30d-920ce3c3a00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:38.089173 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66fa31-c712-40bd-b30d-920ce3c3a00b None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:38.089457 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66fa31-c712-40bd-b30d-920ce3c3a00b None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:38.089735 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66fa31-c712-40bd-b30d-920ce3c3a00b None admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:38.090520 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66fa31-c712-40bd-b30d-920ce3c3a00b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:38.090831 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66fa31-c712-40bd-b30d-920ce3c3a00b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:38.092248 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66fa31-c712-40bd-b30d-920ce3c3a00b None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:38.104403 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 648/1286] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jun 20 06:01:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:38.110233 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b594ae-b839-459c-922c-963e9fb431e8 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:38.207892 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b594ae-b839-459c-922c-963e9fb431e8 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:38.243868 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ca317d-932d-4f29-b155-28136ce325b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:38.244507 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca317d-932d-4f29-b155-28136ce325b4 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:38.244812 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca317d-932d-4f29-b155-28136ce325b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:38.245083 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca317d-932d-4f29-b155-28136ce325b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:38.245902 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ca317d-932d-4f29-b155-28136ce325b4 None admin] RBAC: Adding query filter params (role.id=5a64bd8372704de98e75436ff69e46b3, scope.project.id=b349043204b34d1794818184ffe6505c, user.id=6f0f9248178049cda6571fa365a21225) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:38.246210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ca317d-932d-4f29-b155-28136ce325b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:38.247658 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ca317d-932d-4f29-b155-28136ce325b4 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:38.253543 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 639/1287] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jun 20 06:01:38 2022] GET /identity/v3/role_assignments?user.id=6f0f9248178049cda6571fa365a21225&scope.project.id=b349043204b34d1794818184ffe6505c&role.id=5a64bd8372704de98e75436ff69e46b3 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:40.335055 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5ed0e-63cb-46c1-b99b-23636f8d8469 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:40.335616 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5ed0e-63cb-46c1-b99b-23636f8d8469 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:40.335616 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5ed0e-63cb-46c1-b99b-23636f8d8469 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:40.337020 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 649/1288] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 06:01:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:40.342185 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb0049-6915-4b8f-a3dc-e899939bfa49 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:40.342584 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb0049-6915-4b8f-a3dc-e899939bfa49 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:40.342739 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb0049-6915-4b8f-a3dc-e899939bfa49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:40.359782 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-dfbb0049-6915-4b8f-a3dc-e899939bfa49 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:40.361753 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-dfbb0049-6915-4b8f-a3dc-e899939bfa49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:40.396280 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:40.433653 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 640/1289] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:01:40.457488 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca5ed0e-63cb-46c1-b99b-23636f8d8469 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:40.555964 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca5ed0e-63cb-46c1-b99b-23636f8d8469 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:40.566797 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:40.590758 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b9475-ccb9-4085-b841-380f4d017d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:40.591484 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b9475-ccb9-4085-b841-380f4d017d84 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:40.591769 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b9475-ccb9-4085-b841-380f4d017d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:40.592047 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b9475-ccb9-4085-b841-380f4d017d84 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:40.592716 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b9475-ccb9-4085-b841-380f4d017d84 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:40.594094 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b9475-ccb9-4085-b841-380f4d017d84 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:40.606426 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-764b9475-ccb9-4085-b841-380f4d017d84 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 06:01:40.606426 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:40.606426 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 06:01:40.606426 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 06:01:40.606426 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 06:01:40.606426 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 06:01:40.606426 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 06:01:40.606426 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:01:40.606426 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 06:01:40.606426 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:40.606426 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 06:01:40.606426 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:40.606426 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:40.606426 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:40.606426 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:40.606426 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:40.606426 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:40.607629 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:40.607629 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:40.607629 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:40.607629 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:40.607629 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:40.607629 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:40.607629 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 06:01:40.607629 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 06:01:40.607629 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 06:01:40.607629 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 06:01:40.607629 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:40.607629 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:40.607629 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:40.607629 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:40.607629 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:40.607629 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:40.608725 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:40.608725 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:40.608725 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:40.608725 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:40.608725 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:40.608725 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:40.608725 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:40.608725 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:40.608725 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:40.608725 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:40.608725 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 06:01:40.608725 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:01:40.608725 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 06:01:40.608725 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:40.608725 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 650/1290] 10.222.0.39 () {56 vars in 1117 bytes} [Mon Jun 20 06:01:40 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:40.613737 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb0049-6915-4b8f-a3dc-e899939bfa49 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:40.710846 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb0049-6915-4b8f-a3dc-e899939bfa49 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:40.743794 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a728f8-310d-4269-bb89-2ab51f6e5666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:40.744448 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a728f8-310d-4269-bb89-2ab51f6e5666 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:40.744753 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a728f8-310d-4269-bb89-2ab51f6e5666 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:40.745035 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a728f8-310d-4269-bb89-2ab51f6e5666 None admin] PATH_INFO: `/v3/services` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:40.745737 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a728f8-310d-4269-bb89-2ab51f6e5666 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:40.746044 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a728f8-310d-4269-bb89-2ab51f6e5666 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:40.747411 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a728f8-310d-4269-bb89-2ab51f6e5666 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:40.752197 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 641/1291] 10.222.0.39 () {56 vars in 1116 bytes} [Mon Jun 20 06:01:40 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:01:40.757858 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b9475-ccb9-4085-b841-380f4d017d84 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:40.875323 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b9475-ccb9-4085-b841-380f4d017d84 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:40.914466 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc48482-e52e-4ed3-8f9b-16af9f39aaf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:40.915125 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc48482-e52e-4ed3-8f9b-16af9f39aaf5 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:40.915410 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc48482-e52e-4ed3-8f9b-16af9f39aaf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:40.915690 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc48482-e52e-4ed3-8f9b-16af9f39aaf5 None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:40.916392 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc48482-e52e-4ed3-8f9b-16af9f39aaf5 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:40.916729 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc48482-e52e-4ed3-8f9b-16af9f39aaf5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:40.918090 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc48482-e52e-4ed3-8f9b-16af9f39aaf5 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:40.922446 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 651/1292] 10.222.0.39 () {56 vars in 1116 bytes} [Mon Jun 20 06:01:40 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:42.937618 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd97e03-2258-47c8-8fd9-9fdfe7591340 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:42.938125 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd97e03-2258-47c8-8fd9-9fdfe7591340 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:42.938125 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd97e03-2258-47c8-8fd9-9fdfe7591340 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:42.940456 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 642/1293] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 06:01:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:42.945783 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac6ee3-d4f2-428f-a965-1c598c4d549f None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:42.946223 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac6ee3-d4f2-428f-a965-1c598c4d549f None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:42.946328 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac6ee3-d4f2-428f-a965-1c598c4d549f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:42.963350 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-70ac6ee3-d4f2-428f-a965-1c598c4d549f None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:42.964537 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-70ac6ee3-d4f2-428f-a965-1c598c4d549f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:42.994351 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:43.032130 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 652/1294] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:01:43.056396 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd97e03-2258-47c8-8fd9-9fdfe7591340 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:43.088792 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:43.159741 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd97e03-2258-47c8-8fd9-9fdfe7591340 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:43.195893 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac292a-b149-471c-8c42-789ce87f3595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:43.196628 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac292a-b149-471c-8c42-789ce87f3595 None admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:43.196939 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac292a-b149-471c-8c42-789ce87f3595 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:43.197213 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac292a-b149-471c-8c42-789ce87f3595 None admin] PATH_INFO: `/v3/services` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:43.197928 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac292a-b149-471c-8c42-789ce87f3595 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:43.199384 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac292a-b149-471c-8c42-789ce87f3595 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:43.212922 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 643/1295] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Jun 20 06:01:43 2022] POST /identity/v3/services => generated 246 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:01:45.338716 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fba1b7-26e0-43ff-8b71-14680363c9ab None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:45.339318 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fba1b7-26e0-43ff-8b71-14680363c9ab None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:45.339318 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fba1b7-26e0-43ff-8b71-14680363c9ab None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:45.340768 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 653/1296] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 06:01:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:45.347800 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca921e-1c01-420a-aa2d-c63f93997153 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:45.348529 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca921e-1c01-420a-aa2d-c63f93997153 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:45.348529 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca921e-1c01-420a-aa2d-c63f93997153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:45.367009 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-78ca921e-1c01-420a-aa2d-c63f93997153 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:45.368189 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-78ca921e-1c01-420a-aa2d-c63f93997153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:45.441032 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 644/1297] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:45 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:01:45.464534 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fba1b7-26e0-43ff-8b71-14680363c9ab None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:45.565088 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fba1b7-26e0-43ff-8b71-14680363c9ab None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:45.599189 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef01a70-34a2-4c09-be8b-740c95afa68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:45.599898 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef01a70-34a2-4c09-be8b-740c95afa68c None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:45.600178 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef01a70-34a2-4c09-be8b-740c95afa68c None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:45.600454 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef01a70-34a2-4c09-be8b-740c95afa68c None admin] PATH_INFO: `/v3/services/placement` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:45.601137 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef01a70-34a2-4c09-be8b-740c95afa68c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:45.602498 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef01a70-34a2-4c09-be8b-740c95afa68c None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:45.614218 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-4ef01a70-34a2-4c09-be8b-740c95afa68c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 06:01:45.614218 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:45.614218 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 06:01:45.614218 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 06:01:45.614218 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 06:01:45.614218 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 06:01:45.614218 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 06:01:45.614218 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:01:45.614218 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 06:01:45.614218 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:45.614218 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 06:01:45.614218 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:45.614218 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:45.614218 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:45.614218 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:45.614218 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:45.614218 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:45.615386 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:45.615386 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:45.615386 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:45.615386 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:45.615386 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:45.615386 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:45.615386 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 06:01:45.615386 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 06:01:45.615386 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 06:01:45.615386 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 06:01:45.615386 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:45.615386 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:45.615386 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:45.615386 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:45.615386 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:45.615386 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:45.616624 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:45.616624 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:45.616624 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:45.616624 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:45.616624 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:45.616624 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:45.616624 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:45.616624 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:45.616624 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:45.616624 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:45.616624 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 06:01:45.616624 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:01:45.616624 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 06:01:45.616624 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:45.616624 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 654/1298] 10.222.0.39 () {56 vars in 1117 bytes} [Mon Jun 20 06:01:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:45.621426 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca921e-1c01-420a-aa2d-c63f93997153 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:45.639905 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:45.719921 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca921e-1c01-420a-aa2d-c63f93997153 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:45.753931 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0465e-6af8-479d-9eb4-379617072a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:45.754584 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0465e-6af8-479d-9eb4-379617072a97 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:45.754865 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0465e-6af8-479d-9eb4-379617072a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:45.755139 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0465e-6af8-479d-9eb4-379617072a97 None admin] PATH_INFO: `/v3/services` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:45.755836 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b0465e-6af8-479d-9eb4-379617072a97 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:45.756141 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b0465e-6af8-479d-9eb4-379617072a97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:45.757529 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b0465e-6af8-479d-9eb4-379617072a97 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:45.762553 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 645/1299] 10.222.0.39 () {56 vars in 1116 bytes} [Mon Jun 20 06:01:45 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:45.769375 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef01a70-34a2-4c09-be8b-740c95afa68c None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:45.800759 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:45.867192 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef01a70-34a2-4c09-be8b-740c95afa68c None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:45.898886 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef3f31-ed44-4e0c-81bd-fa61ed05c734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:45.899530 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef3f31-ed44-4e0c-81bd-fa61ed05c734 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:45.899809 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef3f31-ed44-4e0c-81bd-fa61ed05c734 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:45.900081 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef3f31-ed44-4e0c-81bd-fa61ed05c734 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:45.900886 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ef3f31-ed44-4e0c-81bd-fa61ed05c734 None admin] RBAC: Adding query filter params (interface=public, service_id=49cebc8c035144f48b6f84d92f817d78, region_id=RegionOne) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:45.901197 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ef3f31-ed44-4e0c-81bd-fa61ed05c734 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:45.902542 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ef3f31-ed44-4e0c-81bd-fa61ed05c734 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:45.908161 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 655/1300] 10.222.0.39 () {56 vars in 1251 bytes} [Mon Jun 20 06:01:45 2022] GET /identity/v3/endpoints?service_id=49cebc8c035144f48b6f84d92f817d78&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:45.913706 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0465e-6af8-479d-9eb4-379617072a97 None admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:45.994415 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:46.012531 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0465e-6af8-479d-9eb4-379617072a97 None admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:46.046801 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993c5c84-fbbd-43ea-9718-3dc94b540ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:46.047453 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c5c84-fbbd-43ea-9718-3dc94b540ae6 None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:46.047736 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c5c84-fbbd-43ea-9718-3dc94b540ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:46.048485 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c5c84-fbbd-43ea-9718-3dc94b540ae6 None admin] PATH_INFO: `/v3/services` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:46.049199 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993c5c84-fbbd-43ea-9718-3dc94b540ae6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:46.050565 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993c5c84-fbbd-43ea-9718-3dc94b540ae6 None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:46.057214 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 646/1301] 10.222.0.39 () {56 vars in 1087 bytes} [Mon Jun 20 06:01:45 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:01:48.039995 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba1758-63bb-455f-b4f3-d43fae43e334 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:48.040527 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba1758-63bb-455f-b4f3-d43fae43e334 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:48.040527 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba1758-63bb-455f-b4f3-d43fae43e334 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:48.041947 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 656/1302] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 06:01:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:48.047065 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45c99f-47fe-43fe-970d-9e3dead5f5fa None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:48.047482 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45c99f-47fe-43fe-970d-9e3dead5f5fa None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:48.047614 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45c99f-47fe-43fe-970d-9e3dead5f5fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:48.064949 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-4f45c99f-47fe-43fe-970d-9e3dead5f5fa None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:48.066361 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-4f45c99f-47fe-43fe-970d-9e3dead5f5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:48.130916 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 647/1303] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:48 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:01:48.152974 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba1758-63bb-455f-b4f3-d43fae43e334 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:48.255460 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:48.262266 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba1758-63bb-455f-b4f3-d43fae43e334 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:48.294632 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3b6ca8-b91e-46b5-8bef-5333280d9ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:48.295352 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b6ca8-b91e-46b5-8bef-5333280d9ee0 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:48.295629 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b6ca8-b91e-46b5-8bef-5333280d9ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:48.295899 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b6ca8-b91e-46b5-8bef-5333280d9ee0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:48.296543 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3b6ca8-b91e-46b5-8bef-5333280d9ee0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:48.298495 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3b6ca8-b91e-46b5-8bef-5333280d9ee0 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:48.310427 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-bc3b6ca8-b91e-46b5-8bef-5333280d9ee0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 06:01:48.310427 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:48.310427 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 06:01:48.310427 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 06:01:48.310427 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 06:01:48.310427 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 06:01:48.310427 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 06:01:48.310427 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:01:48.310427 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 06:01:48.310427 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:48.310427 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 06:01:48.310427 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:48.310427 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:48.310427 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:48.310427 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:48.310427 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:48.310427 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:48.311596 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:48.311596 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:48.311596 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:48.311596 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:48.311596 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:48.311596 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:48.311596 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 06:01:48.311596 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 06:01:48.311596 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 06:01:48.311596 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 06:01:48.311596 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:48.311596 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:48.311596 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:48.311596 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:48.311596 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:48.311596 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:48.312603 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:48.312603 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:48.312603 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:48.312603 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:48.312603 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:48.312603 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:48.312603 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:48.312603 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:48.312603 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:48.312603 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:48.312603 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 06:01:48.312603 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:01:48.312603 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 06:01:48.312603 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:48.312603 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 657/1304] 10.222.0.39 () {56 vars in 1117 bytes} [Mon Jun 20 06:01:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:48.318625 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45c99f-47fe-43fe-970d-9e3dead5f5fa None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:48.391975 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:48.415135 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45c99f-47fe-43fe-970d-9e3dead5f5fa None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:48.448509 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c8b9d-38f8-4164-a4f1-2596fbad1eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:48.449191 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c8b9d-38f8-4164-a4f1-2596fbad1eeb None admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:48.449472 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c8b9d-38f8-4164-a4f1-2596fbad1eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:48.449743 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c8b9d-38f8-4164-a4f1-2596fbad1eeb None admin] PATH_INFO: `/v3/services` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:48.450444 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c8b9d-38f8-4164-a4f1-2596fbad1eeb None admin] RBAC: Adding query filter params (name=placement) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:48.450746 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c8b9d-38f8-4164-a4f1-2596fbad1eeb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:48.452130 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c8b9d-38f8-4164-a4f1-2596fbad1eeb None admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:48.457768 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 648/1305] 10.222.0.39 () {56 vars in 1116 bytes} [Mon Jun 20 06:01:48 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:48.463327 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3b6ca8-b91e-46b5-8bef-5333280d9ee0 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:48.560509 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3b6ca8-b91e-46b5-8bef-5333280d9ee0 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:48.593310 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2704d1b9-7a62-43a0-9549-7eaa25cd9ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:48.593955 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2704d1b9-7a62-43a0-9549-7eaa25cd9ccb None admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:48.594232 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2704d1b9-7a62-43a0-9549-7eaa25cd9ccb None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:48.595021 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2704d1b9-7a62-43a0-9549-7eaa25cd9ccb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:48.595770 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2704d1b9-7a62-43a0-9549-7eaa25cd9ccb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:48.597150 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2704d1b9-7a62-43a0-9549-7eaa25cd9ccb None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:48.615388 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 658/1306] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Jun 20 06:01:48 2022] POST /identity/v3/endpoints => generated 331 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:01:58.455854 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=30 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:58.610640 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:02:51.647979 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d01cf2-a08a-4a4d-a4a0-a88c3f9a9ee5 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:51.648563 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d01cf2-a08a-4a4d-a4a0-a88c3f9a9ee5 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:51.648563 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d01cf2-a08a-4a4d-a4a0-a88c3f9a9ee5 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:51.650127 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 649/1307] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 06:02:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:02:51.656242 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f99f6af-da2b-4a2f-8c03-e60dea3bca1a None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:51.656839 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f99f6af-da2b-4a2f-8c03-e60dea3bca1a None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:51.656839 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f99f6af-da2b-4a2f-8c03-e60dea3bca1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:51.758399 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-2f99f6af-da2b-4a2f-8c03-e60dea3bca1a None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:02:51.759551 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-2f99f6af-da2b-4a2f-8c03-e60dea3bca1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:02:51.878667 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 659/1308] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 06:02:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:02:51.932644 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7fb609-1c2c-405b-b388-1bf82e00d440 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:51.933471 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7fb609-1c2c-405b-b388-1bf82e00d440 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:51.933972 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7fb609-1c2c-405b-b388-1bf82e00d440 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:51.936010 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 650/1309] 10.222.0.39 () {54 vars in 964 bytes} [Mon Jun 20 06:02:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:02:51.944440 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4348e3-5d51-451f-b0da-505daeb7c2b4 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:51.944857 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4348e3-5d51-451f-b0da-505daeb7c2b4 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:51.945213 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4348e3-5d51-451f-b0da-505daeb7c2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:52.054811 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-1f4348e3-5d51-451f-b0da-505daeb7c2b4 None None] MFA Rules not processed for user `83e77cb05c4546c7a98ada817573edf3`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:02:52.056771 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-1f4348e3-5d51-451f-b0da-505daeb7c2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:02:52.088065 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:02:52.171209 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 660/1310] 10.222.0.39 () {58 vars in 1061 bytes} [Mon Jun 20 06:02:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:02:52.180333 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7fb609-1c2c-405b-b388-1bf82e00d440 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:02:52.182132 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-da7fb609-1c2c-405b-b388-1bf82e00d440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:02:52.336244 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7fb609-1c2c-405b-b388-1bf82e00d440 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:02:52.421841 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63843498-cedf-4d52-8567-14de13f17290 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:02:52.422502 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63843498-cedf-4d52-8567-14de13f17290 service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:52.422785 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63843498-cedf-4d52-8567-14de13f17290 service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:52.423061 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63843498-cedf-4d52-8567-14de13f17290 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:52.424752 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-63843498-cedf-4d52-8567-14de13f17290 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:02:52.491534 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:02:52.551698 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63843498-cedf-4d52-8567-14de13f17290 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:02:52.553177 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63843498-cedf-4d52-8567-14de13f17290 service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:02:52.572659 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 651/1311] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:02:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:02:54.938479 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ccc9a2-50e1-4376-8f51-fd7961033ba9 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:54.939004 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ccc9a2-50e1-4376-8f51-fd7961033ba9 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:54.939004 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ccc9a2-50e1-4376-8f51-fd7961033ba9 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:54.940750 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 661/1312] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 06:02:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:02:54.945639 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec481793-35f8-4529-8188-e28860064a61 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:54.946040 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec481793-35f8-4529-8188-e28860064a61 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:54.946208 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec481793-35f8-4529-8188-e28860064a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:55.022644 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-ec481793-35f8-4529-8188-e28860064a61 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:02:55.023862 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-ec481793-35f8-4529-8188-e28860064a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:02:55.134243 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 652/1313] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 06:02:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:02:55.174253 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ccc9a2-50e1-4376-8f51-fd7961033ba9 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:02:55.176321 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-a0ccc9a2-50e1-4376-8f51-fd7961033ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:02:55.294748 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ccc9a2-50e1-4376-8f51-fd7961033ba9 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:02:55.371498 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:02:55.374544 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d516adf-e303-41ae-96b4-36fa1a302aac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:02:55.375316 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d516adf-e303-41ae-96b4-36fa1a302aac service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:55.376133 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d516adf-e303-41ae-96b4-36fa1a302aac service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:55.376827 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d516adf-e303-41ae-96b4-36fa1a302aac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:55.378915 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-0d516adf-e303-41ae-96b4-36fa1a302aac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:02:55.506369 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d516adf-e303-41ae-96b4-36fa1a302aac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:02:55.508084 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d516adf-e303-41ae-96b4-36fa1a302aac service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:02:55.530455 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 662/1314] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:02:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:02:57.949021 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63287f-9b93-4ff4-8375-1405f633b990 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:57.949592 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63287f-9b93-4ff4-8375-1405f633b990 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:57.949592 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63287f-9b93-4ff4-8375-1405f633b990 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:57.950963 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 653/1315] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 06:02:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:02:57.956189 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d3b9a-0801-44fd-b96d-f3bc1f39d05b None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:57.956628 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d3b9a-0801-44fd-b96d-f3bc1f39d05b None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:57.956763 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d3b9a-0801-44fd-b96d-f3bc1f39d05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:58.019792 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-4c7d3b9a-0801-44fd-b96d-f3bc1f39d05b None None] MFA Rules not processed for user `d4a868efb70f4b3e8d5794974975fc27`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:02:58.021513 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-4c7d3b9a-0801-44fd-b96d-f3bc1f39d05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:02:58.074193 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:02:58.118832 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 663/1316] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 06:02:57 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:02:58.158241 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63287f-9b93-4ff4-8375-1405f633b990 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:02:58.159767 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-0d63287f-9b93-4ff4-8375-1405f633b990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:02:58.170164 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:02:58.264538 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63287f-9b93-4ff4-8375-1405f633b990 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:02:58.339085 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5e5b2-258e-4f5b-a4c6-45d1a4bda964 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:02:58.340241 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5e5b2-258e-4f5b-a4c6-45d1a4bda964 service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:58.340526 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5e5b2-258e-4f5b-a4c6-45d1a4bda964 service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:58.340832 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5e5b2-258e-4f5b-a4c6-45d1a4bda964 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:58.342756 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-d0f5e5b2-258e-4f5b-a4c6-45d1a4bda964 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:02:58.406307 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:02:58.452959 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f5e5b2-258e-4f5b-a4c6-45d1a4bda964 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:02:58.454432 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f5e5b2-258e-4f5b-a4c6-45d1a4bda964 service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:02:58.474985 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 654/1317] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:02:58 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:03:01.003573 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26568d-c2a6-4163-abb9-e96240e2245f None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:01.004127 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26568d-c2a6-4163-abb9-e96240e2245f None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:01.004127 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26568d-c2a6-4163-abb9-e96240e2245f None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:01.005570 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 664/1318] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 06:03:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:03:01.011107 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc4ebe-51ec-49be-8e4d-c448e29e8eb9 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:01.011550 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc4ebe-51ec-49be-8e4d-c448e29e8eb9 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:01.011652 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc4ebe-51ec-49be-8e4d-c448e29e8eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:01.074238 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-85fc4ebe-51ec-49be-8e4d-c448e29e8eb9 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:01.075410 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-85fc4ebe-51ec-49be-8e4d-c448e29e8eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:01.169156 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 655/1319] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 06:03:01 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:03:01.209291 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26568d-c2a6-4163-abb9-e96240e2245f None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:01.210968 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-bd26568d-c2a6-4163-abb9-e96240e2245f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:01.314143 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26568d-c2a6-4163-abb9-e96240e2245f None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:01.385065 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897e904d-4678-4ffd-bf12-9430c9941dbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:01.386436 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e904d-4678-4ffd-bf12-9430c9941dbd service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:01.386725 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e904d-4678-4ffd-bf12-9430c9941dbd service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:01.387003 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e904d-4678-4ffd-bf12-9430c9941dbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:01.388658 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-897e904d-4678-4ffd-bf12-9430c9941dbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:01.396056 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:01.498859 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897e904d-4678-4ffd-bf12-9430c9941dbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:01.500296 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897e904d-4678-4ffd-bf12-9430c9941dbd service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:01.518269 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 665/1320] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:03:01 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:03:04.249841 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c87066-22c7-428f-921d-fe3d22439967 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:04.250387 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c87066-22c7-428f-921d-fe3d22439967 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:04.250387 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c87066-22c7-428f-921d-fe3d22439967 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:04.251772 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 656/1321] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 06:03:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:03:04.256964 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b0f02-c619-4cab-a2b9-1660877e1699 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:04.257409 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b0f02-c619-4cab-a2b9-1660877e1699 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:04.257527 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b0f02-c619-4cab-a2b9-1660877e1699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:04.323978 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-968b0f02-c619-4cab-a2b9-1660877e1699 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:04.325216 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-968b0f02-c619-4cab-a2b9-1660877e1699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:04.388865 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:04.433585 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 666/1322] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 06:03:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:03:04.474339 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c87066-22c7-428f-921d-fe3d22439967 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:04.476023 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-81c87066-22c7-428f-921d-fe3d22439967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:04.497566 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:04.588774 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c87066-22c7-428f-921d-fe3d22439967 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:04.663787 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4de6ad6-77dc-4804-9cfe-b6724669eb78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:04.664441 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de6ad6-77dc-4804-9cfe-b6724669eb78 service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:04.664745 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de6ad6-77dc-4804-9cfe-b6724669eb78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:04.665026 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de6ad6-77dc-4804-9cfe-b6724669eb78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:04.667212 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-b4de6ad6-77dc-4804-9cfe-b6724669eb78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:04.738795 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:04.777952 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4de6ad6-77dc-4804-9cfe-b6724669eb78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:04.779316 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4de6ad6-77dc-4804-9cfe-b6724669eb78 service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:04.798008 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 657/1323] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:03:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:03:06.876362 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6354c28-7ad3-491b-90f1-dda0da8f07ce None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:06.876902 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6354c28-7ad3-491b-90f1-dda0da8f07ce None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:06.876902 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6354c28-7ad3-491b-90f1-dda0da8f07ce None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:06.878200 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 667/1324] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 06:03:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:03:06.883588 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8b07b8-3052-4112-a595-ff2ed4029239 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:06.883985 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8b07b8-3052-4112-a595-ff2ed4029239 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:06.884262 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8b07b8-3052-4112-a595-ff2ed4029239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:06.954999 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-ae8b07b8-3052-4112-a595-ff2ed4029239 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:06.956228 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-ae8b07b8-3052-4112-a595-ff2ed4029239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:07.055212 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 658/1325] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 06:03:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:03:07.093536 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6354c28-7ad3-491b-90f1-dda0da8f07ce None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:07.095219 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-b6354c28-7ad3-491b-90f1-dda0da8f07ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:07.201211 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6354c28-7ad3-491b-90f1-dda0da8f07ce None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:07.279447 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d49fae8-2991-4ff9-8067-457f6f4bf23a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:07.280116 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49fae8-2991-4ff9-8067-457f6f4bf23a service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:07.280398 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49fae8-2991-4ff9-8067-457f6f4bf23a service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:07.280671 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49fae8-2991-4ff9-8067-457f6f4bf23a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:07.282466 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-6d49fae8-2991-4ff9-8067-457f6f4bf23a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:07.303581 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:07.400102 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d49fae8-2991-4ff9-8067-457f6f4bf23a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:07.402331 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d49fae8-2991-4ff9-8067-457f6f4bf23a service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:07.420786 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 668/1326] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:03:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:03:09.588207 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cbd496-3bed-4668-9ecb-6a46e1cd3386 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:09.588891 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cbd496-3bed-4668-9ecb-6a46e1cd3386 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:09.588891 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cbd496-3bed-4668-9ecb-6a46e1cd3386 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:09.590197 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 659/1327] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 06:03:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:03:09.596147 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3db1e-765b-48f1-9d4b-270144c0ef59 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:09.596553 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3db1e-765b-48f1-9d4b-270144c0ef59 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:09.596790 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3db1e-765b-48f1-9d4b-270144c0ef59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:09.667404 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-c9d3db1e-765b-48f1-9d4b-270144c0ef59 None None] MFA Rules not processed for user `d4a868efb70f4b3e8d5794974975fc27`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:09.668615 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-c9d3db1e-765b-48f1-9d4b-270144c0ef59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:09.735892 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:09.770754 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 669/1328] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 06:03:09 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:03:09.822844 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330d713-8fa2-456b-8e27-52f4e109f73c None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:09.823126 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330d713-8fa2-456b-8e27-52f4e109f73c None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:09.823400 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330d713-8fa2-456b-8e27-52f4e109f73c None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:09.824807 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 660/1329] 10.222.0.39 () {54 vars in 964 bytes} [Mon Jun 20 06:03:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:03:09.830842 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963bc780-7ddf-4397-a9a6-5c176da7a883 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:09.831135 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963bc780-7ddf-4397-a9a6-5c176da7a883 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:09.831418 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963bc780-7ddf-4397-a9a6-5c176da7a883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:09.908758 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-963bc780-7ddf-4397-a9a6-5c176da7a883 None None] MFA Rules not processed for user `83e77cb05c4546c7a98ada817573edf3`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:09.909908 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-963bc780-7ddf-4397-a9a6-5c176da7a883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:09.989609 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 670/1330] 10.222.0.39 () {58 vars in 1061 bytes} [Mon Jun 20 06:03:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:03:09.999248 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0330d713-8fa2-456b-8e27-52f4e109f73c None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:10.000803 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-0330d713-8fa2-456b-8e27-52f4e109f73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:10.032044 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:10.107576 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0330d713-8fa2-456b-8e27-52f4e109f73c None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:10.195291 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a92dd8-8489-484b-aec9-098cb62badf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:10.196057 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a92dd8-8489-484b-aec9-098cb62badf8 service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:10.196420 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a92dd8-8489-484b-aec9-098cb62badf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:10.196798 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a92dd8-8489-484b-aec9-098cb62badf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:10.198901 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-44a92dd8-8489-484b-aec9-098cb62badf8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:10.281201 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:10.313338 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a92dd8-8489-484b-aec9-098cb62badf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:10.314761 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a92dd8-8489-484b-aec9-098cb62badf8 service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:10.332238 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 661/1331] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:03:09 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:03:13.000584 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90579ac8-dd27-4288-b88b-a9016743f02b None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:13.001182 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90579ac8-dd27-4288-b88b-a9016743f02b None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:13.001182 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90579ac8-dd27-4288-b88b-a9016743f02b None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:13.002552 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 671/1332] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 06:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:03:13.007643 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88294fe-8f2b-440f-bca2-1d7dbe0178de None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:13.008029 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88294fe-8f2b-440f-bca2-1d7dbe0178de None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:13.008204 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88294fe-8f2b-440f-bca2-1d7dbe0178de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:13.073587 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-f88294fe-8f2b-440f-bca2-1d7dbe0178de None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:13.074793 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-f88294fe-8f2b-440f-bca2-1d7dbe0178de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:13.172100 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 662/1333] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 06:03:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:03:13.208665 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90579ac8-dd27-4288-b88b-a9016743f02b None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:13.210299 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-90579ac8-dd27-4288-b88b-a9016743f02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:13.281920 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:13.316215 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90579ac8-dd27-4288-b88b-a9016743f02b None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:13.388979 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcab560-1c72-4b0b-b084-93b264ea46c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:13.389631 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcab560-1c72-4b0b-b084-93b264ea46c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:13.389910 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcab560-1c72-4b0b-b084-93b264ea46c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:13.390188 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcab560-1c72-4b0b-b084-93b264ea46c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:13.391840 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-2dcab560-1c72-4b0b-b084-93b264ea46c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:13.501331 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcab560-1c72-4b0b-b084-93b264ea46c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:13.502768 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcab560-1c72-4b0b-b084-93b264ea46c8 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:13.512545 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:13.521148 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 672/1334] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:03:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:03:15.652289 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb0d69-82a9-415d-95cf-7cc57ca28f54 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:15.652901 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb0d69-82a9-415d-95cf-7cc57ca28f54 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:15.652901 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb0d69-82a9-415d-95cf-7cc57ca28f54 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:15.654465 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 663/1335] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 06:03:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:03:15.659511 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68241c-f027-4e5c-919b-0c5d71171d90 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:15.659935 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68241c-f027-4e5c-919b-0c5d71171d90 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:15.660067 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68241c-f027-4e5c-919b-0c5d71171d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:15.727235 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-da68241c-f027-4e5c-919b-0c5d71171d90 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:15.728887 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-da68241c-f027-4e5c-919b-0c5d71171d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:15.824137 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 673/1336] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 06:03:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:03:15.863547 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb0d69-82a9-415d-95cf-7cc57ca28f54 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:15.865129 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-92fb0d69-82a9-415d-95cf-7cc57ca28f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:15.906258 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:15.970458 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb0d69-82a9-415d-95cf-7cc57ca28f54 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:16.042940 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e808151-04f6-4085-9fdd-274cd3712390 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:16.043518 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e808151-04f6-4085-9fdd-274cd3712390 service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:16.043800 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e808151-04f6-4085-9fdd-274cd3712390 service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:16.044075 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e808151-04f6-4085-9fdd-274cd3712390 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:16.045729 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-2e808151-04f6-4085-9fdd-274cd3712390 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:16.129793 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:16.156313 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e808151-04f6-4085-9fdd-274cd3712390 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:16.157777 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e808151-04f6-4085-9fdd-274cd3712390 service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:16.175844 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 664/1337] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:03:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:03:18.699872 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177428fc-c7b3-4aa2-a34c-f5c9b27647b7 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:18.700342 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177428fc-c7b3-4aa2-a34c-f5c9b27647b7 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:18.700455 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177428fc-c7b3-4aa2-a34c-f5c9b27647b7 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:18.702047 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 674/1338] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 06:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:03:18.707792 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f01a7-f21a-444e-88dd-1f25474df85d None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:18.708216 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f01a7-f21a-444e-88dd-1f25474df85d None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:18.708375 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f01a7-f21a-444e-88dd-1f25474df85d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:18.777665 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-f20f01a7-f21a-444e-88dd-1f25474df85d None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:18.778966 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-f20f01a7-f21a-444e-88dd-1f25474df85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:18.890970 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 665/1339] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 06:03:18 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:03:18.927315 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177428fc-c7b3-4aa2-a34c-f5c9b27647b7 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:18.928894 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-177428fc-c7b3-4aa2-a34c-f5c9b27647b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:19.005200 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:19.032980 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177428fc-c7b3-4aa2-a34c-f5c9b27647b7 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:19.106737 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958e4f3-ae67-49c2-9660-293625ea6dc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:19.107377 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958e4f3-ae67-49c2-9660-293625ea6dc9 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:19.107656 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958e4f3-ae67-49c2-9660-293625ea6dc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:19.107924 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958e4f3-ae67-49c2-9660-293625ea6dc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:19.109597 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-7958e4f3-ae67-49c2-9660-293625ea6dc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:19.216028 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7958e4f3-ae67-49c2-9660-293625ea6dc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:19.217482 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7958e4f3-ae67-49c2-9660-293625ea6dc9 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:19.239012 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 675/1340] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:03:18 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:03:23.469932 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc5571-03a5-4c05-949e-e447b71706a3 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:23.470447 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc5571-03a5-4c05-949e-e447b71706a3 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:23.470543 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc5571-03a5-4c05-949e-e447b71706a3 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:23.471855 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 666/1341] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 06:03:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:03:23.477339 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc95e94-b099-42ea-8fb0-e4912faac19b None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:23.477783 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc95e94-b099-42ea-8fb0-e4912faac19b None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:23.478152 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc95e94-b099-42ea-8fb0-e4912faac19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:23.484993 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:23.566911 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-fcc95e94-b099-42ea-8fb0-e4912faac19b None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:23.568877 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-fcc95e94-b099-42ea-8fb0-e4912faac19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:23.681961 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 676/1342] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 06:03:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:03:23.722151 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc5571-03a5-4c05-949e-e447b71706a3 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:23.724301 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-c0dc5571-03a5-4c05-949e-e447b71706a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:23.779000 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:23.836419 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc5571-03a5-4c05-949e-e447b71706a3 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:23.840172 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a258709e-8a0d-4f6f-8d21-618a2ebe762f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:23.840842 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258709e-8a0d-4f6f-8d21-618a2ebe762f service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:23.841146 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258709e-8a0d-4f6f-8d21-618a2ebe762f service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:23.841423 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258709e-8a0d-4f6f-8d21-618a2ebe762f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:23.850623 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a258709e-8a0d-4f6f-8d21-618a2ebe762f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:23.852071 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a258709e-8a0d-4f6f-8d21-618a2ebe762f service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:23.862395 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 667/1343] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:03:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:03:26.571204 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604bedc-a376-4222-a51d-a332f4066de5 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:26.571755 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604bedc-a376-4222-a51d-a332f4066de5 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:26.571755 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604bedc-a376-4222-a51d-a332f4066de5 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:26.573191 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 677/1344] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 06:03:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:03:26.578503 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3b199-6fcb-4afd-9ba3-e7d6f23c48a9 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:26.578904 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3b199-6fcb-4afd-9ba3-e7d6f23c48a9 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:26.579180 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3b199-6fcb-4afd-9ba3-e7d6f23c48a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:26.610832 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-41f3b199-6fcb-4afd-9ba3-e7d6f23c48a9 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:26.612043 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-41f3b199-6fcb-4afd-9ba3-e7d6f23c48a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:26.696333 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 668/1345] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 06:03:26 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:03:26.734454 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a604bedc-a376-4222-a51d-a332f4066de5 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:26.746049 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a604bedc-a376-4222-a51d-a332f4066de5 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:26.749731 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c784732-697c-48f9-9162-28642f969885 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:26.750620 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c784732-697c-48f9-9162-28642f969885 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:26.750905 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c784732-697c-48f9-9162-28642f969885 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:26.751179 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c784732-697c-48f9-9162-28642f969885 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:26.762203 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c784732-697c-48f9-9162-28642f969885 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:26.763648 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c784732-697c-48f9-9162-28642f969885 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:26.773418 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 678/1346] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:03:26 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:03:30.884550 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c7fd72-6a83-4d38-a45a-150269ba4be3 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:30.885148 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c7fd72-6a83-4d38-a45a-150269ba4be3 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:30.885148 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c7fd72-6a83-4d38-a45a-150269ba4be3 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:30.886491 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 669/1347] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 06:03:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:03:30.891850 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe23cf-7bad-4d40-b4f0-ebf6e5ea1d27 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:30.892323 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe23cf-7bad-4d40-b4f0-ebf6e5ea1d27 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:30.892538 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe23cf-7bad-4d40-b4f0-ebf6e5ea1d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:30.914448 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-41fe23cf-7bad-4d40-b4f0-ebf6e5ea1d27 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:30.915776 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-41fe23cf-7bad-4d40-b4f0-ebf6e5ea1d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:30.924139 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 679/1348] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 06:03:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:03:30.964352 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c7fd72-6a83-4d38-a45a-150269ba4be3 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:30.975970 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c7fd72-6a83-4d38-a45a-150269ba4be3 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:30.980885 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962fa4a2-dd3b-4586-b271-b54639fdffc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:30.981531 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962fa4a2-dd3b-4586-b271-b54639fdffc0 service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:30.981809 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962fa4a2-dd3b-4586-b271-b54639fdffc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:30.982081 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962fa4a2-dd3b-4586-b271-b54639fdffc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:30.992504 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962fa4a2-dd3b-4586-b271-b54639fdffc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:30.993969 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962fa4a2-dd3b-4586-b271-b54639fdffc0 service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:31.004145 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 670/1349] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:03:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:03:36.473228 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a474176-4fed-44f3-af81-432315385af5 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:36.473737 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a474176-4fed-44f3-af81-432315385af5 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:36.473822 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a474176-4fed-44f3-af81-432315385af5 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:36.475565 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 680/1350] 10.222.0.39 () {54 vars in 921 bytes} [Mon Jun 20 06:03:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:03:36.481769 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ffa761-bd84-4132-b6ca-e5f7b3671e7e None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:36.482610 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ffa761-bd84-4132-b6ca-e5f7b3671e7e None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:36.483099 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ffa761-bd84-4132-b6ca-e5f7b3671e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:36.569317 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-c5ffa761-bd84-4132-b6ca-e5f7b3671e7e None None] MFA Rules not processed for user `6f0f9248178049cda6571fa365a21225`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:36.570733 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-c5ffa761-bd84-4132-b6ca-e5f7b3671e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:36.617050 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:36.705250 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 671/1351] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Jun 20 06:03:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:03:40.888488 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6bc73e-23f5-4994-9977-5f236b177094 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:40.889083 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6bc73e-23f5-4994-9977-5f236b177094 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:40.889083 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6bc73e-23f5-4994-9977-5f236b177094 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:40.890372 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 681/1352] 10.222.0.39 () {54 vars in 921 bytes} [Mon Jun 20 06:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:03:40.895653 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1234c-83ef-4fc7-baff-eee20366e14e None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:40.896502 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1234c-83ef-4fc7-baff-eee20366e14e None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:40.897078 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1234c-83ef-4fc7-baff-eee20366e14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:40.908943 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=72 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:40.918239 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-0ba1234c-83ef-4fc7-baff-eee20366e14e None None] MFA Rules not processed for user `6f0f9248178049cda6571fa365a21225`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:40.919437 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-0ba1234c-83ef-4fc7-baff-eee20366e14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:40.928742 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 672/1353] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Jun 20 06:03:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:03:42.542259 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2506a-b81e-4722-8b13-800efc63a835 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:42.542793 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2506a-b81e-4722-8b13-800efc63a835 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:42.543003 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2506a-b81e-4722-8b13-800efc63a835 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:42.544606 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 682/1354] 10.222.0.39 () {54 vars in 921 bytes} [Mon Jun 20 06:03:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:03:42.549819 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1bafc1-41df-4678-b553-f774edbfe3e3 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:42.550251 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1bafc1-41df-4678-b553-f774edbfe3e3 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:42.550420 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1bafc1-41df-4678-b553-f774edbfe3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:42.570027 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-0a1bafc1-41df-4678-b553-f774edbfe3e3 None None] MFA Rules not processed for user `6f0f9248178049cda6571fa365a21225`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:42.571234 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-0a1bafc1-41df-4678-b553-f774edbfe3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:42.580128 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 673/1355] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Jun 20 06:03:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:03:46.260233 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63df17-8abf-4e4d-9a3b-3b6648e1d0f1 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:46.260804 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63df17-8abf-4e4d-9a3b-3b6648e1d0f1 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:46.262259 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63df17-8abf-4e4d-9a3b-3b6648e1d0f1 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:46.265777 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 683/1356] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 06:03:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:03:46.271057 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c10fa-ec27-44d3-8025-b60eddaca5ce None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:46.271562 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c10fa-ec27-44d3-8025-b60eddaca5ce None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:46.271643 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c10fa-ec27-44d3-8025-b60eddaca5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:46.292636 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-4e1c10fa-ec27-44d3-8025-b60eddaca5ce None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:46.294156 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-4e1c10fa-ec27-44d3-8025-b60eddaca5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:46.306378 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 674/1357] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 06:03:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:03:46.375061 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6089d19-9dac-42d2-babd-ad52a20852c4 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:46.375656 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6089d19-9dac-42d2-babd-ad52a20852c4 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:46.376091 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6089d19-9dac-42d2-babd-ad52a20852c4 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:46.378028 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 684/1358] 10.222.0.39 () {54 vars in 961 bytes} [Mon Jun 20 06:03:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:03:46.387565 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e725c-45b7-4196-9e76-f172ee3ffc63 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:46.387917 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e725c-45b7-4196-9e76-f172ee3ffc63 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:46.388136 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e725c-45b7-4196-9e76-f172ee3ffc63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:46.449810 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-0e7e725c-45b7-4196-9e76-f172ee3ffc63 None None] MFA Rules not processed for user `3cee106502e54829ad802ee41c9165fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:46.451124 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-0e7e725c-45b7-4196-9e76-f172ee3ffc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:46.554867 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 675/1359] 10.222.0.39 () {58 vars in 1058 bytes} [Mon Jun 20 06:03:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:03:46.564499 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6089d19-9dac-42d2-babd-ad52a20852c4 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:46.582267 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6089d19-9dac-42d2-babd-ad52a20852c4 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:46.588504 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6879e890-918a-4b11-9f12-22110de18dff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cee106502e54829ad802ee41c9165fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:46.589208 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879e890-918a-4b11-9f12-22110de18dff service nova] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:46.589494 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879e890-918a-4b11-9f12-22110de18dff service nova] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:46.589771 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879e890-918a-4b11-9f12-22110de18dff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:46.598338 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6879e890-918a-4b11-9f12-22110de18dff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:46.599975 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6879e890-918a-4b11-9f12-22110de18dff service nova] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:46.611519 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 685/1360] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:03:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:03:48.874861 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534650d-df51-4298-8d54-0a0194a9151a None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:48.875409 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534650d-df51-4298-8d54-0a0194a9151a None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:48.875409 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534650d-df51-4298-8d54-0a0194a9151a None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:48.876990 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 676/1361] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 06:03:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:03:48.882217 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6e2a0-e1b6-4747-b5e0-23ec3b24c133 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:48.882658 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6e2a0-e1b6-4747-b5e0-23ec3b24c133 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:48.882753 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6e2a0-e1b6-4747-b5e0-23ec3b24c133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:48.900153 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-4cc6e2a0-e1b6-4747-b5e0-23ec3b24c133 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:48.901360 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-4cc6e2a0-e1b6-4747-b5e0-23ec3b24c133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:48.909212 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 686/1362] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 06:03:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:03:48.954077 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9534650d-df51-4298-8d54-0a0194a9151a None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:48.971902 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9534650d-df51-4298-8d54-0a0194a9151a None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:48.979082 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58fbd8e-4e11-490d-8999-8b0d250bf64b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cee106502e54829ad802ee41c9165fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:48.980035 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fbd8e-4e11-490d-8999-8b0d250bf64b service nova] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:48.980396 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fbd8e-4e11-490d-8999-8b0d250bf64b service nova] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:48.980790 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fbd8e-4e11-490d-8999-8b0d250bf64b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:48.992447 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58fbd8e-4e11-490d-8999-8b0d250bf64b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:48.994101 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58fbd8e-4e11-490d-8999-8b0d250bf64b service nova] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:49.005330 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 677/1363] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:03:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:03:51.428072 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196be5b-c147-4b3d-9219-82878b56963f None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:51.428984 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196be5b-c147-4b3d-9219-82878b56963f None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:51.429266 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196be5b-c147-4b3d-9219-82878b56963f None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:51.430724 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 687/1364] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 06:03:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:03:51.436436 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415eaf02-a6eb-4a52-aa91-c771ccbdacc7 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:51.436860 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415eaf02-a6eb-4a52-aa91-c771ccbdacc7 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:51.437218 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415eaf02-a6eb-4a52-aa91-c771ccbdacc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:51.462144 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-415eaf02-a6eb-4a52-aa91-c771ccbdacc7 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:51.463366 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-415eaf02-a6eb-4a52-aa91-c771ccbdacc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:51.471748 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 678/1365] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 06:03:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:03:51.530566 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82e010-68cf-4df3-8ff9-9ad59ebe299f None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:51.531119 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82e010-68cf-4df3-8ff9-9ad59ebe299f None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:51.531783 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82e010-68cf-4df3-8ff9-9ad59ebe299f None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:51.534099 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 688/1366] 10.222.0.39 () {54 vars in 961 bytes} [Mon Jun 20 06:03:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:03:51.543731 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03816f33-6f2c-4453-a995-c25cef2b9d78 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:51.544020 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03816f33-6f2c-4453-a995-c25cef2b9d78 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:51.544481 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03816f33-6f2c-4453-a995-c25cef2b9d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:51.565652 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-03816f33-6f2c-4453-a995-c25cef2b9d78 None None] MFA Rules not processed for user `3cee106502e54829ad802ee41c9165fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:51.566851 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-03816f33-6f2c-4453-a995-c25cef2b9d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:51.576688 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 679/1367] 10.222.0.39 () {58 vars in 1058 bytes} [Mon Jun 20 06:03:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:03:51.585412 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc82e010-68cf-4df3-8ff9-9ad59ebe299f None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:51.599598 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc82e010-68cf-4df3-8ff9-9ad59ebe299f None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:51.605776 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4140241c-513e-4041-a133-e7ae1a27d24d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cee106502e54829ad802ee41c9165fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:51.606446 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140241c-513e-4041-a133-e7ae1a27d24d service nova] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:51.606723 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140241c-513e-4041-a133-e7ae1a27d24d service nova] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:51.607005 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140241c-513e-4041-a133-e7ae1a27d24d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:51.615561 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4140241c-513e-4041-a133-e7ae1a27d24d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:51.617200 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4140241c-513e-4041-a133-e7ae1a27d24d service nova] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:51.626554 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 689/1368] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:03:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:03:53.775431 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a668b7-0ba3-41ce-9943-4258c9cfff5a None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:53.775964 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a668b7-0ba3-41ce-9943-4258c9cfff5a None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:53.775964 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a668b7-0ba3-41ce-9943-4258c9cfff5a None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:53.777367 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 680/1369] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 06:03:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:03:53.782807 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf7f11-a7c7-4942-978a-997686d9595f None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:53.783221 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf7f11-a7c7-4942-978a-997686d9595f None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:53.783398 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf7f11-a7c7-4942-978a-997686d9595f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:53.803579 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-b6bf7f11-a7c7-4942-978a-997686d9595f None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:53.805101 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-b6bf7f11-a7c7-4942-978a-997686d9595f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:53.814246 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 690/1370] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 06:03:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:03:53.866264 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a668b7-0ba3-41ce-9943-4258c9cfff5a None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:53.881552 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a668b7-0ba3-41ce-9943-4258c9cfff5a None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:53.887090 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ccd173-236f-46a5-9712-facb26bfb0bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cee106502e54829ad802ee41c9165fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:53.887850 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccd173-236f-46a5-9712-facb26bfb0bc service nova] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:53.888229 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccd173-236f-46a5-9712-facb26bfb0bc service nova] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:53.888598 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccd173-236f-46a5-9712-facb26bfb0bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:53.909398 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ccd173-236f-46a5-9712-facb26bfb0bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:53.912545 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ccd173-236f-46a5-9712-facb26bfb0bc service nova] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:53.932416 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 681/1371] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:03:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:03:54.634390 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c54552-3404-4a82-9128-689a55992a80 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:54.635226 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c54552-3404-4a82-9128-689a55992a80 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:54.635567 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c54552-3404-4a82-9128-689a55992a80 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:54.637170 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 691/1372] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 06:03:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:03:54.642793 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa70752-a994-461a-a80f-53540dbd5ac4 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:54.643086 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa70752-a994-461a-a80f-53540dbd5ac4 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:54.643368 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa70752-a994-461a-a80f-53540dbd5ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:54.663610 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-1fa70752-a994-461a-a80f-53540dbd5ac4 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:54.664885 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-1fa70752-a994-461a-a80f-53540dbd5ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:54.673513 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 682/1373] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 06:03:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:03:54.994006 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b3147-7a51-4b82-9c08-ab8b569058a6 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:54.994648 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b3147-7a51-4b82-9c08-ab8b569058a6 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:54.994648 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b3147-7a51-4b82-9c08-ab8b569058a6 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:54.996095 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 692/1374] 10.222.0.39 () {54 vars in 963 bytes} [Mon Jun 20 06:03:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:03:55.002082 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adea6d5-a70e-4d03-8ba6-57cdb27f06f8 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:55.002649 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adea6d5-a70e-4d03-8ba6-57cdb27f06f8 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:55.002649 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adea6d5-a70e-4d03-8ba6-57cdb27f06f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:55.010693 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:55.056631 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-2adea6d5-a70e-4d03-8ba6-57cdb27f06f8 None None] MFA Rules not processed for user `19bd2ac77c5d48d49b58712f4025e279`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:55.058029 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-2adea6d5-a70e-4d03-8ba6-57cdb27f06f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:55.138013 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 683/1375] 10.222.0.39 () {58 vars in 1060 bytes} [Mon Jun 20 06:03:55 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:03:55.145592 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3b3147-7a51-4b82-9c08-ab8b569058a6 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:55.158266 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3b3147-7a51-4b82-9c08-ab8b569058a6 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:55.161981 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7951b33-05b7-4f93-9881-4fb6699195d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:55.162636 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7951b33-05b7-4f93-9881-4fb6699195d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:55.162981 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7951b33-05b7-4f93-9881-4fb6699195d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:55.163267 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7951b33-05b7-4f93-9881-4fb6699195d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:55.173905 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7951b33-05b7-4f93-9881-4fb6699195d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:55.175473 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7951b33-05b7-4f93-9881-4fb6699195d5 service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:55.187554 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 693/1376] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:03:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:03:56.089556 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f1367-30f8-481b-bf5f-bbbfd5ade99a None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:56.090046 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f1367-30f8-481b-bf5f-bbbfd5ade99a None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:56.090046 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f1367-30f8-481b-bf5f-bbbfd5ade99a None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:56.097266 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 684/1377] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 06:03:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:03:56.098420 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982fafed-1a22-4c54-9450-4e3cac538be2 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:56.099010 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982fafed-1a22-4c54-9450-4e3cac538be2 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:56.099992 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982fafed-1a22-4c54-9450-4e3cac538be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:56.135533 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-982fafed-1a22-4c54-9450-4e3cac538be2 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:56.138604 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-982fafed-1a22-4c54-9450-4e3cac538be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:56.153186 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 694/1378] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 06:03:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:03:56.199858 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f1367-30f8-481b-bf5f-bbbfd5ade99a None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:56.215999 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f1367-30f8-481b-bf5f-bbbfd5ade99a None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:56.223562 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44bc881-0499-4566-a219-e5cc56d9c2b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cee106502e54829ad802ee41c9165fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:56.224208 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44bc881-0499-4566-a219-e5cc56d9c2b4 service nova] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:56.224487 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44bc881-0499-4566-a219-e5cc56d9c2b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:56.224789 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44bc881-0499-4566-a219-e5cc56d9c2b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:56.238918 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44bc881-0499-4566-a219-e5cc56d9c2b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:56.242801 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44bc881-0499-4566-a219-e5cc56d9c2b4 service nova] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:56.260959 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 685/1379] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:03:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:03:58.366582 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b40350-f4ef-48e7-95dc-9d603f4c4fdf None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:58.368366 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b40350-f4ef-48e7-95dc-9d603f4c4fdf None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:58.368857 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b40350-f4ef-48e7-95dc-9d603f4c4fdf None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:58.370726 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 695/1380] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 06:03:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:03:58.376461 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15081c7-e5b1-4c0d-a6ac-c9f293792d1b None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:58.377380 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15081c7-e5b1-4c0d-a6ac-c9f293792d1b None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:58.377668 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15081c7-e5b1-4c0d-a6ac-c9f293792d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:58.396513 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-f15081c7-e5b1-4c0d-a6ac-c9f293792d1b None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:58.397648 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-f15081c7-e5b1-4c0d-a6ac-c9f293792d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:58.405741 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 686/1381] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 06:03:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:03:58.450542 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b40350-f4ef-48e7-95dc-9d603f4c4fdf None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:58.465888 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b40350-f4ef-48e7-95dc-9d603f4c4fdf None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:58.471607 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992cb309-b4ae-4054-b09e-eaa98e4b8dee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cee106502e54829ad802ee41c9165fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:58.472280 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992cb309-b4ae-4054-b09e-eaa98e4b8dee service nova] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:58.472564 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992cb309-b4ae-4054-b09e-eaa98e4b8dee service nova] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:58.472901 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992cb309-b4ae-4054-b09e-eaa98e4b8dee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:58.482069 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992cb309-b4ae-4054-b09e-eaa98e4b8dee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:58.483638 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992cb309-b4ae-4054-b09e-eaa98e4b8dee service nova] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:58.493009 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 696/1382] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:03:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:04:00.622438 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a9e3f-74db-43e4-ab58-e4bbbc1b1381 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:00.623395 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a9e3f-74db-43e4-ab58-e4bbbc1b1381 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:00.623806 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a9e3f-74db-43e4-ab58-e4bbbc1b1381 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:00.625530 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 687/1383] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 06:04:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:04:00.634945 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb451c-194c-47bf-afa2-c9b9e241792e None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:00.635478 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb451c-194c-47bf-afa2-c9b9e241792e None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:00.635932 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb451c-194c-47bf-afa2-c9b9e241792e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:00.657447 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-f7bb451c-194c-47bf-afa2-c9b9e241792e None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:04:00.658701 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-f7bb451c-194c-47bf-afa2-c9b9e241792e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:04:00.667301 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 697/1384] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 06:04:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:04:00.710379 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a9e3f-74db-43e4-ab58-e4bbbc1b1381 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:04:00.725787 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a9e3f-74db-43e4-ab58-e4bbbc1b1381 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:04:00.732591 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e88e212-19c3-4b4b-a04b-f257141a25e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cee106502e54829ad802ee41c9165fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:04:00.733505 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88e212-19c3-4b4b-a04b-f257141a25e7 service nova] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:00.733976 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88e212-19c3-4b4b-a04b-f257141a25e7 service nova] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:00.734350 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88e212-19c3-4b4b-a04b-f257141a25e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:00.745005 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e88e212-19c3-4b4b-a04b-f257141a25e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:04:00.746698 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e88e212-19c3-4b4b-a04b-f257141a25e7 service nova] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:04:00.758366 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 688/1385] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:04:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:04:02.885724 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf19d3-9a82-4a35-a2a5-613357f00b0e None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:02.886373 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf19d3-9a82-4a35-a2a5-613357f00b0e None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:02.886373 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf19d3-9a82-4a35-a2a5-613357f00b0e None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:02.888080 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 698/1386] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 06:04:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:04:02.893198 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef309e60-103d-4f86-9f2e-e6638a92a193 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:02.893198 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef309e60-103d-4f86-9f2e-e6638a92a193 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:02.893198 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef309e60-103d-4f86-9f2e-e6638a92a193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:02.914415 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-ef309e60-103d-4f86-9f2e-e6638a92a193 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:04:02.915174 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-ef309e60-103d-4f86-9f2e-e6638a92a193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:04:02.937460 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 689/1387] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 06:04:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:04:02.971669 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf19d3-9a82-4a35-a2a5-613357f00b0e None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:04:02.991069 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf19d3-9a82-4a35-a2a5-613357f00b0e None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:04:02.997115 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3581121f-33ed-44cb-90a9-0d74707792e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cee106502e54829ad802ee41c9165fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:04:02.997845 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581121f-33ed-44cb-90a9-0d74707792e1 service nova] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:02.998203 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581121f-33ed-44cb-90a9-0d74707792e1 service nova] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:02.998489 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581121f-33ed-44cb-90a9-0d74707792e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:03.008305 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3581121f-33ed-44cb-90a9-0d74707792e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:04:03.009187 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3581121f-33ed-44cb-90a9-0d74707792e1 service nova] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:04:03.020599 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 699/1388] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:04:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:04:05.544514 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e423e-05d6-45dc-aba7-2293ed689ca0 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:05.545121 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e423e-05d6-45dc-aba7-2293ed689ca0 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:05.545121 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e423e-05d6-45dc-aba7-2293ed689ca0 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:05.546526 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 690/1389] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 06:04:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:04:05.551840 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b6bf6-f082-4114-b816-f45ca0307438 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:05.552345 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b6bf6-f082-4114-b816-f45ca0307438 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:05.552517 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b6bf6-f082-4114-b816-f45ca0307438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:05.570503 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-cf9b6bf6-f082-4114-b816-f45ca0307438 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:04:05.571696 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-cf9b6bf6-f082-4114-b816-f45ca0307438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:04:05.580287 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 700/1390] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 06:04:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:04:05.624199 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e423e-05d6-45dc-aba7-2293ed689ca0 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:04:05.640007 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e423e-05d6-45dc-aba7-2293ed689ca0 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:04:05.645657 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984bc7d2-244b-4e86-b45a-7e0363a29c0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cee106502e54829ad802ee41c9165fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:04:05.646329 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984bc7d2-244b-4e86-b45a-7e0363a29c0c service nova] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:05.646616 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984bc7d2-244b-4e86-b45a-7e0363a29c0c service nova] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:05.646898 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984bc7d2-244b-4e86-b45a-7e0363a29c0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:05.655478 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984bc7d2-244b-4e86-b45a-7e0363a29c0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:04:05.657134 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984bc7d2-244b-4e86-b45a-7e0363a29c0c service nova] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:04:05.667096 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 691/1391] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:04:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:04:07.894289 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f31bd1-afac-471a-aaa6-b18a43715578 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:07.894845 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f31bd1-afac-471a-aaa6-b18a43715578 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:07.894845 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f31bd1-afac-471a-aaa6-b18a43715578 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:07.896431 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 701/1392] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 06:04:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 06:04:07.903090 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e16ebd-8496-40cf-88b4-7fd9981e8ffd None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:07.903513 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e16ebd-8496-40cf-88b4-7fd9981e8ffd None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:07.903699 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e16ebd-8496-40cf-88b4-7fd9981e8ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:07.923519 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-c1e16ebd-8496-40cf-88b4-7fd9981e8ffd None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:04:07.924911 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-c1e16ebd-8496-40cf-88b4-7fd9981e8ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:04:07.934796 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 692/1393] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 06:04:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:04:07.992943 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f31bd1-afac-471a-aaa6-b18a43715578 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:04:08.007883 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f31bd1-afac-471a-aaa6-b18a43715578 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:04:08.014068 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa06cea-5125-40fa-a81a-d5b864da7798 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cee106502e54829ad802ee41c9165fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:04:08.014701 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa06cea-5125-40fa-a81a-d5b864da7798 service nova] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:08.014978 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa06cea-5125-40fa-a81a-d5b864da7798 service nova] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:08.015278 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa06cea-5125-40fa-a81a-d5b864da7798 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:08.023693 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa06cea-5125-40fa-a81a-d5b864da7798 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:04:08.025294 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa06cea-5125-40fa-a81a-d5b864da7798 service nova] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:04:08.035295 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 702/1394] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:04:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:04:10.135087 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4290a4-3ed1-4ba0-b615-d832f1310759 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:10.135710 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4290a4-3ed1-4ba0-b615-d832f1310759 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:10.135710 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4290a4-3ed1-4ba0-b615-d832f1310759 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:10.138831 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 693/1395] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 06:04:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:04:10.142956 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2fd6c0-2eed-48c7-aa3c-f7c619004e78 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:10.143361 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2fd6c0-2eed-48c7-aa3c-f7c619004e78 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:10.143633 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2fd6c0-2eed-48c7-aa3c-f7c619004e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:10.161638 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-2c2fd6c0-2eed-48c7-aa3c-f7c619004e78 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:04:10.162819 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-2c2fd6c0-2eed-48c7-aa3c-f7c619004e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:04:10.171207 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 703/1396] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 06:04:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:04:10.215746 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4290a4-3ed1-4ba0-b615-d832f1310759 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:04:10.231144 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4290a4-3ed1-4ba0-b615-d832f1310759 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:04:10.238393 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce90e5-7dbd-4322-a0b5-9440370a7b40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cee106502e54829ad802ee41c9165fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:04:10.239135 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce90e5-7dbd-4322-a0b5-9440370a7b40 service nova] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:10.239445 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce90e5-7dbd-4322-a0b5-9440370a7b40 service nova] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:10.239851 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce90e5-7dbd-4322-a0b5-9440370a7b40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:10.248610 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ce90e5-7dbd-4322-a0b5-9440370a7b40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:04:10.250248 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ce90e5-7dbd-4322-a0b5-9440370a7b40 service nova] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:04:10.259658 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 694/1397] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:04:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:04:10.633322 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f77fe3-07e5-4836-9290-009081fb7e15 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:10.633719 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f77fe3-07e5-4836-9290-009081fb7e15 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:10.633999 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f77fe3-07e5-4836-9290-009081fb7e15 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:10.635472 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 704/1398] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 06:04:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:04:10.641011 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa5301-b1db-4c19-bd62-9ece0e33bea2 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:10.641306 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa5301-b1db-4c19-bd62-9ece0e33bea2 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:10.641608 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa5301-b1db-4c19-bd62-9ece0e33bea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:10.659829 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-75aa5301-b1db-4c19-bd62-9ece0e33bea2 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:04:10.661172 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-75aa5301-b1db-4c19-bd62-9ece0e33bea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:04:10.669951 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 695/1399] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 06:04:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:04:10.726963 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b473969-9f58-48ab-8748-c57ac92160a3 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:10.727346 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b473969-9f58-48ab-8748-c57ac92160a3 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:10.727692 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b473969-9f58-48ab-8748-c57ac92160a3 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:10.729214 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 705/1400] 10.222.0.39 () {54 vars in 962 bytes} [Mon Jun 20 06:04:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:04:10.735267 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3fac8-41df-45b3-8cdb-3bc4b16a32b4 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:10.735555 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3fac8-41df-45b3-8cdb-3bc4b16a32b4 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:10.735856 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3fac8-41df-45b3-8cdb-3bc4b16a32b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:10.786151 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-88f3fac8-41df-45b3-8cdb-3bc4b16a32b4 None None] MFA Rules not processed for user `b9cb22811a754357ab9d839b70d44261`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:04:10.787321 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-88f3fac8-41df-45b3-8cdb-3bc4b16a32b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:04:10.819831 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:04:10.848516 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 696/1401] 10.222.0.39 () {58 vars in 1059 bytes} [Mon Jun 20 06:04:10 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:04:10.856819 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b473969-9f58-48ab-8748-c57ac92160a3 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:04:10.867345 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b473969-9f58-48ab-8748-c57ac92160a3 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:04:10.870828 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdedc796-85b2-4533-b79a-4d4740ee551c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cb22811a754357ab9d839b70d44261', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:04:10.872052 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdedc796-85b2-4533-b79a-4d4740ee551c service glance] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:10.872764 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdedc796-85b2-4533-b79a-4d4740ee551c service glance] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:10.873049 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdedc796-85b2-4533-b79a-4d4740ee551c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:10.881954 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdedc796-85b2-4533-b79a-4d4740ee551c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:04:10.883371 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdedc796-85b2-4533-b79a-4d4740ee551c service glance] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:04:10.893930 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 706/1402] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:04:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:04:11.619246 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31419d-9377-4819-af19-24df245ced67 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:11.619711 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31419d-9377-4819-af19-24df245ced67 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:11.619805 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31419d-9377-4819-af19-24df245ced67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:11.668987 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-1a31419d-9377-4819-af19-24df245ced67 None None] MFA Rules not processed for user `8c0f131484cb48d289cae1f473ec2fbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:04:11.670174 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-1a31419d-9377-4819-af19-24df245ced67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:04:11.737129 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 697/1403] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Jun 20 06:04:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:04:11.781695 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef73d7c-cea0-4f25-a4f4-d92882743dc4 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:11.782158 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef73d7c-cea0-4f25-a4f4-d92882743dc4 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:11.782267 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef73d7c-cea0-4f25-a4f4-d92882743dc4 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:11.783656 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 707/1404] 10.222.0.39 () {54 vars in 942 bytes} [Mon Jun 20 06:04:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:04:11.790202 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003dad8c-b31a-47e5-b780-965ffe4582d8 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:11.790501 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003dad8c-b31a-47e5-b780-965ffe4582d8 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:11.790779 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003dad8c-b31a-47e5-b780-965ffe4582d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:11.838864 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-003dad8c-b31a-47e5-b780-965ffe4582d8 None None] MFA Rules not processed for user `b2b490cf71bc468da5ea2be04239e33f`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:04:11.840042 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-003dad8c-b31a-47e5-b780-965ffe4582d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:04:11.911050 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 698/1405] 10.222.0.39 () {58 vars in 1039 bytes} [Mon Jun 20 06:04:11 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:04:11.920239 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef73d7c-cea0-4f25-a4f4-d92882743dc4 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:04:11.927953 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=61 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:04:11.935774 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef73d7c-cea0-4f25-a4f4-d92882743dc4 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:04:11.940784 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654549c4-412f-490d-92fd-6c994f2a77ee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b490cf71bc468da5ea2be04239e33f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:04:11.941431 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654549c4-412f-490d-92fd-6c994f2a77ee service swift] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:11.941718 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654549c4-412f-490d-92fd-6c994f2a77ee service swift] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:11.942022 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654549c4-412f-490d-92fd-6c994f2a77ee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:11.951262 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654549c4-412f-490d-92fd-6c994f2a77ee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:04:11.952867 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654549c4-412f-490d-92fd-6c994f2a77ee service swift] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:04:11.961110 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 708/1406] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Jun 20 06:04:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 06:04:12.377794 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00821b-aa4e-4229-8b13-4d958a51b241 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:12.378276 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00821b-aa4e-4229-8b13-4d958a51b241 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:12.378622 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00821b-aa4e-4229-8b13-4d958a51b241 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:12.383064 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 699/1407] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 06:04:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:04:12.385465 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c98a42-5ebf-440f-baea-0c365c5e6e84 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:12.386065 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c98a42-5ebf-440f-baea-0c365c5e6e84 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:12.386350 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c98a42-5ebf-440f-baea-0c365c5e6e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:12.405613 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-f8c98a42-5ebf-440f-baea-0c365c5e6e84 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:04:12.406875 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-f8c98a42-5ebf-440f-baea-0c365c5e6e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:04:12.415705 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 709/1408] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 06:04:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:04:12.462320 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a00821b-aa4e-4229-8b13-4d958a51b241 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:04:12.479353 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a00821b-aa4e-4229-8b13-4d958a51b241 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:04:12.485220 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708decc-a328-432e-b878-57c0333c8d97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cee106502e54829ad802ee41c9165fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:04:12.485867 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708decc-a328-432e-b878-57c0333c8d97 service nova] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:12.486147 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708decc-a328-432e-b878-57c0333c8d97 service nova] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:12.486428 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708decc-a328-432e-b878-57c0333c8d97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:12.497471 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5708decc-a328-432e-b878-57c0333c8d97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:04:12.499306 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5708decc-a328-432e-b878-57c0333c8d97 service nova] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:04:12.505152 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:04:12.522961 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 700/1409] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:04:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:04:22.399228 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=8 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:04:34.286480 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f9a60-abe3-4954-ab0e-7c2cfaa07a6a None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:34.287130 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f9a60-abe3-4954-ab0e-7c2cfaa07a6a None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:34.287130 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f9a60-abe3-4954-ab0e-7c2cfaa07a6a None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:34.288479 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 710/1410] 10.222.0.39 () {54 vars in 918 bytes} [Mon Jun 20 06:04:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:04:34.293648 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d995b1-7cb8-42f6-975c-f81958bdf896 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:34.294196 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d995b1-7cb8-42f6-975c-f81958bdf896 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:34.294196 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d995b1-7cb8-42f6-975c-f81958bdf896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:34.313248 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-96d995b1-7cb8-42f6-975c-f81958bdf896 None None] MFA Rules not processed for user `6f0f9248178049cda6571fa365a21225`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:04:34.314438 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-96d995b1-7cb8-42f6-975c-f81958bdf896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:04:34.323347 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 701/1411] 10.222.0.39 () {58 vars in 1015 bytes} [Mon Jun 20 06:04:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:04:34.338142 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106dc1cf-5161-4af0-a84b-e43cf05b744c None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:34.338464 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106dc1cf-5161-4af0-a84b-e43cf05b744c None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:34.338771 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106dc1cf-5161-4af0-a84b-e43cf05b744c None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:34.340134 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 711/1412] 10.222.0.39 () {54 vars in 918 bytes} [Mon Jun 20 06:04:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:04:34.344989 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b89366-8463-40f8-ad25-1fdc8796239c None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:34.345280 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b89366-8463-40f8-ad25-1fdc8796239c None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:34.345557 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b89366-8463-40f8-ad25-1fdc8796239c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:34.365030 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-80b89366-8463-40f8-ad25-1fdc8796239c None None] MFA Rules not processed for user `3cee106502e54829ad802ee41c9165fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:04:34.367144 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-80b89366-8463-40f8-ad25-1fdc8796239c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:04:34.376219 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 702/1413] 10.222.0.39 () {58 vars in 1015 bytes} [Mon Jun 20 06:04:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:04:36.939235 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d08b5-2a95-4637-8d13-024059477eb9 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:36.939789 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d08b5-2a95-4637-8d13-024059477eb9 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:36.939789 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d08b5-2a95-4637-8d13-024059477eb9 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:36.941286 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 712/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 06:04:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:04:36.946787 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127a6bc-d484-431f-a10f-9cc2d2d9d465 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:36.947199 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127a6bc-d484-431f-a10f-9cc2d2d9d465 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:36.947355 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127a6bc-d484-431f-a10f-9cc2d2d9d465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:36.966041 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-3127a6bc-d484-431f-a10f-9cc2d2d9d465 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:04:36.967225 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-3127a6bc-d484-431f-a10f-9cc2d2d9d465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:04:36.976181 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 703/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 06:04:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:04:37.018917 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d08b5-2a95-4637-8d13-024059477eb9 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:04:37.034025 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d08b5-2a95-4637-8d13-024059477eb9 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:04:37.040322 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5014e7dd-4498-4c89-ac2c-6caa13ad29de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cee106502e54829ad802ee41c9165fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:04:37.040985 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014e7dd-4498-4c89-ac2c-6caa13ad29de service nova] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:37.041273 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014e7dd-4498-4c89-ac2c-6caa13ad29de service nova] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:37.041551 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014e7dd-4498-4c89-ac2c-6caa13ad29de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:37.049564 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5014e7dd-4498-4c89-ac2c-6caa13ad29de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:04:37.051693 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5014e7dd-4498-4c89-ac2c-6caa13ad29de service nova] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:04:37.060947 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 713/1416] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:04:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:04:37.987721 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c97dd-4280-4a50-99d3-62655fd77271 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:37.988271 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c97dd-4280-4a50-99d3-62655fd77271 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:37.988271 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c97dd-4280-4a50-99d3-62655fd77271 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:37.989738 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 704/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 06:04:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:04:37.994790 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293b684-8c7b-4e51-bf93-1d5fb57fa610 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:37.995198 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293b684-8c7b-4e51-bf93-1d5fb57fa610 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:37.995351 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293b684-8c7b-4e51-bf93-1d5fb57fa610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:38.013691 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-5293b684-8c7b-4e51-bf93-1d5fb57fa610 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:04:38.014884 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-5293b684-8c7b-4e51-bf93-1d5fb57fa610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:04:38.023313 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 714/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 06:04:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:04:38.172165 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c97dd-4280-4a50-99d3-62655fd77271 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:04:38.186660 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c97dd-4280-4a50-99d3-62655fd77271 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:04:38.192756 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4fee2c-2e1a-454c-ab3e-ca50159c189d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cee106502e54829ad802ee41c9165fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:04:38.193337 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fee2c-2e1a-454c-ab3e-ca50159c189d service nova] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:38.193618 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fee2c-2e1a-454c-ab3e-ca50159c189d service nova] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:38.193893 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fee2c-2e1a-454c-ab3e-ca50159c189d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:38.202406 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4fee2c-2e1a-454c-ab3e-ca50159c189d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:04:38.203984 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4fee2c-2e1a-454c-ab3e-ca50159c189d service nova] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:04:38.214327 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 705/1419] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:04:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:04:39.131478 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d2488-3afd-4aba-bac7-308540d6b8a7 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:39.132063 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d2488-3afd-4aba-bac7-308540d6b8a7 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:39.132063 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d2488-3afd-4aba-bac7-308540d6b8a7 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:39.133496 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 715/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 06:04:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:04:39.138439 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63002f54-9e6d-41c7-877b-823ae436ba2a None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:39.138870 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63002f54-9e6d-41c7-877b-823ae436ba2a None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:39.138994 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63002f54-9e6d-41c7-877b-823ae436ba2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:39.157659 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-63002f54-9e6d-41c7-877b-823ae436ba2a None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:04:39.158850 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-63002f54-9e6d-41c7-877b-823ae436ba2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:04:39.167274 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 706/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 06:04:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:04:39.315851 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d2488-3afd-4aba-bac7-308540d6b8a7 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:04:39.330891 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d2488-3afd-4aba-bac7-308540d6b8a7 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:04:39.336871 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d76b10e-19dc-4407-86b5-5f673d40c9b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cee106502e54829ad802ee41c9165fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:04:39.337503 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76b10e-19dc-4407-86b5-5f673d40c9b9 service nova] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:39.337788 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76b10e-19dc-4407-86b5-5f673d40c9b9 service nova] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:39.338067 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76b10e-19dc-4407-86b5-5f673d40c9b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:39.346047 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d76b10e-19dc-4407-86b5-5f673d40c9b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:04:39.347612 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d76b10e-19dc-4407-86b5-5f673d40c9b9 service nova] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:04:39.357044 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 716/1422] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:04:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:04:40.229496 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351e819-efdd-4b49-8b03-c1ec8a6e3ee8 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:40.230051 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351e819-efdd-4b49-8b03-c1ec8a6e3ee8 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:40.230051 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351e819-efdd-4b49-8b03-c1ec8a6e3ee8 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:40.231440 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 707/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 06:04:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:04:40.236461 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7d28e-0809-48d5-b0bb-3508a7762934 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:40.236937 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7d28e-0809-48d5-b0bb-3508a7762934 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:40.237070 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7d28e-0809-48d5-b0bb-3508a7762934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:40.255684 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-c4e7d28e-0809-48d5-b0bb-3508a7762934 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:04:40.256917 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-c4e7d28e-0809-48d5-b0bb-3508a7762934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:04:40.264604 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 717/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 06:04:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:04:40.413401 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351e819-efdd-4b49-8b03-c1ec8a6e3ee8 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:04:40.427678 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351e819-efdd-4b49-8b03-c1ec8a6e3ee8 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:04:40.433021 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e93308-16a4-45a8-8caa-cf435acae2ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cee106502e54829ad802ee41c9165fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:04:40.433647 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e93308-16a4-45a8-8caa-cf435acae2ae service nova] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:40.433927 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e93308-16a4-45a8-8caa-cf435acae2ae service nova] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:40.434196 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e93308-16a4-45a8-8caa-cf435acae2ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:40.442868 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e93308-16a4-45a8-8caa-cf435acae2ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:04:40.444445 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e93308-16a4-45a8-8caa-cf435acae2ae service nova] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:04:40.454363 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 708/1425] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:04:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:04:41.308974 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20078ef-03ff-4a48-973e-9460b3fdd1e3 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:41.309553 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20078ef-03ff-4a48-973e-9460b3fdd1e3 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:41.309553 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20078ef-03ff-4a48-973e-9460b3fdd1e3 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:41.310928 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 718/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 06:04:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:04:41.315908 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3824e90-5fd3-4519-a8ee-ed0850a41369 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:41.316320 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3824e90-5fd3-4519-a8ee-ed0850a41369 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:41.316454 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3824e90-5fd3-4519-a8ee-ed0850a41369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:41.334863 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-d3824e90-5fd3-4519-a8ee-ed0850a41369 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:04:41.336032 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-d3824e90-5fd3-4519-a8ee-ed0850a41369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:04:41.343780 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 709/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 06:04:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:04:41.494121 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20078ef-03ff-4a48-973e-9460b3fdd1e3 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:04:41.509033 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20078ef-03ff-4a48-973e-9460b3fdd1e3 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:04:41.514364 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc2895-f69c-4308-b6b9-e2b6fd14bdfe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cee106502e54829ad802ee41c9165fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:04:41.515000 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc2895-f69c-4308-b6b9-e2b6fd14bdfe service nova] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:41.515323 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc2895-f69c-4308-b6b9-e2b6fd14bdfe service nova] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:41.515629 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc2895-f69c-4308-b6b9-e2b6fd14bdfe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:41.523894 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fc2895-f69c-4308-b6b9-e2b6fd14bdfe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:04:41.525558 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fc2895-f69c-4308-b6b9-e2b6fd14bdfe service nova] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:04:41.534872 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 719/1428] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:04:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:04:42.356631 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e84b5ff-d51f-4396-a72c-0d55758eb086 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:42.357218 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e84b5ff-d51f-4396-a72c-0d55758eb086 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:42.357497 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e84b5ff-d51f-4396-a72c-0d55758eb086 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:42.358893 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 710/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 06:04:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:04:42.363801 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ef5e7-ca2a-4408-9938-cc20f5a78dd7 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:42.364232 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ef5e7-ca2a-4408-9938-cc20f5a78dd7 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:42.364378 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ef5e7-ca2a-4408-9938-cc20f5a78dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:42.382416 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-7b2ef5e7-ca2a-4408-9938-cc20f5a78dd7 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:04:42.383608 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-7b2ef5e7-ca2a-4408-9938-cc20f5a78dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:04:42.391279 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 720/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 06:04:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:04:42.544173 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e84b5ff-d51f-4396-a72c-0d55758eb086 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:04:42.558537 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e84b5ff-d51f-4396-a72c-0d55758eb086 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:04:42.563856 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2368d-ab85-4e45-af98-fff45e3256b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cee106502e54829ad802ee41c9165fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:04:42.564487 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2368d-ab85-4e45-af98-fff45e3256b7 service nova] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:42.564795 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2368d-ab85-4e45-af98-fff45e3256b7 service nova] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:42.565073 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2368d-ab85-4e45-af98-fff45e3256b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:42.573963 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd2368d-ab85-4e45-af98-fff45e3256b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:04:42.575528 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd2368d-ab85-4e45-af98-fff45e3256b7 service nova] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:04:42.586205 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 711/1431] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:04:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:04:43.387471 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41323f-eb78-4523-9d49-cc8106ec345e None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:43.388046 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41323f-eb78-4523-9d49-cc8106ec345e None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:43.388046 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41323f-eb78-4523-9d49-cc8106ec345e None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:43.389420 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 721/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 06:04:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:04:43.394492 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc514378-1a90-449d-b75f-446565b8ef54 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:43.394934 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc514378-1a90-449d-b75f-446565b8ef54 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:43.395076 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc514378-1a90-449d-b75f-446565b8ef54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:43.414745 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-fc514378-1a90-449d-b75f-446565b8ef54 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:04:43.416023 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-fc514378-1a90-449d-b75f-446565b8ef54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:04:43.423940 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 712/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 06:04:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:04:43.576492 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a41323f-eb78-4523-9d49-cc8106ec345e None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:04:43.590891 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a41323f-eb78-4523-9d49-cc8106ec345e None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:04:43.596144 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cdee65-b2fd-4672-bf3c-326b07cc5753 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cee106502e54829ad802ee41c9165fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:04:43.596798 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cdee65-b2fd-4672-bf3c-326b07cc5753 service nova] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:43.597085 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cdee65-b2fd-4672-bf3c-326b07cc5753 service nova] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:43.597361 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cdee65-b2fd-4672-bf3c-326b07cc5753 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:43.605516 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cdee65-b2fd-4672-bf3c-326b07cc5753 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:04:43.607080 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cdee65-b2fd-4672-bf3c-326b07cc5753 service nova] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:04:43.617009 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 722/1434] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:04:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:04:44.444138 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218693a-236b-4d39-8eb4-ae274c78cbd8 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:44.444842 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218693a-236b-4d39-8eb4-ae274c78cbd8 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:44.444842 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218693a-236b-4d39-8eb4-ae274c78cbd8 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:44.446100 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 713/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 06:04:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:04:44.451286 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa64fbd3-5dd6-49de-86f5-e578808ca43f None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:44.451741 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa64fbd3-5dd6-49de-86f5-e578808ca43f None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:44.451866 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa64fbd3-5dd6-49de-86f5-e578808ca43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:44.470476 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-fa64fbd3-5dd6-49de-86f5-e578808ca43f None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:04:44.471681 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-fa64fbd3-5dd6-49de-86f5-e578808ca43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:04:44.480292 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 723/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 06:04:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:04:44.630356 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c218693a-236b-4d39-8eb4-ae274c78cbd8 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:04:44.645223 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c218693a-236b-4d39-8eb4-ae274c78cbd8 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:04:44.651708 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a7da3-79d4-4930-9ee8-5796c7cec21d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cee106502e54829ad802ee41c9165fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:04:44.652342 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a7da3-79d4-4930-9ee8-5796c7cec21d service nova] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:44.652624 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a7da3-79d4-4930-9ee8-5796c7cec21d service nova] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:44.652933 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a7da3-79d4-4930-9ee8-5796c7cec21d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:44.660998 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7a7da3-79d4-4930-9ee8-5796c7cec21d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:04:44.663167 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7a7da3-79d4-4930-9ee8-5796c7cec21d service nova] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:04:44.672571 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 714/1437] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:04:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:04:45.474014 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bde4de-8943-4515-a104-8fa00a4a1f9e None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:45.474578 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bde4de-8943-4515-a104-8fa00a4a1f9e None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:45.475076 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bde4de-8943-4515-a104-8fa00a4a1f9e None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:45.476748 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 724/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 06:04:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:04:45.481632 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09daf2d3-d596-43ce-9bcf-b0496278b213 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:45.482081 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09daf2d3-d596-43ce-9bcf-b0496278b213 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:45.482211 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09daf2d3-d596-43ce-9bcf-b0496278b213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:45.500265 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-09daf2d3-d596-43ce-9bcf-b0496278b213 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:04:45.501488 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-09daf2d3-d596-43ce-9bcf-b0496278b213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:04:45.509933 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 715/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 06:04:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:04:45.658965 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bde4de-8943-4515-a104-8fa00a4a1f9e None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:04:45.673679 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bde4de-8943-4515-a104-8fa00a4a1f9e None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:04:45.679628 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250a20e-85ff-4b58-af22-2ef71d358c1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cee106502e54829ad802ee41c9165fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:04:45.680268 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250a20e-85ff-4b58-af22-2ef71d358c1e service nova] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:45.680575 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250a20e-85ff-4b58-af22-2ef71d358c1e service nova] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:45.680887 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250a20e-85ff-4b58-af22-2ef71d358c1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:45.689218 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e250a20e-85ff-4b58-af22-2ef71d358c1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:04:45.691134 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e250a20e-85ff-4b58-af22-2ef71d358c1e service nova] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:04:45.701424 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 725/1440] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:04:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:04:47.747862 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2fda4-cfca-44ce-bece-f2b0d23e9484 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:47.748392 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2fda4-cfca-44ce-bece-f2b0d23e9484 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:47.748392 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2fda4-cfca-44ce-bece-f2b0d23e9484 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:47.749753 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 716/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 06:04:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:04:47.754912 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beacc989-d1e2-4090-bc23-482e8bcb3c30 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:47.755340 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beacc989-d1e2-4090-bc23-482e8bcb3c30 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:47.755465 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beacc989-d1e2-4090-bc23-482e8bcb3c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:47.774201 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-beacc989-d1e2-4090-bc23-482e8bcb3c30 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:04:47.775522 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-beacc989-d1e2-4090-bc23-482e8bcb3c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:04:47.784085 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 726/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 06:04:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:04:47.824056 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2fda4-cfca-44ce-bece-f2b0d23e9484 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:04:47.825786 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-15b2fda4-cfca-44ce-bece-f2b0d23e9484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:04:47.839344 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2fda4-cfca-44ce-bece-f2b0d23e9484 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:04:47.842929 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0adea61-0c67-460a-946d-0ebd0fbbb8c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:04:47.843616 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0adea61-0c67-460a-946d-0ebd0fbbb8c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:47.843921 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0adea61-0c67-460a-946d-0ebd0fbbb8c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:47.844237 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0adea61-0c67-460a-946d-0ebd0fbbb8c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:47.854567 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0adea61-0c67-460a-946d-0ebd0fbbb8c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:04:47.856036 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0adea61-0c67-460a-946d-0ebd0fbbb8c1 service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:04:47.865587 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 717/1443] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:04:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:04:50.052074 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b62bc-d098-4cb8-8c8e-665e6fe0e092 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:50.052657 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b62bc-d098-4cb8-8c8e-665e6fe0e092 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:50.052657 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b62bc-d098-4cb8-8c8e-665e6fe0e092 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:50.054290 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 727/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 06:04:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:04:50.059654 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161cee96-0d9a-4edf-ad82-2b515f864c9c None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:50.060038 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161cee96-0d9a-4edf-ad82-2b515f864c9c None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:50.060212 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161cee96-0d9a-4edf-ad82-2b515f864c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:50.082391 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-161cee96-0d9a-4edf-ad82-2b515f864c9c None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:04:50.083611 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-161cee96-0d9a-4edf-ad82-2b515f864c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:04:50.092794 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 718/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 06:04:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:04:50.133488 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b62bc-d098-4cb8-8c8e-665e6fe0e092 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:04:50.144410 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b62bc-d098-4cb8-8c8e-665e6fe0e092 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:04:50.148886 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58b5130-ac75-46ac-a312-0d057bf424ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:04:50.149524 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b5130-ac75-46ac-a312-0d057bf424ae service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:50.149834 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b5130-ac75-46ac-a312-0d057bf424ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:50.150132 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b5130-ac75-46ac-a312-0d057bf424ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:50.159223 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58b5130-ac75-46ac-a312-0d057bf424ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:04:50.160694 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58b5130-ac75-46ac-a312-0d057bf424ae service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:04:50.170700 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 728/1446] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:04:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:04:52.545795 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f1ff0-71e7-4e58-842b-113f8541d2ec None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:52.546327 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f1ff0-71e7-4e58-842b-113f8541d2ec None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:52.546327 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f1ff0-71e7-4e58-842b-113f8541d2ec None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:52.547655 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 719/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 06:04:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:04:52.552982 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec7604-3851-4612-8a30-7b04c52c98ba None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:52.553392 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec7604-3851-4612-8a30-7b04c52c98ba None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:52.553516 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec7604-3851-4612-8a30-7b04c52c98ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:52.572255 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-15ec7604-3851-4612-8a30-7b04c52c98ba None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:04:52.573509 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-15ec7604-3851-4612-8a30-7b04c52c98ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:04:52.581480 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 729/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 06:04:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:04:52.619457 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f1ff0-71e7-4e58-842b-113f8541d2ec None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:04:52.630064 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f1ff0-71e7-4e58-842b-113f8541d2ec None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:04:52.634143 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326f1580-ffff-4416-be00-9b26d665a633 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:04:52.634779 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f1580-ffff-4416-be00-9b26d665a633 service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:52.635062 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f1580-ffff-4416-be00-9b26d665a633 service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:52.635335 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f1580-ffff-4416-be00-9b26d665a633 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:52.644290 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326f1580-ffff-4416-be00-9b26d665a633 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:04:52.645757 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326f1580-ffff-4416-be00-9b26d665a633 service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:04:52.655311 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 720/1449] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:04:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:04:54.866138 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01aa90-8f3a-454e-982b-56589d2db945 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:54.866575 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01aa90-8f3a-454e-982b-56589d2db945 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:54.866692 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01aa90-8f3a-454e-982b-56589d2db945 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:54.868672 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 730/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 06:04:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:04:54.874006 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767fecf-eb01-4370-a4fa-6fc711c4cf1b None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:54.874425 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767fecf-eb01-4370-a4fa-6fc711c4cf1b None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:54.874604 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767fecf-eb01-4370-a4fa-6fc711c4cf1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:54.892824 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-9767fecf-eb01-4370-a4fa-6fc711c4cf1b None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:04:54.894020 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-9767fecf-eb01-4370-a4fa-6fc711c4cf1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:04:54.902254 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 721/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 06:04:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:04:54.941826 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c01aa90-8f3a-454e-982b-56589d2db945 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:04:54.953033 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c01aa90-8f3a-454e-982b-56589d2db945 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:04:54.956832 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d45bbd-526f-47ff-a284-73e47f2d017b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:04:54.957465 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d45bbd-526f-47ff-a284-73e47f2d017b service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:54.957749 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d45bbd-526f-47ff-a284-73e47f2d017b service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:54.958026 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d45bbd-526f-47ff-a284-73e47f2d017b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:54.967698 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d45bbd-526f-47ff-a284-73e47f2d017b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:04:54.969187 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d45bbd-526f-47ff-a284-73e47f2d017b service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:04:54.978931 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 731/1452] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:04:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:04:57.103047 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c8bc6-b376-495d-9d28-00609d360380 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:57.103652 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c8bc6-b376-495d-9d28-00609d360380 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:57.103870 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c8bc6-b376-495d-9d28-00609d360380 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:57.105326 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 722/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 06:04:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:04:57.110609 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd49b6-25d1-494e-84a5-c8690a9fe72a None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:57.111027 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd49b6-25d1-494e-84a5-c8690a9fe72a None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:57.111190 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd49b6-25d1-494e-84a5-c8690a9fe72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:57.128425 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-7ebd49b6-25d1-494e-84a5-c8690a9fe72a None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:04:57.129644 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-7ebd49b6-25d1-494e-84a5-c8690a9fe72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:04:57.137395 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 732/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 06:04:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:04:57.175808 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c8bc6-b376-495d-9d28-00609d360380 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:04:57.186514 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c8bc6-b376-495d-9d28-00609d360380 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:04:57.190010 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ab64b-0731-45b8-93a7-5be955d05bc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:04:57.190638 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ab64b-0731-45b8-93a7-5be955d05bc8 service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:57.190919 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ab64b-0731-45b8-93a7-5be955d05bc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:57.191194 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ab64b-0731-45b8-93a7-5be955d05bc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:57.200014 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690ab64b-0731-45b8-93a7-5be955d05bc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:04:57.201467 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690ab64b-0731-45b8-93a7-5be955d05bc8 service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:04:57.211206 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 723/1455] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:04:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:04:59.358365 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3257c0-8f66-4fdc-a4ff-7fc715b1549d None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:59.358933 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3257c0-8f66-4fdc-a4ff-7fc715b1549d None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:59.358933 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3257c0-8f66-4fdc-a4ff-7fc715b1549d None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:59.360298 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 733/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 06:04:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:04:59.365725 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2112707-763a-41b9-8f96-e5701a00f735 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:59.366168 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2112707-763a-41b9-8f96-e5701a00f735 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:59.366265 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2112707-763a-41b9-8f96-e5701a00f735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:59.384489 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-f2112707-763a-41b9-8f96-e5701a00f735 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:04:59.385709 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-f2112707-763a-41b9-8f96-e5701a00f735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:04:59.393284 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 724/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 06:04:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:04:59.432665 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3257c0-8f66-4fdc-a4ff-7fc715b1549d None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:04:59.443329 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3257c0-8f66-4fdc-a4ff-7fc715b1549d None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:04:59.446950 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2331a8-54fe-453c-a461-d46f1c5230ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:04:59.447593 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2331a8-54fe-453c-a461-d46f1c5230ab service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:04:59.447878 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2331a8-54fe-453c-a461-d46f1c5230ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:04:59.448178 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2331a8-54fe-453c-a461-d46f1c5230ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:04:59.458299 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2331a8-54fe-453c-a461-d46f1c5230ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:04:59.459746 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2331a8-54fe-453c-a461-d46f1c5230ab service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:04:59.469286 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 734/1458] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:04:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:05:01.549374 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf42cf-f1a7-42ea-b177-9a60d271e6a0 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:01.549926 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf42cf-f1a7-42ea-b177-9a60d271e6a0 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:01.549926 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf42cf-f1a7-42ea-b177-9a60d271e6a0 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:01.551324 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 725/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 06:05:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:05:01.557219 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a115ba4-71bc-471d-995a-8c468fc16c94 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:01.557675 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a115ba4-71bc-471d-995a-8c468fc16c94 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:01.557776 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a115ba4-71bc-471d-995a-8c468fc16c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:01.575732 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-6a115ba4-71bc-471d-995a-8c468fc16c94 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:05:01.576969 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-6a115ba4-71bc-471d-995a-8c468fc16c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:01.584995 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 735/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 06:05:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:05:01.623110 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf42cf-f1a7-42ea-b177-9a60d271e6a0 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:05:01.633966 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf42cf-f1a7-42ea-b177-9a60d271e6a0 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:05:01.638299 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0828c8-c3bc-4139-9e31-69e2e75724db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:05:01.638926 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0828c8-c3bc-4139-9e31-69e2e75724db service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:01.639200 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0828c8-c3bc-4139-9e31-69e2e75724db service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:01.639479 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0828c8-c3bc-4139-9e31-69e2e75724db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:01.648359 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0828c8-c3bc-4139-9e31-69e2e75724db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:05:01.649810 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0828c8-c3bc-4139-9e31-69e2e75724db service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:05:01.659446 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 726/1461] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:05:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:05:03.739148 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0fba2-75e0-4cc8-b87f-9cdfcad6ed76 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:03.739654 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0fba2-75e0-4cc8-b87f-9cdfcad6ed76 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:03.739654 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0fba2-75e0-4cc8-b87f-9cdfcad6ed76 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:03.741042 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 736/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 06:05:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:05:03.746813 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00babd44-7bcd-4dad-b848-5e3a36f565ae None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:03.747218 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00babd44-7bcd-4dad-b848-5e3a36f565ae None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:03.747356 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00babd44-7bcd-4dad-b848-5e3a36f565ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:03.753410 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=79 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:05:03.766289 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-00babd44-7bcd-4dad-b848-5e3a36f565ae None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:05:03.767469 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-00babd44-7bcd-4dad-b848-5e3a36f565ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:03.775207 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 727/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 06:05:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:05:03.813018 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e0fba2-75e0-4cc8-b87f-9cdfcad6ed76 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:05:03.818357 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=73 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:05:03.825466 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e0fba2-75e0-4cc8-b87f-9cdfcad6ed76 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:05:03.828948 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76cf93d-b31f-4174-85d4-945b58d610af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:05:03.829580 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76cf93d-b31f-4174-85d4-945b58d610af service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:03.829859 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76cf93d-b31f-4174-85d4-945b58d610af service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:03.830240 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76cf93d-b31f-4174-85d4-945b58d610af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:03.839283 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76cf93d-b31f-4174-85d4-945b58d610af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:05:03.840750 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76cf93d-b31f-4174-85d4-945b58d610af service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:05:03.849910 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 737/1464] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:05:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:05:05.933708 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93638ac6-cb0f-4ae1-a2cd-f5f75fb6738d None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:05.934235 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93638ac6-cb0f-4ae1-a2cd-f5f75fb6738d None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:05.934235 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93638ac6-cb0f-4ae1-a2cd-f5f75fb6738d None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:05.935565 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 728/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 06:05:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:05:05.940815 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da613e-9c3d-477f-9215-9cd6c8b9e3dd None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:05.941195 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da613e-9c3d-477f-9215-9cd6c8b9e3dd None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:05.941363 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da613e-9c3d-477f-9215-9cd6c8b9e3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:05.959619 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-a9da613e-9c3d-477f-9215-9cd6c8b9e3dd None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:05:05.960831 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-a9da613e-9c3d-477f-9215-9cd6c8b9e3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:05.969222 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 738/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 06:05:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:05:06.005165 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93638ac6-cb0f-4ae1-a2cd-f5f75fb6738d None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:05:06.016021 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93638ac6-cb0f-4ae1-a2cd-f5f75fb6738d None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:05:06.019747 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c7a42-50c0-444b-9e1f-c738495b1452 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:05:06.020517 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c7a42-50c0-444b-9e1f-c738495b1452 service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:06.020931 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c7a42-50c0-444b-9e1f-c738495b1452 service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:06.021328 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c7a42-50c0-444b-9e1f-c738495b1452 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:06.031468 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c7a42-50c0-444b-9e1f-c738495b1452 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:05:06.032915 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c7a42-50c0-444b-9e1f-c738495b1452 service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:05:06.042960 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 729/1467] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:05:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:05:08.078736 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa356f-8f0e-4198-8a2a-9b89f5d62151 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:08.079325 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa356f-8f0e-4198-8a2a-9b89f5d62151 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:08.079325 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa356f-8f0e-4198-8a2a-9b89f5d62151 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:08.080716 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 739/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 06:05:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:05:08.086290 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f68dc-d391-4d31-9ea3-aa5f592fd4e0 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:08.086711 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f68dc-d391-4d31-9ea3-aa5f592fd4e0 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:08.086857 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f68dc-d391-4d31-9ea3-aa5f592fd4e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:08.104980 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-599f68dc-d391-4d31-9ea3-aa5f592fd4e0 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:05:08.106103 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-599f68dc-d391-4d31-9ea3-aa5f592fd4e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:08.113840 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 730/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 06:05:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:05:08.150756 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfa356f-8f0e-4198-8a2a-9b89f5d62151 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:05:08.161377 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfa356f-8f0e-4198-8a2a-9b89f5d62151 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:05:08.164855 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc09dcd-7435-4a35-bc49-7eaf1a1938bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:05:08.165483 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc09dcd-7435-4a35-bc49-7eaf1a1938bd service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:08.165760 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc09dcd-7435-4a35-bc49-7eaf1a1938bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:08.166029 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc09dcd-7435-4a35-bc49-7eaf1a1938bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:08.175422 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc09dcd-7435-4a35-bc49-7eaf1a1938bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:05:08.176864 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc09dcd-7435-4a35-bc49-7eaf1a1938bd service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:05:08.186779 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 740/1470] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:05:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:05:18.099303 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=11 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:05:18.181931 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=14 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:05:28.213111 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344d232-7259-4d52-8849-af30e14998a6 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:28.213736 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344d232-7259-4d52-8849-af30e14998a6 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:28.213736 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344d232-7259-4d52-8849-af30e14998a6 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:28.214981 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 731/1471] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 06:05:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:05:28.221232 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee747c2-6115-4155-8923-471c6de6fb0a None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:28.221667 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee747c2-6115-4155-8923-471c6de6fb0a None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:28.221779 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee747c2-6115-4155-8923-471c6de6fb0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:28.239965 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-aee747c2-6115-4155-8923-471c6de6fb0a None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:05:28.241216 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-aee747c2-6115-4155-8923-471c6de6fb0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:28.249142 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 741/1472] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 06:05:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:05:28.297274 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c980f8-11af-4f80-89d4-72f182bed238 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:28.297570 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c980f8-11af-4f80-89d4-72f182bed238 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:28.297847 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c980f8-11af-4f80-89d4-72f182bed238 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:28.299215 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 732/1473] 10.222.0.39 () {54 vars in 962 bytes} [Mon Jun 20 06:05:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:05:28.303865 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807cb8d6-4c85-4bc0-ab66-b2bac75b0fbf None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:28.304156 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807cb8d6-4c85-4bc0-ab66-b2bac75b0fbf None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:28.304435 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807cb8d6-4c85-4bc0-ab66-b2bac75b0fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:28.322407 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-807cb8d6-4c85-4bc0-ab66-b2bac75b0fbf None None] MFA Rules not processed for user `b9cb22811a754357ab9d839b70d44261`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:05:28.323606 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-807cb8d6-4c85-4bc0-ab66-b2bac75b0fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:28.330763 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 742/1474] 10.222.0.39 () {58 vars in 1059 bytes} [Mon Jun 20 06:05:28 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:05:28.338071 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c980f8-11af-4f80-89d4-72f182bed238 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:05:28.350358 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c980f8-11af-4f80-89d4-72f182bed238 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:05:28.354314 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52386644-2079-40a6-bf6b-15a27cf96584 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cb22811a754357ab9d839b70d44261', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:05:28.355289 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52386644-2079-40a6-bf6b-15a27cf96584 service glance] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:28.355790 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52386644-2079-40a6-bf6b-15a27cf96584 service glance] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:28.356299 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52386644-2079-40a6-bf6b-15a27cf96584 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:28.367473 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52386644-2079-40a6-bf6b-15a27cf96584 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:05:28.368931 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52386644-2079-40a6-bf6b-15a27cf96584 service glance] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:05:28.378419 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 733/1475] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:05:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:05:30.519496 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4472384-4e15-4b70-b210-0a302b0fdf6b None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:30.520054 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4472384-4e15-4b70-b210-0a302b0fdf6b None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:30.520054 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4472384-4e15-4b70-b210-0a302b0fdf6b None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:30.521472 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 743/1476] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 06:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:05:30.526535 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca5653-d669-467e-9771-129874e7b3ad None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:30.526931 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca5653-d669-467e-9771-129874e7b3ad None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:30.527099 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca5653-d669-467e-9771-129874e7b3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:30.544904 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-15ca5653-d669-467e-9771-129874e7b3ad None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:05:30.546627 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-15ca5653-d669-467e-9771-129874e7b3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:30.554405 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 734/1477] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 06:05:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:05:30.578639 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4472384-4e15-4b70-b210-0a302b0fdf6b None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:05:30.591421 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4472384-4e15-4b70-b210-0a302b0fdf6b None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:05:30.596097 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6b489-27ca-45f9-be26-060e40690622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:05:30.596765 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6b489-27ca-45f9-be26-060e40690622 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:30.597055 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6b489-27ca-45f9-be26-060e40690622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:30.597332 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6b489-27ca-45f9-be26-060e40690622 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:30.598063 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c6b489-27ca-45f9-be26-060e40690622 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:05:30.599838 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: WARNING py.warnings [None req-75c6b489-27ca-45f9-be26-060e40690622 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:05:30.599838 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: warnings.warn(msg) Jun 20 06:05:30.599838 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: Jun 20 06:05:30.601009 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c6b489-27ca-45f9-be26-060e40690622 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:05:30.620360 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 744/1478] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jun 20 06:05:30 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:05:32.658809 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d598ab-8d5d-4adb-bf48-f53b2a538fe2 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:32.659354 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d598ab-8d5d-4adb-bf48-f53b2a538fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:32.659354 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d598ab-8d5d-4adb-bf48-f53b2a538fe2 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:32.660632 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 735/1479] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 06:05:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:05:32.665745 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b7fe8-ec64-41e4-b9a3-d9fe55140ea3 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:32.666152 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b7fe8-ec64-41e4-b9a3-d9fe55140ea3 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:32.666295 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b7fe8-ec64-41e4-b9a3-d9fe55140ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:32.684352 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-b85b7fe8-ec64-41e4-b9a3-d9fe55140ea3 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:05:32.685576 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-b85b7fe8-ec64-41e4-b9a3-d9fe55140ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:32.693579 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 745/1480] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 06:05:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:05:32.737788 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d598ab-8d5d-4adb-bf48-f53b2a538fe2 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:05:32.752051 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d598ab-8d5d-4adb-bf48-f53b2a538fe2 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:05:32.757278 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc2106-927b-46ab-a4d0-d77d10d932a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cee106502e54829ad802ee41c9165fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:05:32.757914 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc2106-927b-46ab-a4d0-d77d10d932a4 service nova] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:32.758192 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc2106-927b-46ab-a4d0-d77d10d932a4 service nova] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:32.758466 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc2106-927b-46ab-a4d0-d77d10d932a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:32.767010 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc2106-927b-46ab-a4d0-d77d10d932a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:05:32.768584 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc2106-927b-46ab-a4d0-d77d10d932a4 service nova] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:05:32.778111 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 736/1481] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:05:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:05:35.017968 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6c2ad-a413-4ab4-972a-58d6ecfc9439 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:35.018566 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6c2ad-a413-4ab4-972a-58d6ecfc9439 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:35.018566 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6c2ad-a413-4ab4-972a-58d6ecfc9439 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:35.019919 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 746/1482] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 06:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:05:35.025151 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72e61f-0b6e-4557-8b5a-21b958a14ef5 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:35.025588 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72e61f-0b6e-4557-8b5a-21b958a14ef5 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:35.025708 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72e61f-0b6e-4557-8b5a-21b958a14ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:35.045339 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-2c72e61f-0b6e-4557-8b5a-21b958a14ef5 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:05:35.047125 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-2c72e61f-0b6e-4557-8b5a-21b958a14ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:35.054837 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 737/1483] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 06:05:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:05:35.091616 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6c2ad-a413-4ab4-972a-58d6ecfc9439 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:05:35.102750 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6c2ad-a413-4ab4-972a-58d6ecfc9439 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:05:35.106125 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4365d93-36be-4ec7-bdb1-f3d5fc77e5d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:05:35.106757 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4365d93-36be-4ec7-bdb1-f3d5fc77e5d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:35.107035 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4365d93-36be-4ec7-bdb1-f3d5fc77e5d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:35.107308 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4365d93-36be-4ec7-bdb1-f3d5fc77e5d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:35.116317 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4365d93-36be-4ec7-bdb1-f3d5fc77e5d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:05:35.117800 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4365d93-36be-4ec7-bdb1-f3d5fc77e5d7 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:05:35.128000 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 747/1484] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:05:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:05:37.240534 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d653d-21a8-4ae5-aa5b-3150f25f53b8 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:37.241656 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d653d-21a8-4ae5-aa5b-3150f25f53b8 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:37.242119 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d653d-21a8-4ae5-aa5b-3150f25f53b8 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:37.243584 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 738/1485] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 06:05:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:05:37.248999 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba3929-57f1-408e-8194-7615b035f1d0 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:37.249418 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba3929-57f1-408e-8194-7615b035f1d0 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:37.249558 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba3929-57f1-408e-8194-7615b035f1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:37.266947 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-72ba3929-57f1-408e-8194-7615b035f1d0 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:05:37.268132 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-72ba3929-57f1-408e-8194-7615b035f1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:37.275805 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 748/1486] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 06:05:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:05:37.314883 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d653d-21a8-4ae5-aa5b-3150f25f53b8 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:05:37.325823 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d653d-21a8-4ae5-aa5b-3150f25f53b8 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:05:37.330078 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61d1e6-d8a8-4448-a0ce-48034d23a2a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:05:37.330724 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61d1e6-d8a8-4448-a0ce-48034d23a2a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:37.331006 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61d1e6-d8a8-4448-a0ce-48034d23a2a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:37.331282 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61d1e6-d8a8-4448-a0ce-48034d23a2a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:37.340756 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb61d1e6-d8a8-4448-a0ce-48034d23a2a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:05:37.342181 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb61d1e6-d8a8-4448-a0ce-48034d23a2a8 service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:05:37.352361 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 739/1487] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:05:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:05:39.587390 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba80157-ef93-41a5-af9c-baaa92f92046 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:39.587954 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba80157-ef93-41a5-af9c-baaa92f92046 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:39.587954 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba80157-ef93-41a5-af9c-baaa92f92046 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:39.589357 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 749/1488] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 06:05:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:05:39.595247 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf58ea3-9e22-4291-9801-dbc3acc2bb3d None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:39.595695 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf58ea3-9e22-4291-9801-dbc3acc2bb3d None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:39.595807 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf58ea3-9e22-4291-9801-dbc3acc2bb3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:39.614139 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-ecf58ea3-9e22-4291-9801-dbc3acc2bb3d None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:05:39.615327 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-ecf58ea3-9e22-4291-9801-dbc3acc2bb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:39.623025 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 740/1489] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 06:05:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:05:39.662750 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba80157-ef93-41a5-af9c-baaa92f92046 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:05:39.674463 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba80157-ef93-41a5-af9c-baaa92f92046 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:05:39.677991 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f7508-e6d5-47af-820d-88695aef2432 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:05:39.678621 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f7508-e6d5-47af-820d-88695aef2432 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:39.678905 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f7508-e6d5-47af-820d-88695aef2432 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:39.679178 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f7508-e6d5-47af-820d-88695aef2432 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:39.688045 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845f7508-e6d5-47af-820d-88695aef2432 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:05:39.689488 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845f7508-e6d5-47af-820d-88695aef2432 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:05:39.698714 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 750/1490] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:05:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:05:41.944669 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc1fd5-759e-43a5-a1a7-94eee3e5a4d2 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:41.945237 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc1fd5-759e-43a5-a1a7-94eee3e5a4d2 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:41.945237 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc1fd5-759e-43a5-a1a7-94eee3e5a4d2 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:41.946569 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 741/1491] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jun 20 06:05:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:05:41.951820 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a9006-2d1e-4225-89aa-1dd6b82372eb None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:41.952278 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a9006-2d1e-4225-89aa-1dd6b82372eb None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:41.952387 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a9006-2d1e-4225-89aa-1dd6b82372eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:41.970781 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-8a5a9006-2d1e-4225-89aa-1dd6b82372eb None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:05:41.971956 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-8a5a9006-2d1e-4225-89aa-1dd6b82372eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:41.979695 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 751/1492] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jun 20 06:05:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:05:42.018834 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc1fd5-759e-43a5-a1a7-94eee3e5a4d2 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:05:42.029903 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc1fd5-759e-43a5-a1a7-94eee3e5a4d2 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:05:42.034077 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce5e3f-6b05-47dc-a59a-4d3e27ce4c1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:05:42.034709 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce5e3f-6b05-47dc-a59a-4d3e27ce4c1c service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:42.034992 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce5e3f-6b05-47dc-a59a-4d3e27ce4c1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:42.035269 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce5e3f-6b05-47dc-a59a-4d3e27ce4c1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:42.044061 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce5e3f-6b05-47dc-a59a-4d3e27ce4c1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:05:42.045520 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce5e3f-6b05-47dc-a59a-4d3e27ce4c1c service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:05:42.055064 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 742/1493] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:05:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:05:51.964680 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=33 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:05:52.050725 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=33 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:23.735810 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fab76-674a-4f26-9bee-bfd67bb7a775 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:23.736398 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fab76-674a-4f26-9bee-bfd67bb7a775 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:23.736398 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fab76-674a-4f26-9bee-bfd67bb7a775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:23.754894 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-511fab76-674a-4f26-9bee-bfd67bb7a775 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:23.756088 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-511fab76-674a-4f26-9bee-bfd67bb7a775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:23.766258 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 752/1494] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:07:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:23.775664 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd49b01-3c21-43de-8062-9e9e95178e8c None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:23.776202 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd49b01-3c21-43de-8062-9e9e95178e8c None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:23.776202 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd49b01-3c21-43de-8062-9e9e95178e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:23.795335 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-bfd49b01-3c21-43de-8062-9e9e95178e8c None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:23.796535 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-bfd49b01-3c21-43de-8062-9e9e95178e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:23.805406 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 743/1495] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:07:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:23.810774 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511fab76-674a-4f26-9bee-bfd67bb7a775 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:23.821043 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511fab76-674a-4f26-9bee-bfd67bb7a775 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:23.826263 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8057392-778e-4089-a182-6f2f724a7963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:23.826919 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8057392-778e-4089-a182-6f2f724a7963 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:23.827199 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8057392-778e-4089-a182-6f2f724a7963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:23.827470 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8057392-778e-4089-a182-6f2f724a7963 admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:23.828223 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8057392-778e-4089-a182-6f2f724a7963 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:07:23.828528 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8057392-778e-4089-a182-6f2f724a7963 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:23.829582 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: WARNING py.warnings [None req-e8057392-778e-4089-a182-6f2f724a7963 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:07:23.829582 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: warnings.warn(msg) Jun 20 06:07:23.829582 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: Jun 20 06:07:23.830482 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8057392-778e-4089-a182-6f2f724a7963 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:23.844553 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 753/1496] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:07:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:07:23.853967 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd49b01-3c21-43de-8062-9e9e95178e8c None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:23.863975 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd49b01-3c21-43de-8062-9e9e95178e8c None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:23.868662 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fbb0cb-ca18-41ab-87a1-3d5728dbc502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:23.869356 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fbb0cb-ca18-41ab-87a1-3d5728dbc502 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:23.869644 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fbb0cb-ca18-41ab-87a1-3d5728dbc502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:23.869920 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fbb0cb-ca18-41ab-87a1-3d5728dbc502 admin admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:23.871224 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fbb0cb-ca18-41ab-87a1-3d5728dbc502 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:23.874044 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: WARNING py.warnings [None req-31fbb0cb-ca18-41ab-87a1-3d5728dbc502 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:07:23.874044 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: warnings.warn(msg) Jun 20 06:07:23.874044 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: Jun 20 06:07:23.876155 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fbb0cb-ca18-41ab-87a1-3d5728dbc502 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:23.914556 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 744/1497] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:07:23 2022] POST /identity/v3/projects => generated 379 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:07:23.919769 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8057392-778e-4089-a182-6f2f724a7963 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:23.937659 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8057392-778e-4089-a182-6f2f724a7963 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:24.009790 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21ecf89-ea9f-4376-b723-1223c59ec715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:24.010766 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ecf89-ea9f-4376-b723-1223c59ec715 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:24.011882 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ecf89-ea9f-4376-b723-1223c59ec715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:24.012363 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ecf89-ea9f-4376-b723-1223c59ec715 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:24.013595 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21ecf89-ea9f-4376-b723-1223c59ec715 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:24.015357 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: WARNING py.warnings [None req-a21ecf89-ea9f-4376-b723-1223c59ec715 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:07:24.015357 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: warnings.warn(msg) Jun 20 06:07:24.015357 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: Jun 20 06:07:24.017485 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21ecf89-ea9f-4376-b723-1223c59ec715 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:24.042044 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 754/1498] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:07:23 2022] POST /identity/v3/users => generated 290 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:07:24.048629 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fbb0cb-ca18-41ab-87a1-3d5728dbc502 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:24.060247 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fbb0cb-ca18-41ab-87a1-3d5728dbc502 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:24.064940 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0a02b-3232-48a1-a9ae-fb5acc4b3c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:24.065606 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0a02b-3232-48a1-a9ae-fb5acc4b3c37 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:24.065890 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0a02b-3232-48a1-a9ae-fb5acc4b3c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:24.066170 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0a02b-3232-48a1-a9ae-fb5acc4b3c37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:24.074651 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e0a02b-3232-48a1-a9ae-fb5acc4b3c37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:24.075709 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: WARNING py.warnings [None req-24e0a02b-3232-48a1-a9ae-fb5acc4b3c37 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:07:24.075709 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: warnings.warn(msg) Jun 20 06:07:24.075709 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: Jun 20 06:07:24.076621 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e0a02b-3232-48a1-a9ae-fb5acc4b3c37 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:24.099947 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 745/1499] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:24 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:07:24.104322 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21ecf89-ea9f-4376-b723-1223c59ec715 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:24.114618 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21ecf89-ea9f-4376-b723-1223c59ec715 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:24.119399 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149e5f2-ac7c-480f-a1b7-1453d22c3021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:24.120053 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149e5f2-ac7c-480f-a1b7-1453d22c3021 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:24.120336 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149e5f2-ac7c-480f-a1b7-1453d22c3021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:24.121137 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149e5f2-ac7c-480f-a1b7-1453d22c3021 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:24.121866 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149e5f2-ac7c-480f-a1b7-1453d22c3021 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:24.122868 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: WARNING py.warnings [None req-4149e5f2-ac7c-480f-a1b7-1453d22c3021 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:07:24.122868 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: warnings.warn(msg) Jun 20 06:07:24.122868 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: Jun 20 06:07:24.123756 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149e5f2-ac7c-480f-a1b7-1453d22c3021 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:24.138170 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 755/1500] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:07:24.142413 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0a02b-3232-48a1-a9ae-fb5acc4b3c37 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:24.152725 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0a02b-3232-48a1-a9ae-fb5acc4b3c37 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:24.158670 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f811b-76b5-4955-8cf0-2ba16b523cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:24.159563 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f811b-76b5-4955-8cf0-2ba16b523cbb admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:24.159850 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f811b-76b5-4955-8cf0-2ba16b523cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:24.160129 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f811b-76b5-4955-8cf0-2ba16b523cbb admin admin] PATH_INFO: `/v3/projects/ed940a187f1e46318c6300364ae21ff7/users/58e9c5d9218d43ae8102772835d4ab97/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:24.175704 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0f811b-76b5-4955-8cf0-2ba16b523cbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed940a187f1e46318c6300364ae21ff7, user_id=58e9c5d9218d43ae8102772835d4ab97, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:24.176763 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: WARNING py.warnings [None req-9c0f811b-76b5-4955-8cf0-2ba16b523cbb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:07:24.176763 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: warnings.warn(msg) Jun 20 06:07:24.176763 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: Jun 20 06:07:24.178712 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0f811b-76b5-4955-8cf0-2ba16b523cbb admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:24.192014 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 746/1501] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:07:24 2022] PUT /identity/v3/projects/ed940a187f1e46318c6300364ae21ff7/users/58e9c5d9218d43ae8102772835d4ab97/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:24.203999 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11994e9-5b59-405b-af46-8507b9a2dbb9 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:24.204292 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11994e9-5b59-405b-af46-8507b9a2dbb9 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:24.204573 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11994e9-5b59-405b-af46-8507b9a2dbb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:24.230820 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-b11994e9-5b59-405b-af46-8507b9a2dbb9 None None] MFA Rules not processed for user `58e9c5d9218d43ae8102772835d4ab97`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:24.232044 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-b11994e9-5b59-405b-af46-8507b9a2dbb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:24.297051 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 756/1502] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:07:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:24.312451 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f580a-1878-4f2e-8366-045cb17b441f None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:24.312766 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f580a-1878-4f2e-8366-045cb17b441f None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:24.313047 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f580a-1878-4f2e-8366-045cb17b441f None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:24.314486 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 747/1503] 10.222.0.39 () {54 vars in 963 bytes} [Mon Jun 20 06:07:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:07:24.319366 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19af9d-bbaf-4ae4-8131-5285a3ab7dbd None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:24.319651 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19af9d-bbaf-4ae4-8131-5285a3ab7dbd None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:24.319931 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19af9d-bbaf-4ae4-8131-5285a3ab7dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:24.340419 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-af19af9d-bbaf-4ae4-8131-5285a3ab7dbd None None] MFA Rules not processed for user `19bd2ac77c5d48d49b58712f4025e279`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:24.341663 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-af19af9d-bbaf-4ae4-8131-5285a3ab7dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:24.385248 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:24.393831 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 757/1504] 10.222.0.39 () {58 vars in 1060 bytes} [Mon Jun 20 06:07:24 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:24.401373 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f580a-1878-4f2e-8366-045cb17b441f None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:24.412102 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f580a-1878-4f2e-8366-045cb17b441f None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:24.415600 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de25aec-aa0b-476d-aca8-64ae8d10bd05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:24.416236 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de25aec-aa0b-476d-aca8-64ae8d10bd05 service cinder] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:24.416514 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de25aec-aa0b-476d-aca8-64ae8d10bd05 service cinder] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:24.416847 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de25aec-aa0b-476d-aca8-64ae8d10bd05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:24.425712 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de25aec-aa0b-476d-aca8-64ae8d10bd05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:24.427135 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de25aec-aa0b-476d-aca8-64ae8d10bd05 service cinder] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:24.436686 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 748/1505] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:24 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:07:24.477962 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53edbc4a-f18f-4658-a6f6-ced663e7e2ad None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:24.478256 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53edbc4a-f18f-4658-a6f6-ced663e7e2ad None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:24.478556 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53edbc4a-f18f-4658-a6f6-ced663e7e2ad None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:24.479823 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 758/1506] 10.222.0.39 () {52 vars in 829 bytes} [Mon Jun 20 06:07:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:07:24.483961 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de25aec-aa0b-476d-aca8-64ae8d10bd05 service cinder] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:24.545475 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de25aec-aa0b-476d-aca8-64ae8d10bd05 service cinder] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:24.549967 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527d9211-0fc6-4b38-8fbf-45c37c1f6e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:24.550772 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d9211-0fc6-4b38-8fbf-45c37c1f6e91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:24.551053 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d9211-0fc6-4b38-8fbf-45c37c1f6e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:24.551329 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d9211-0fc6-4b38-8fbf-45c37c1f6e91 admin admin] PATH_INFO: `/v3/users/58e9c5d9218d43ae8102772835d4ab97` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:24.552508 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527d9211-0fc6-4b38-8fbf-45c37c1f6e91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58e9c5d9218d43ae8102772835d4ab97)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:24.553558 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: WARNING py.warnings [None req-527d9211-0fc6-4b38-8fbf-45c37c1f6e91 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:07:24.553558 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: warnings.warn(msg) Jun 20 06:07:24.553558 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: Jun 20 06:07:24.554744 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527d9211-0fc6-4b38-8fbf-45c37c1f6e91 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:24.619116 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-527d9211-0fc6-4b38-8fbf-45c37c1f6e91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58e9c5d9218d43ae8102772835d4ab97'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:24.629194 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-527d9211-0fc6-4b38-8fbf-45c37c1f6e91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58e9c5d9218d43ae8102772835d4ab97'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:24.629996 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-527d9211-0fc6-4b38-8fbf-45c37c1f6e91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58e9c5d9218d43ae8102772835d4ab97'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:24.630681 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-527d9211-0fc6-4b38-8fbf-45c37c1f6e91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58e9c5d9218d43ae8102772835d4ab97'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:24.648511 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-527d9211-0fc6-4b38-8fbf-45c37c1f6e91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58e9c5d9218d43ae8102772835d4ab97'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:24.657094 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:24.669703 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 749/1507] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:07:24 2022] DELETE /identity/v3/users/58e9c5d9218d43ae8102772835d4ab97 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:24.674045 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8635d46-f7e8-4415-9ddf-194958cf4e24 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:24.674356 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8635d46-f7e8-4415-9ddf-194958cf4e24 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:24.674618 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8635d46-f7e8-4415-9ddf-194958cf4e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:24.692157 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-b8635d46-f7e8-4415-9ddf-194958cf4e24 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:24.693393 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-b8635d46-f7e8-4415-9ddf-194958cf4e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:24.751680 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 759/1508] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:07:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:24.761145 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527d9211-0fc6-4b38-8fbf-45c37c1f6e91 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:24.763064 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-527d9211-0fc6-4b38-8fbf-45c37c1f6e91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:24.819130 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527d9211-0fc6-4b38-8fbf-45c37c1f6e91 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:24.822654 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb68c2-85f1-4651-81c5-0bb89bc8cde9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:24.823289 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb68c2-85f1-4651-81c5-0bb89bc8cde9 service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:24.823571 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb68c2-85f1-4651-81c5-0bb89bc8cde9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:24.823888 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb68c2-85f1-4651-81c5-0bb89bc8cde9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:24.832651 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cb68c2-85f1-4651-81c5-0bb89bc8cde9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:24.834097 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cb68c2-85f1-4651-81c5-0bb89bc8cde9 service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:24.843893 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 750/1509] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:07:25.168384 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8635d46-f7e8-4415-9ddf-194958cf4e24 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:25.169855 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-b8635d46-f7e8-4415-9ddf-194958cf4e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:25.182045 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8635d46-f7e8-4415-9ddf-194958cf4e24 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:25.186899 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cb532b-51b6-4f2d-9cfc-ea01a79fe40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:25.187760 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb532b-51b6-4f2d-9cfc-ea01a79fe40c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:25.188103 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb532b-51b6-4f2d-9cfc-ea01a79fe40c admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:25.188385 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb532b-51b6-4f2d-9cfc-ea01a79fe40c admin admin] PATH_INFO: `/v3/projects/ed940a187f1e46318c6300364ae21ff7` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:25.189665 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cb532b-51b6-4f2d-9cfc-ea01a79fe40c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed940a187f1e46318c6300364ae21ff7)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:25.190690 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: WARNING py.warnings [None req-f9cb532b-51b6-4f2d-9cfc-ea01a79fe40c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:07:25.190690 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: warnings.warn(msg) Jun 20 06:07:25.190690 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: Jun 20 06:07:25.191968 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cb532b-51b6-4f2d-9cfc-ea01a79fe40c admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:25.256322 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-f9cb532b-51b6-4f2d-9cfc-ea01a79fe40c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed940a187f1e46318c6300364ae21ff7', 'request_id': 'req-f9cb532b-51b6-4f2d-9cfc-ea01a79fe40c'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:25.262879 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-f9cb532b-51b6-4f2d-9cfc-ea01a79fe40c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed940a187f1e46318c6300364ae21ff7', 'request_id': 'req-f9cb532b-51b6-4f2d-9cfc-ea01a79fe40c'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:25.272647 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-f9cb532b-51b6-4f2d-9cfc-ea01a79fe40c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed940a187f1e46318c6300364ae21ff7', 'request_id': 'req-f9cb532b-51b6-4f2d-9cfc-ea01a79fe40c'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:25.292092 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-f9cb532b-51b6-4f2d-9cfc-ea01a79fe40c admin admin] The token cache is being invalidate because project ed940a187f1e46318c6300364ae21ff7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:07:25.292382 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-f9cb532b-51b6-4f2d-9cfc-ea01a79fe40c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:25.293392 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-f9cb532b-51b6-4f2d-9cfc-ea01a79fe40c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:25.294934 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 760/1510] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:07:25 2022] DELETE /identity/v3/projects/ed940a187f1e46318c6300364ae21ff7 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:34.839295 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=29 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:35.288989 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:04.964586 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c782e8-dc9f-447b-8e97-d62c449bcb75 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:04.965204 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c782e8-dc9f-447b-8e97-d62c449bcb75 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:04.965204 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c782e8-dc9f-447b-8e97-d62c449bcb75 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:04.966540 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 751/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 06:09:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:09:04.972172 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bece9e-b85b-408b-97e8-ffc9ef2a1758 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:04.972605 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bece9e-b85b-408b-97e8-ffc9ef2a1758 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:04.972766 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bece9e-b85b-408b-97e8-ffc9ef2a1758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:04.991437 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-75bece9e-b85b-408b-97e8-ffc9ef2a1758 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:04.992652 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-75bece9e-b85b-408b-97e8-ffc9ef2a1758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:05.050601 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 761/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 06:09:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:05.205738 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c782e8-dc9f-447b-8e97-d62c449bcb75 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:05.207527 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-d9c782e8-dc9f-447b-8e97-d62c449bcb75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:05.284978 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c782e8-dc9f-447b-8e97-d62c449bcb75 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:05.290260 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44fecb6-4412-4c5c-913e-b168701c4a7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cee106502e54829ad802ee41c9165fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:05.290914 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44fecb6-4412-4c5c-913e-b168701c4a7a service nova] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:05.291200 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44fecb6-4412-4c5c-913e-b168701c4a7a service nova] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:05.291479 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44fecb6-4412-4c5c-913e-b168701c4a7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:05.299824 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44fecb6-4412-4c5c-913e-b168701c4a7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:05.301466 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44fecb6-4412-4c5c-913e-b168701c4a7a service nova] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:05.310961 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 752/1513] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:09:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:09:06.144020 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0ae14-df23-4714-8176-3d2921e6a1bf None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:06.144554 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0ae14-df23-4714-8176-3d2921e6a1bf None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:06.144554 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0ae14-df23-4714-8176-3d2921e6a1bf None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:06.145910 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 762/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 06:09:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:09:06.150927 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d05c3b-bbde-4910-9f4f-ee889411889e None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:06.151324 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d05c3b-bbde-4910-9f4f-ee889411889e None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:06.151493 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d05c3b-bbde-4910-9f4f-ee889411889e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:06.170556 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-83d05c3b-bbde-4910-9f4f-ee889411889e None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:06.172877 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-83d05c3b-bbde-4910-9f4f-ee889411889e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:06.180651 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 753/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 06:09:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:06.333929 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac0ae14-df23-4714-8176-3d2921e6a1bf None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:06.348657 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac0ae14-df23-4714-8176-3d2921e6a1bf None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:06.353908 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f3ac68-956d-49da-8167-4b1fda2637ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cee106502e54829ad802ee41c9165fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:06.354536 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3ac68-956d-49da-8167-4b1fda2637ce service nova] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:06.354813 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3ac68-956d-49da-8167-4b1fda2637ce service nova] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:06.355081 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3ac68-956d-49da-8167-4b1fda2637ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:06.364208 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f3ac68-956d-49da-8167-4b1fda2637ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:06.365824 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f3ac68-956d-49da-8167-4b1fda2637ce service nova] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:06.375488 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 763/1516] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:09:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:09:07.108975 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190a7c3-6fbb-40be-9cfa-73457e7d0c96 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:07.109300 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190a7c3-6fbb-40be-9cfa-73457e7d0c96 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:07.109681 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190a7c3-6fbb-40be-9cfa-73457e7d0c96 None None] PATH_INFO: `/v3` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:07.111042 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 754/1517] 10.222.0.42 () {54 vars in 925 bytes} [Mon Jun 20 06:09:07 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:09:07.117111 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0e70e-8cda-4eb1-a0df-f0949e1ecbec None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:07.117400 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0e70e-8cda-4eb1-a0df-f0949e1ecbec None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:07.117682 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0e70e-8cda-4eb1-a0df-f0949e1ecbec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:07.135678 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-97c0e70e-8cda-4eb1-a0df-f0949e1ecbec None None] MFA Rules not processed for user `6f0f9248178049cda6571fa365a21225`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:07.136904 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-97c0e70e-8cda-4eb1-a0df-f0949e1ecbec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:07.197309 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 764/1518] 10.222.0.42 () {58 vars in 1015 bytes} [Mon Jun 20 06:09:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:16.165449 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=37 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:16.443349 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd439e-2241-4ee1-9826-6b6eb053ed14 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:16.443560 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd439e-2241-4ee1-9826-6b6eb053ed14 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:16.443807 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd439e-2241-4ee1-9826-6b6eb053ed14 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:16.445236 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 755/1519] 10.222.0.39 () {54 vars in 960 bytes} [Mon Jun 20 06:09:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:09:16.450368 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61811d-2d71-4b17-8eb6-1bd387a38abf None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:16.450836 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61811d-2d71-4b17-8eb6-1bd387a38abf None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:16.450959 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61811d-2d71-4b17-8eb6-1bd387a38abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:16.468914 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-3f61811d-2d71-4b17-8eb6-1bd387a38abf None None] MFA Rules not processed for user `6f0f9248178049cda6571fa365a21225`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:16.470257 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-3f61811d-2d71-4b17-8eb6-1bd387a38abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:16.478863 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 765/1520] 10.222.0.39 () {58 vars in 1057 bytes} [Mon Jun 20 06:09:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:16.486978 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcd439e-2241-4ee1-9826-6b6eb053ed14 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:16.500916 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcd439e-2241-4ee1-9826-6b6eb053ed14 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:16.506633 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43753fdc-c776-4e22-a9ea-c1275558629b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f0f9248178049cda6571fa365a21225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:16.507276 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43753fdc-c776-4e22-a9ea-c1275558629b service placement] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:16.507554 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43753fdc-c776-4e22-a9ea-c1275558629b service placement] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:16.507823 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43753fdc-c776-4e22-a9ea-c1275558629b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:16.516394 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43753fdc-c776-4e22-a9ea-c1275558629b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:16.518370 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43753fdc-c776-4e22-a9ea-c1275558629b service placement] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:16.527991 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 756/1521] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:09:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:09:17.644561 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bbcfa-c0a5-4cbd-a263-ef882f63f15b None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:17.645134 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bbcfa-c0a5-4cbd-a263-ef882f63f15b None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:17.645134 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bbcfa-c0a5-4cbd-a263-ef882f63f15b None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:17.646544 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 766/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 06:09:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:09:17.651573 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca21cc-40a4-4145-bcf1-37c4697c1c8d None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:17.651964 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca21cc-40a4-4145-bcf1-37c4697c1c8d None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:17.652139 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca21cc-40a4-4145-bcf1-37c4697c1c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:17.669836 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-a2ca21cc-40a4-4145-bcf1-37c4697c1c8d None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:17.671060 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-a2ca21cc-40a4-4145-bcf1-37c4697c1c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:17.678920 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 757/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 06:09:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:17.837548 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22bbcfa-c0a5-4cbd-a263-ef882f63f15b None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:17.852448 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22bbcfa-c0a5-4cbd-a263-ef882f63f15b None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:17.857761 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a44a3b-e3b2-4611-a813-cbbdb5df9f8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cee106502e54829ad802ee41c9165fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:17.858654 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a44a3b-e3b2-4611-a813-cbbdb5df9f8f service nova] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:17.858934 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a44a3b-e3b2-4611-a813-cbbdb5df9f8f service nova] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:17.859206 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a44a3b-e3b2-4611-a813-cbbdb5df9f8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:17.867226 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a44a3b-e3b2-4611-a813-cbbdb5df9f8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:17.868867 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a44a3b-e3b2-4611-a813-cbbdb5df9f8f service nova] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:17.878590 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 767/1524] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:09:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:09:18.700904 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa8568-f656-4a8a-878f-29dec42b1347 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:18.701635 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa8568-f656-4a8a-878f-29dec42b1347 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:18.701635 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa8568-f656-4a8a-878f-29dec42b1347 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:18.702806 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 758/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 06:09:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:09:18.708647 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb28f75-fa0f-4015-ab15-fd11c36a4248 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:18.709139 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb28f75-fa0f-4015-ab15-fd11c36a4248 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:18.709248 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb28f75-fa0f-4015-ab15-fd11c36a4248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:18.729391 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-3cb28f75-fa0f-4015-ab15-fd11c36a4248 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:18.730601 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-3cb28f75-fa0f-4015-ab15-fd11c36a4248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:18.739034 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 768/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 06:09:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:18.894371 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaa8568-f656-4a8a-878f-29dec42b1347 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:18.909534 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaa8568-f656-4a8a-878f-29dec42b1347 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:18.914833 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814de845-f9d9-4dd9-8396-49692bc2887b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cee106502e54829ad802ee41c9165fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:18.915463 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814de845-f9d9-4dd9-8396-49692bc2887b service nova] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:18.915742 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814de845-f9d9-4dd9-8396-49692bc2887b service nova] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:18.916016 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814de845-f9d9-4dd9-8396-49692bc2887b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:18.924426 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814de845-f9d9-4dd9-8396-49692bc2887b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:18.926047 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814de845-f9d9-4dd9-8396-49692bc2887b service nova] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:18.935450 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 759/1527] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:09:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:09:22.972240 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a2a1f-cf32-467e-b268-ff2990c10234 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:22.972902 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a2a1f-cf32-467e-b268-ff2990c10234 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:22.972902 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a2a1f-cf32-467e-b268-ff2990c10234 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:22.974230 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 769/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 06:09:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:09:22.979660 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532815f-6512-4586-977d-614780258e65 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:22.980123 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532815f-6512-4586-977d-614780258e65 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:22.980230 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532815f-6512-4586-977d-614780258e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:22.998949 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-3532815f-6512-4586-977d-614780258e65 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:23.000140 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-3532815f-6512-4586-977d-614780258e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:23.008351 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 760/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 06:09:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:23.045254 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a2a1f-cf32-467e-b268-ff2990c10234 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:23.046932 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-050a2a1f-cf32-467e-b268-ff2990c10234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:23.104766 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a2a1f-cf32-467e-b268-ff2990c10234 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:23.108269 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76665339-5a79-40b3-95fb-ba0a9e78d660 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:23.109204 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76665339-5a79-40b3-95fb-ba0a9e78d660 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:23.109489 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76665339-5a79-40b3-95fb-ba0a9e78d660 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:23.109765 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76665339-5a79-40b3-95fb-ba0a9e78d660 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:23.119675 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76665339-5a79-40b3-95fb-ba0a9e78d660 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:23.121144 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76665339-5a79-40b3-95fb-ba0a9e78d660 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:23.126072 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:23.132288 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 770/1530] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:09:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:09:25.162359 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0a5c7-0ea5-44cb-bc36-b410712971a1 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:25.162917 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0a5c7-0ea5-44cb-bc36-b410712971a1 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:25.162917 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0a5c7-0ea5-44cb-bc36-b410712971a1 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:25.164389 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 761/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 06:09:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:09:25.169413 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42caeb79-a61d-4956-9596-802e3a70c5f0 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:25.169839 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42caeb79-a61d-4956-9596-802e3a70c5f0 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:25.169966 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42caeb79-a61d-4956-9596-802e3a70c5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:25.188434 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-42caeb79-a61d-4956-9596-802e3a70c5f0 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:25.189780 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-42caeb79-a61d-4956-9596-802e3a70c5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:25.197480 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 771/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 06:09:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:25.232762 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b0a5c7-0ea5-44cb-bc36-b410712971a1 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:25.247214 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b0a5c7-0ea5-44cb-bc36-b410712971a1 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:25.251262 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6946886-9cb4-4219-8be6-b51e29657902 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:25.252323 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6946886-9cb4-4219-8be6-b51e29657902 service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:25.252828 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6946886-9cb4-4219-8be6-b51e29657902 service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:25.253120 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6946886-9cb4-4219-8be6-b51e29657902 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:25.263330 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6946886-9cb4-4219-8be6-b51e29657902 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:25.264819 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6946886-9cb4-4219-8be6-b51e29657902 service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:25.276564 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 762/1533] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:09:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:09:28.777858 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8395ce-b0c7-47ca-8641-823862b5c6d1 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:28.778508 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8395ce-b0c7-47ca-8641-823862b5c6d1 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:28.778508 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8395ce-b0c7-47ca-8641-823862b5c6d1 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:28.779775 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 772/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 06:09:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:09:28.785623 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0705958-5272-4555-a391-48aefaeade50 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:28.786035 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0705958-5272-4555-a391-48aefaeade50 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:28.786182 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0705958-5272-4555-a391-48aefaeade50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:28.806642 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-c0705958-5272-4555-a391-48aefaeade50 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:28.807841 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-c0705958-5272-4555-a391-48aefaeade50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:28.815879 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 763/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 06:09:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:29.122704 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8395ce-b0c7-47ca-8641-823862b5c6d1 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:29.124442 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-ba8395ce-b0c7-47ca-8641-823862b5c6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:29.180826 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8395ce-b0c7-47ca-8641-823862b5c6d1 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:29.184279 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e335f-499c-4f48-8528-10344b5d9cc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:29.184941 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e335f-499c-4f48-8528-10344b5d9cc7 service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:29.185222 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e335f-499c-4f48-8528-10344b5d9cc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:29.185495 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e335f-499c-4f48-8528-10344b5d9cc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:29.194380 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e335f-499c-4f48-8528-10344b5d9cc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:29.195785 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e335f-499c-4f48-8528-10344b5d9cc7 service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:29.205663 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 773/1536] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:09:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:09:31.266438 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59f695-e80d-4f32-8157-14cdc9d1f3a4 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:31.267554 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59f695-e80d-4f32-8157-14cdc9d1f3a4 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:31.267651 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59f695-e80d-4f32-8157-14cdc9d1f3a4 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:31.269169 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 764/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 06:09:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:09:31.275900 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda00b6-4868-402a-9aa4-6058bc7a61b7 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:31.276391 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda00b6-4868-402a-9aa4-6058bc7a61b7 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:31.276557 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda00b6-4868-402a-9aa4-6058bc7a61b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:31.296392 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-acda00b6-4868-402a-9aa4-6058bc7a61b7 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:31.297648 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-acda00b6-4868-402a-9aa4-6058bc7a61b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:31.305491 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 774/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 06:09:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:31.605525 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f59f695-e80d-4f32-8157-14cdc9d1f3a4 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:31.607268 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-2f59f695-e80d-4f32-8157-14cdc9d1f3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:31.621241 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f59f695-e80d-4f32-8157-14cdc9d1f3a4 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:31.624744 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bca7a4-d093-43bf-99ad-c8198392b655 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:31.625381 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bca7a4-d093-43bf-99ad-c8198392b655 service cinder] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:31.625661 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bca7a4-d093-43bf-99ad-c8198392b655 service cinder] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:31.625934 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bca7a4-d093-43bf-99ad-c8198392b655 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:31.635492 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bca7a4-d093-43bf-99ad-c8198392b655 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:31.636932 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bca7a4-d093-43bf-99ad-c8198392b655 service cinder] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:31.646271 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 765/1539] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:09:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:09:41.291144 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=32 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:41.642280 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=33 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:00.576670 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd142725-d5ff-4f61-b0a5-e21ddd4e647d None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:00.577936 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd142725-d5ff-4f61-b0a5-e21ddd4e647d None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:00.577936 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd142725-d5ff-4f61-b0a5-e21ddd4e647d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:00.596189 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-dd142725-d5ff-4f61-b0a5-e21ddd4e647d None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:00.602475 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-dd142725-d5ff-4f61-b0a5-e21ddd4e647d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:00.614267 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 775/1540] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:00.624259 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6629f7-ce1d-40ed-93fd-febc1d90faeb None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:00.624873 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6629f7-ce1d-40ed-93fd-febc1d90faeb None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:00.625075 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6629f7-ce1d-40ed-93fd-febc1d90faeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:00.630520 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b000b-d162-4222-8653-f6a9d6ce60f3 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:00.630812 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b000b-d162-4222-8653-f6a9d6ce60f3 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:00.631097 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b000b-d162-4222-8653-f6a9d6ce60f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:00.650002 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-0d6629f7-ce1d-40ed-93fd-febc1d90faeb None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:00.651518 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-0d6629f7-ce1d-40ed-93fd-febc1d90faeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:00.658645 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-830b000b-d162-4222-8653-f6a9d6ce60f3 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:00.659934 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-830b000b-d162-4222-8653-f6a9d6ce60f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:00.667885 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 766/1541] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:00.669495 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827206a9-6132-4937-b74e-a581fce9a691 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:00.670022 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827206a9-6132-4937-b74e-a581fce9a691 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:00.670667 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827206a9-6132-4937-b74e-a581fce9a691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:00.678633 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 776/1542] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jun 20 06:11:00.680163 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf6533-fb46-4033-90ff-50b8c48c6b22 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:00.680625 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf6533-fb46-4033-90ff-50b8c48c6b22 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:00.681109 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf6533-fb46-4033-90ff-50b8c48c6b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:00.694888 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-827206a9-6132-4937-b74e-a581fce9a691 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:00.696538 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-827206a9-6132-4937-b74e-a581fce9a691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:00.700876 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-3cdf6533-fb46-4033-90ff-50b8c48c6b22 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:00.702040 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-3cdf6533-fb46-4033-90ff-50b8c48c6b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:00.706659 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 767/1543] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:00.708200 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c057f78-aef0-413d-9491-8febf86e6c85 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:00.708801 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c057f78-aef0-413d-9491-8febf86e6c85 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:00.709376 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c057f78-aef0-413d-9491-8febf86e6c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:00.717235 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 777/1544] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:00.718532 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b95cf0-6c49-4e04-aade-9ef1b0e47f10 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:00.720048 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b95cf0-6c49-4e04-aade-9ef1b0e47f10 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:00.720333 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b95cf0-6c49-4e04-aade-9ef1b0e47f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:00.738556 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-7c057f78-aef0-413d-9491-8febf86e6c85 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:00.739874 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-7c057f78-aef0-413d-9491-8febf86e6c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:00.753766 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-65b95cf0-6c49-4e04-aade-9ef1b0e47f10 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:00.754404 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 768/1545] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:00.754983 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-65b95cf0-6c49-4e04-aade-9ef1b0e47f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:00.755700 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c057f78-aef0-413d-9491-8febf86e6c85 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:00.764238 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 778/1546] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:00.765534 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200860d0-7dfc-4f02-a2ea-4ba92f96bb60 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:00.767863 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c057f78-aef0-413d-9491-8febf86e6c85 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:00.772130 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200860d0-7dfc-4f02-a2ea-4ba92f96bb60 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:00.772471 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200860d0-7dfc-4f02-a2ea-4ba92f96bb60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:00.775862 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde63f39-01e5-4c8e-a3a4-f673935a3b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:00.776534 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde63f39-01e5-4c8e-a3a4-f673935a3b63 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:00.776847 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde63f39-01e5-4c8e-a3a4-f673935a3b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:00.777153 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde63f39-01e5-4c8e-a3a4-f673935a3b63 admin admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:00.777914 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde63f39-01e5-4c8e-a3a4-f673935a3b63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:11:00.778220 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde63f39-01e5-4c8e-a3a4-f673935a3b63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:00.779267 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: WARNING py.warnings [None req-dde63f39-01e5-4c8e-a3a4-f673935a3b63 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:11:00.779267 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: warnings.warn(msg) Jun 20 06:11:00.779267 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: Jun 20 06:11:00.780169 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde63f39-01e5-4c8e-a3a4-f673935a3b63 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:00.791060 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-200860d0-7dfc-4f02-a2ea-4ba92f96bb60 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:00.792174 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 769/1547] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:11:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:11:00.792435 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-200860d0-7dfc-4f02-a2ea-4ba92f96bb60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:00.793435 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370baeb-5a55-4fdd-b029-826abfb43549 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:00.793726 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370baeb-5a55-4fdd-b029-826abfb43549 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:00.793995 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370baeb-5a55-4fdd-b029-826abfb43549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:00.800647 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 779/1548] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:00.801890 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd449d-0592-4c12-a32e-bce6bb69dd8e None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:00.802175 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd449d-0592-4c12-a32e-bce6bb69dd8e None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:00.802450 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd449d-0592-4c12-a32e-bce6bb69dd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:00.816126 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-0370baeb-5a55-4fdd-b029-826abfb43549 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:00.817353 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-0370baeb-5a55-4fdd-b029-826abfb43549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:00.821343 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-bdfd449d-0592-4c12-a32e-bce6bb69dd8e None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:00.822502 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-bdfd449d-0592-4c12-a32e-bce6bb69dd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:00.825221 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 770/1549] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:00.826425 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca69666-7540-4adc-bb65-078f3c27c41f None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:00.826755 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca69666-7540-4adc-bb65-078f3c27c41f None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:00.826979 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca69666-7540-4adc-bb65-078f3c27c41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:00.831818 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 780/1550] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:00.833163 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28112dc3-08b2-4c73-863a-3e7c0722c9f2 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:00.833698 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28112dc3-08b2-4c73-863a-3e7c0722c9f2 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:00.833979 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28112dc3-08b2-4c73-863a-3e7c0722c9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:00.844976 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-dca69666-7540-4adc-bb65-078f3c27c41f None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:00.846627 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-dca69666-7540-4adc-bb65-078f3c27c41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:00.851339 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-28112dc3-08b2-4c73-863a-3e7c0722c9f2 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:00.852516 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-28112dc3-08b2-4c73-863a-3e7c0722c9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:00.854424 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 771/1551] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:00.855640 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74225b-7572-41e6-afe2-d57ff06e9a9f None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:00.855926 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74225b-7572-41e6-afe2-d57ff06e9a9f None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:00.856207 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74225b-7572-41e6-afe2-d57ff06e9a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:00.866433 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 781/1552] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:00.867830 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9b207-8d20-47ef-97a7-65aa7e643e5f None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:00.868127 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9b207-8d20-47ef-97a7-65aa7e643e5f None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:00.868404 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9b207-8d20-47ef-97a7-65aa7e643e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:00.879091 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-9b74225b-7572-41e6-afe2-d57ff06e9a9f None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:00.880296 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-9b74225b-7572-41e6-afe2-d57ff06e9a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:00.887482 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-a5d9b207-8d20-47ef-97a7-65aa7e643e5f None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:00.888217 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 772/1553] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:00.888742 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-a5d9b207-8d20-47ef-97a7-65aa7e643e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:00.888886 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b74225b-7572-41e6-afe2-d57ff06e9a9f None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:00.897276 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 782/1554] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:00.898061 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d9b207-8d20-47ef-97a7-65aa7e643e5f None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:00.898761 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b74225b-7572-41e6-afe2-d57ff06e9a9f None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:00.903533 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abeb3ba-627b-43ca-a81c-e273dca29407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:00.904180 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abeb3ba-627b-43ca-a81c-e273dca29407 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:00.904460 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abeb3ba-627b-43ca-a81c-e273dca29407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:00.904761 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abeb3ba-627b-43ca-a81c-e273dca29407 admin admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:00.905454 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abeb3ba-627b-43ca-a81c-e273dca29407 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:00.907265 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d9b207-8d20-47ef-97a7-65aa7e643e5f None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:00.907384 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abeb3ba-627b-43ca-a81c-e273dca29407 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:00.912323 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b919eeb4-4f9b-4adc-9545-dd364e62b433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:00.912989 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919eeb4-4f9b-4adc-9545-dd364e62b433 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:00.913278 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919eeb4-4f9b-4adc-9545-dd364e62b433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:00.913553 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919eeb4-4f9b-4adc-9545-dd364e62b433 admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:00.914271 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b919eeb4-4f9b-4adc-9545-dd364e62b433 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:11:00.914579 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b919eeb4-4f9b-4adc-9545-dd364e62b433 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:00.916165 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b919eeb4-4f9b-4adc-9545-dd364e62b433 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:00.928364 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 783/1555] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:11:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:11:00.929218 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b919eeb4-4f9b-4adc-9545-dd364e62b433 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:00.934555 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 773/1556] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:11:00 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:00.935452 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abeb3ba-627b-43ca-a81c-e273dca29407 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:00.946370 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b919eeb4-4f9b-4adc-9545-dd364e62b433 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:01.002738 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abeb3ba-627b-43ca-a81c-e273dca29407 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:01.005730 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf94a3-800b-4d22-aa9f-eed124f9736a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:01.006389 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf94a3-800b-4d22-aa9f-eed124f9736a admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:01.006685 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf94a3-800b-4d22-aa9f-eed124f9736a admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:01.006981 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf94a3-800b-4d22-aa9f-eed124f9736a admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:01.007662 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cf94a3-800b-4d22-aa9f-eed124f9736a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:11:01.007964 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cf94a3-800b-4d22-aa9f-eed124f9736a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:01.008541 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8183f1-a07f-4d31-8829-19afdd509225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:01.009427 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8183f1-a07f-4d31-8829-19afdd509225 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:01.009616 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cf94a3-800b-4d22-aa9f-eed124f9736a admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:01.009912 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8183f1-a07f-4d31-8829-19afdd509225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:01.010331 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8183f1-a07f-4d31-8829-19afdd509225 admin admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:01.011337 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8183f1-a07f-4d31-8829-19afdd509225 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:11:01.011826 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8183f1-a07f-4d31-8829-19afdd509225 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:01.013886 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8183f1-a07f-4d31-8829-19afdd509225 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:01.021367 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 784/1557] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:11:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:11:01.022643 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303429f-1c3c-4724-a640-52ea378cf7f0 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:01.022926 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303429f-1c3c-4724-a640-52ea378cf7f0 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:01.023203 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303429f-1c3c-4724-a640-52ea378cf7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:01.026389 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 774/1558] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:11:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:11:01.027844 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb5432-968b-44b8-9e6b-9bdbc1e6bafc None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:01.028332 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb5432-968b-44b8-9e6b-9bdbc1e6bafc None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:01.028616 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb5432-968b-44b8-9e6b-9bdbc1e6bafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:01.045531 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-a303429f-1c3c-4724-a640-52ea378cf7f0 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:01.046725 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-a303429f-1c3c-4724-a640-52ea378cf7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:01.047778 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-f5fb5432-968b-44b8-9e6b-9bdbc1e6bafc None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:01.049088 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-f5fb5432-968b-44b8-9e6b-9bdbc1e6bafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:01.055329 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 785/1559] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:01.056228 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a303429f-1c3c-4724-a640-52ea378cf7f0 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:01.060991 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 775/1560] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:01.061953 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb5432-968b-44b8-9e6b-9bdbc1e6bafc None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:01.065811 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a303429f-1c3c-4724-a640-52ea378cf7f0 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:01.070587 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac7bcc-df8a-49f9-b145-f3861c961650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:01.071307 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac7bcc-df8a-49f9-b145-f3861c961650 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:01.071582 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb5432-968b-44b8-9e6b-9bdbc1e6bafc None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:01.071848 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac7bcc-df8a-49f9-b145-f3861c961650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:01.072189 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac7bcc-df8a-49f9-b145-f3861c961650 admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:01.072941 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ac7bcc-df8a-49f9-b145-f3861c961650 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:11:01.073248 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ac7bcc-df8a-49f9-b145-f3861c961650 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:01.074887 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ac7bcc-df8a-49f9-b145-f3861c961650 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:01.076115 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239eaa1-71e1-4a2b-a663-0f448939d5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:01.076837 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239eaa1-71e1-4a2b-a663-0f448939d5b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:01.077064 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239eaa1-71e1-4a2b-a663-0f448939d5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:01.077334 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239eaa1-71e1-4a2b-a663-0f448939d5b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:01.078045 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3239eaa1-71e1-4a2b-a663-0f448939d5b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:11:01.078349 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3239eaa1-71e1-4a2b-a663-0f448939d5b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:01.079959 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3239eaa1-71e1-4a2b-a663-0f448939d5b3 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:01.092254 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 786/1561] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:11:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:11:01.092254 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac7bcc-df8a-49f9-b145-f3861c961650 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:01.097834 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 776/1562] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:11:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:11:01.098505 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239eaa1-71e1-4a2b-a663-0f448939d5b3 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:01.098625 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac7bcc-df8a-49f9-b145-f3861c961650 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:01.103461 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb651a-aa64-4863-9c92-71c52572ba96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:01.104128 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb651a-aa64-4863-9c92-71c52572ba96 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:01.104410 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb651a-aa64-4863-9c92-71c52572ba96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:01.104691 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb651a-aa64-4863-9c92-71c52572ba96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:01.105463 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cb651a-aa64-4863-9c92-71c52572ba96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:01.106505 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: WARNING py.warnings [None req-84cb651a-aa64-4863-9c92-71c52572ba96 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:11:01.106505 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: warnings.warn(msg) Jun 20 06:11:01.106505 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: Jun 20 06:11:01.107682 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cb651a-aa64-4863-9c92-71c52572ba96 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:01.108933 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239eaa1-71e1-4a2b-a663-0f448939d5b3 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:01.114308 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a3d33d-d96b-4f0a-a68b-c4aa5b079a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:01.114951 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3d33d-d96b-4f0a-a68b-c4aa5b079a30 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:01.115227 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3d33d-d96b-4f0a-a68b-c4aa5b079a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:01.115501 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3d33d-d96b-4f0a-a68b-c4aa5b079a30 admin admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:01.116183 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a3d33d-d96b-4f0a-a68b-c4aa5b079a30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:01.117212 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: WARNING py.warnings [None req-d1a3d33d-d96b-4f0a-a68b-c4aa5b079a30 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:11:01.117212 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: warnings.warn(msg) Jun 20 06:11:01.117212 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: Jun 20 06:11:01.118395 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a3d33d-d96b-4f0a-a68b-c4aa5b079a30 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:01.136422 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 787/1563] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:11:01 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:01.137314 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb651a-aa64-4863-9c92-71c52572ba96 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:01.141540 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 777/1564] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:11:01 2022] POST /identity/v3/users => generated 283 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:01.141540 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a3d33d-d96b-4f0a-a68b-c4aa5b079a30 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:01.151360 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a3d33d-d96b-4f0a-a68b-c4aa5b079a30 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:01.188077 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:01.192844 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:01.204109 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb651a-aa64-4863-9c92-71c52572ba96 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:01.209216 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a4b61-ca92-4606-a09f-e84ea5bcaecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:01.209409 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98422e0f-573d-4073-b17f-16a5033c7405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:01.209875 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a4b61-ca92-4606-a09f-e84ea5bcaecc admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:01.210065 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98422e0f-573d-4073-b17f-16a5033c7405 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:01.210183 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a4b61-ca92-4606-a09f-e84ea5bcaecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:01.210346 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98422e0f-573d-4073-b17f-16a5033c7405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:01.210451 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a4b61-ca92-4606-a09f-e84ea5bcaecc admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:01.210617 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98422e0f-573d-4073-b17f-16a5033c7405 admin admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:01.211146 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a4b61-ca92-4606-a09f-e84ea5bcaecc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:01.211327 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98422e0f-573d-4073-b17f-16a5033c7405 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:01.213130 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a4b61-ca92-4606-a09f-e84ea5bcaecc admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:01.213261 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98422e0f-573d-4073-b17f-16a5033c7405 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:01.238957 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 788/1565] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:11:01 2022] POST /identity/v3/projects => generated 387 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:01.240044 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a4b61-ca92-4606-a09f-e84ea5bcaecc admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:01.240172 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 778/1566] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:11:01 2022] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:01.240717 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98422e0f-573d-4073-b17f-16a5033c7405 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:01.305552 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98422e0f-573d-4073-b17f-16a5033c7405 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:01.307549 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a4b61-ca92-4606-a09f-e84ea5bcaecc admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:01.310207 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2326681d-a01d-47c6-8f35-8d6c23e1cf1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:01.310857 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326681d-a01d-47c6-8f35-8d6c23e1cf1e admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:01.311135 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326681d-a01d-47c6-8f35-8d6c23e1cf1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:01.311407 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326681d-a01d-47c6-8f35-8d6c23e1cf1e admin admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:01.312124 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2326681d-a01d-47c6-8f35-8d6c23e1cf1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:11:01.312317 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead3a1e-dae6-48ce-91dc-640f162eed50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:01.312442 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2326681d-a01d-47c6-8f35-8d6c23e1cf1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:01.313023 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead3a1e-dae6-48ce-91dc-640f162eed50 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:01.313420 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead3a1e-dae6-48ce-91dc-640f162eed50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:01.313702 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead3a1e-dae6-48ce-91dc-640f162eed50 admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:01.314083 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2326681d-a01d-47c6-8f35-8d6c23e1cf1e admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:01.314430 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead3a1e-dae6-48ce-91dc-640f162eed50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:11:01.314738 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead3a1e-dae6-48ce-91dc-640f162eed50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:01.317066 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead3a1e-dae6-48ce-91dc-640f162eed50 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:01.325851 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 779/1567] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:11:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:11:01.337253 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 789/1568] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:11:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:11:01.337253 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead3a1e-dae6-48ce-91dc-640f162eed50 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:01.337501 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2326681d-a01d-47c6-8f35-8d6c23e1cf1e admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:01.344611 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2326681d-a01d-47c6-8f35-8d6c23e1cf1e admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:01.344782 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead3a1e-dae6-48ce-91dc-640f162eed50 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:01.349818 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e3f3be-778e-46ed-94cd-9fa8ff0e3aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:01.350271 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8173f2f7-ab59-40ac-bc40-7d3053b83a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:01.350479 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3f3be-778e-46ed-94cd-9fa8ff0e3aed admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:01.350740 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3f3be-778e-46ed-94cd-9fa8ff0e3aed admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:01.350922 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173f2f7-ab59-40ac-bc40-7d3053b83a75 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:01.351035 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3f3be-778e-46ed-94cd-9fa8ff0e3aed admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:01.351201 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173f2f7-ab59-40ac-bc40-7d3053b83a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:01.351465 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173f2f7-ab59-40ac-bc40-7d3053b83a75 admin admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:01.351686 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e3f3be-778e-46ed-94cd-9fa8ff0e3aed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:01.352161 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8173f2f7-ab59-40ac-bc40-7d3053b83a75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:01.353622 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e3f3be-778e-46ed-94cd-9fa8ff0e3aed admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:01.354313 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8173f2f7-ab59-40ac-bc40-7d3053b83a75 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:01.383927 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 790/1569] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:11:01 2022] POST /identity/v3/projects => generated 393 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:01.383927 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e3f3be-778e-46ed-94cd-9fa8ff0e3aed admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:01.384276 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 780/1570] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:11:01 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:01.384276 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8173f2f7-ab59-40ac-bc40-7d3053b83a75 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:01.445139 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e3f3be-778e-46ed-94cd-9fa8ff0e3aed admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:01.450135 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5b1570-a1f7-4fc6-9908-c942387920c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:01.450780 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8173f2f7-ab59-40ac-bc40-7d3053b83a75 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:01.450941 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b1570-a1f7-4fc6-9908-c942387920c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:01.451293 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b1570-a1f7-4fc6-9908-c942387920c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:01.451574 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b1570-a1f7-4fc6-9908-c942387920c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:01.452260 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5b1570-a1f7-4fc6-9908-c942387920c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:01.454212 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5b1570-a1f7-4fc6-9908-c942387920c1 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:01.458675 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa2c0a-69c6-4b64-9115-e0021ce9d497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:01.459428 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa2c0a-69c6-4b64-9115-e0021ce9d497 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:01.459718 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa2c0a-69c6-4b64-9115-e0021ce9d497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:01.460025 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa2c0a-69c6-4b64-9115-e0021ce9d497 admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:01.460827 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fa2c0a-69c6-4b64-9115-e0021ce9d497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:01.462825 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fa2c0a-69c6-4b64-9115-e0021ce9d497 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:01.475127 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 781/1571] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:01 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:01.475930 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 791/1572] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:11:01 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:01.476258 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa2c0a-69c6-4b64-9115-e0021ce9d497 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:01.476734 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5b1570-a1f7-4fc6-9908-c942387920c1 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:01.486521 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa2c0a-69c6-4b64-9115-e0021ce9d497 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:01.490060 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5b1570-a1f7-4fc6-9908-c942387920c1 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:01.491077 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1485f6-273e-4e8a-9114-8d55b1c9a05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:01.491706 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1485f6-273e-4e8a-9114-8d55b1c9a05f admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:01.491991 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1485f6-273e-4e8a-9114-8d55b1c9a05f admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:01.492264 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1485f6-273e-4e8a-9114-8d55b1c9a05f admin admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:01.492985 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1485f6-273e-4e8a-9114-8d55b1c9a05f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:01.494875 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1485f6-273e-4e8a-9114-8d55b1c9a05f admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:01.495010 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d5322c-4fcf-4a8e-9584-7d28acdbbab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:01.495579 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5322c-4fcf-4a8e-9584-7d28acdbbab5 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:01.495858 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5322c-4fcf-4a8e-9584-7d28acdbbab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:01.496238 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5322c-4fcf-4a8e-9584-7d28acdbbab5 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:01.496942 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d5322c-4fcf-4a8e-9584-7d28acdbbab5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:01.498909 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d5322c-4fcf-4a8e-9584-7d28acdbbab5 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:01.515785 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 782/1573] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:11:01 2022] POST /identity/v3/users => generated 294 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:01.516567 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1485f6-273e-4e8a-9114-8d55b1c9a05f admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:01.524918 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 792/1574] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:11:01 2022] POST /identity/v3/users => generated 292 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:01.524918 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d5322c-4fcf-4a8e-9584-7d28acdbbab5 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:01.529251 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1485f6-273e-4e8a-9114-8d55b1c9a05f admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:01.532383 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d5322c-4fcf-4a8e-9584-7d28acdbbab5 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:01.533835 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0028fab-ba13-47fe-9d20-b4e8e3d08e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:01.534596 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0028fab-ba13-47fe-9d20-b4e8e3d08e52 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:01.534878 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0028fab-ba13-47fe-9d20-b4e8e3d08e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:01.535152 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0028fab-ba13-47fe-9d20-b4e8e3d08e52 admin admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:01.535834 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0028fab-ba13-47fe-9d20-b4e8e3d08e52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:01.537298 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf81cf-eeba-49b7-944e-5e4e4693ac8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:01.537744 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0028fab-ba13-47fe-9d20-b4e8e3d08e52 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:01.537925 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf81cf-eeba-49b7-944e-5e4e4693ac8a admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:01.538205 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf81cf-eeba-49b7-944e-5e4e4693ac8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:01.538477 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf81cf-eeba-49b7-944e-5e4e4693ac8a admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:01.539153 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdf81cf-eeba-49b7-944e-5e4e4693ac8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:01.541044 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdf81cf-eeba-49b7-944e-5e4e4693ac8a admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:01.552436 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:01.555362 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:01.570847 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 783/1575] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:11:01 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:01.570847 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0028fab-ba13-47fe-9d20-b4e8e3d08e52 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:01.571123 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 793/1576] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:11:01 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:01.573117 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf81cf-eeba-49b7-944e-5e4e4693ac8a admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:01.631658 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0028fab-ba13-47fe-9d20-b4e8e3d08e52 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:01.636170 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d17b2-a233-4e21-af0e-b6a3d7d724a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:01.636874 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d17b2-a233-4e21-af0e-b6a3d7d724a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:01.637156 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d17b2-a233-4e21-af0e-b6a3d7d724a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:01.637457 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d17b2-a233-4e21-af0e-b6a3d7d724a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:01.638141 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401d17b2-a233-4e21-af0e-b6a3d7d724a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:01.639382 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf81cf-eeba-49b7-944e-5e4e4693ac8a admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:01.640043 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401d17b2-a233-4e21-af0e-b6a3d7d724a1 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:01.644481 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1daee8-484b-4a8b-9158-192e6023524e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:01.645178 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1daee8-484b-4a8b-9158-192e6023524e admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:01.645463 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1daee8-484b-4a8b-9158-192e6023524e admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:01.645744 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1daee8-484b-4a8b-9158-192e6023524e admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:01.646433 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1daee8-484b-4a8b-9158-192e6023524e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:01.648391 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1daee8-484b-4a8b-9158-192e6023524e admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:01.662171 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 784/1577] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:11:01 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:01.662844 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d17b2-a233-4e21-af0e-b6a3d7d724a1 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:01.672038 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 794/1578] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:11:01 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:01.672330 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d17b2-a233-4e21-af0e-b6a3d7d724a1 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:01.673003 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1daee8-484b-4a8b-9158-192e6023524e admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:01.677159 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e2fd3-a3aa-4b21-a0b0-13bb2692f969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:01.677801 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e2fd3-a3aa-4b21-a0b0-13bb2692f969 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:01.678082 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e2fd3-a3aa-4b21-a0b0-13bb2692f969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:01.678352 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e2fd3-a3aa-4b21-a0b0-13bb2692f969 admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:01.679515 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e2fd3-a3aa-4b21-a0b0-13bb2692f969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:01.680719 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e2fd3-a3aa-4b21-a0b0-13bb2692f969 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:01.682686 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1daee8-484b-4a8b-9158-192e6023524e admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:01.687287 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f014d-61e5-494a-b002-b204d3edc825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:01.687980 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f014d-61e5-494a-b002-b204d3edc825 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:01.688269 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f014d-61e5-494a-b002-b204d3edc825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:01.688546 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f014d-61e5-494a-b002-b204d3edc825 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:01.689294 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2f014d-61e5-494a-b002-b204d3edc825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:01.691450 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2f014d-61e5-494a-b002-b204d3edc825 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:01.691568 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 785/1579] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:01.692369 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e2fd3-a3aa-4b21-a0b0-13bb2692f969 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:01.701639 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 795/1580] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:01.702379 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f014d-61e5-494a-b002-b204d3edc825 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:01.702487 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e2fd3-a3aa-4b21-a0b0-13bb2692f969 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:01.708060 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed2124-e0d1-4c2f-9df8-862863f27edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:01.708852 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed2124-e0d1-4c2f-9df8-862863f27edd admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:01.709196 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed2124-e0d1-4c2f-9df8-862863f27edd admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:01.709531 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed2124-e0d1-4c2f-9df8-862863f27edd admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:01.710319 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ed2124-e0d1-4c2f-9df8-862863f27edd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:01.711990 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ed2124-e0d1-4c2f-9df8-862863f27edd admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:01.712256 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f014d-61e5-494a-b002-b204d3edc825 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:01.716809 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e700705d-d9cc-4c24-af03-0998561b9b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:01.717449 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700705d-d9cc-4c24-af03-0998561b9b44 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:01.717739 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700705d-d9cc-4c24-af03-0998561b9b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:01.718015 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700705d-d9cc-4c24-af03-0998561b9b44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:01.718790 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e700705d-d9cc-4c24-af03-0998561b9b44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:01.720361 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e700705d-d9cc-4c24-af03-0998561b9b44 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:01.723453 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 786/1581] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:01.724223 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed2124-e0d1-4c2f-9df8-862863f27edd admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:01.733873 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 796/1582] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:01.733873 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e700705d-d9cc-4c24-af03-0998561b9b44 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:01.736868 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed2124-e0d1-4c2f-9df8-862863f27edd admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:01.741437 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403001b-ee7a-4543-990f-5d45f93696f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:01.742114 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403001b-ee7a-4543-990f-5d45f93696f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:01.742388 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403001b-ee7a-4543-990f-5d45f93696f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:01.742598 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e700705d-d9cc-4c24-af03-0998561b9b44 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:01.742721 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403001b-ee7a-4543-990f-5d45f93696f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:01.743328 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5403001b-ee7a-4543-990f-5d45f93696f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:01.745248 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5403001b-ee7a-4543-990f-5d45f93696f6 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:01.747069 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3eb236-1300-418d-bd22-b3fc02f98234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:01.747707 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3eb236-1300-418d-bd22-b3fc02f98234 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:01.748021 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3eb236-1300-418d-bd22-b3fc02f98234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:01.748284 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3eb236-1300-418d-bd22-b3fc02f98234 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:01.748988 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3eb236-1300-418d-bd22-b3fc02f98234 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:01.750849 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3eb236-1300-418d-bd22-b3fc02f98234 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:01.766584 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 787/1583] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:11:01 2022] POST /identity/v3/users => generated 289 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:01.767386 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403001b-ee7a-4543-990f-5d45f93696f6 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:01.772620 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 797/1584] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:11:01 2022] POST /identity/v3/users => generated 292 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:01.773511 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3eb236-1300-418d-bd22-b3fc02f98234 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:01.778165 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403001b-ee7a-4543-990f-5d45f93696f6 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:01.782926 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914259fa-80ad-4a60-b837-ab388e22b956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:01.783507 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3eb236-1300-418d-bd22-b3fc02f98234 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:01.783666 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914259fa-80ad-4a60-b837-ab388e22b956 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:01.783936 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914259fa-80ad-4a60-b837-ab388e22b956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:01.784218 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914259fa-80ad-4a60-b837-ab388e22b956 admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:01.785181 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914259fa-80ad-4a60-b837-ab388e22b956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:01.786695 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914259fa-80ad-4a60-b837-ab388e22b956 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:01.788570 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f65b7-fa02-4061-b796-bce218ed14a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:01.789376 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f65b7-fa02-4061-b796-bce218ed14a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:01.789727 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f65b7-fa02-4061-b796-bce218ed14a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:01.790010 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f65b7-fa02-4061-b796-bce218ed14a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:01.790741 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66f65b7-fa02-4061-b796-bce218ed14a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:01.792314 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66f65b7-fa02-4061-b796-bce218ed14a3 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:01.797017 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 788/1585] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:01.797775 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914259fa-80ad-4a60-b837-ab388e22b956 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:01.805475 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 798/1586] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:01.806320 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f65b7-fa02-4061-b796-bce218ed14a3 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:01.807498 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914259fa-80ad-4a60-b837-ab388e22b956 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:01.812289 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c26702-25ca-4e87-9afa-8a1d61d979cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:01.813197 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c26702-25ca-4e87-9afa-8a1d61d979cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:01.813467 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c26702-25ca-4e87-9afa-8a1d61d979cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:01.813740 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c26702-25ca-4e87-9afa-8a1d61d979cf admin admin] PATH_INFO: `/v3/projects/a51e9b198bd94915b23fdfe8e7e4dafd/users/d7049b6e4fe847a98968263944fad13c/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:01.816337 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f65b7-fa02-4061-b796-bce218ed14a3 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:01.820913 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c5995-df19-4a8f-a4b3-becfddd2cc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:01.821553 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c5995-df19-4a8f-a4b3-becfddd2cc34 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:01.821839 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c5995-df19-4a8f-a4b3-becfddd2cc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:01.822117 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c5995-df19-4a8f-a4b3-becfddd2cc34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:01.822834 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596c5995-df19-4a8f-a4b3-becfddd2cc34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:01.824435 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596c5995-df19-4a8f-a4b3-becfddd2cc34 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:01.829519 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c26702-25ca-4e87-9afa-8a1d61d979cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a51e9b198bd94915b23fdfe8e7e4dafd, user_id=d7049b6e4fe847a98968263944fad13c, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:01.833014 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c26702-25ca-4e87-9afa-8a1d61d979cf admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:01.836161 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 799/1587] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:01.837094 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c5995-df19-4a8f-a4b3-becfddd2cc34 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:01.847316 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c5995-df19-4a8f-a4b3-becfddd2cc34 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:01.850198 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 789/1588] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:01 2022] PUT /identity/v3/projects/a51e9b198bd94915b23fdfe8e7e4dafd/users/d7049b6e4fe847a98968263944fad13c/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:01.851148 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c26702-25ca-4e87-9afa-8a1d61d979cf admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:01.914037 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6298f9fe-0b1c-4d25-8288-227f39773733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:01.914622 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298f9fe-0b1c-4d25-8288-227f39773733 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:01.914903 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298f9fe-0b1c-4d25-8288-227f39773733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:01.915139 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c26702-25ca-4e87-9afa-8a1d61d979cf admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:01.915257 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298f9fe-0b1c-4d25-8288-227f39773733 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:01.915886 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6298f9fe-0b1c-4d25-8288-227f39773733 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:01.917596 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6298f9fe-0b1c-4d25-8288-227f39773733 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:01.920296 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff39c9-f573-47d0-8f9c-efbf5efa648d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:01.921078 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff39c9-f573-47d0-8f9c-efbf5efa648d admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:01.921431 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff39c9-f573-47d0-8f9c-efbf5efa648d admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:01.921775 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff39c9-f573-47d0-8f9c-efbf5efa648d admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:01.922573 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ff39c9-f573-47d0-8f9c-efbf5efa648d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:01.924596 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ff39c9-f573-47d0-8f9c-efbf5efa648d admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:01.928245 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 800/1589] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:01 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:01.929150 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6298f9fe-0b1c-4d25-8288-227f39773733 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:01.935138 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 790/1590] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:01 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:01.936025 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff39c9-f573-47d0-8f9c-efbf5efa648d admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:01.939513 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6298f9fe-0b1c-4d25-8288-227f39773733 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:01.944999 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e8896-1055-4ab5-a4f5-33a3777bdffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:01.945650 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e8896-1055-4ab5-a4f5-33a3777bdffb admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:01.945931 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e8896-1055-4ab5-a4f5-33a3777bdffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:01.946206 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e8896-1055-4ab5-a4f5-33a3777bdffb admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:01.946925 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363e8896-1055-4ab5-a4f5-33a3777bdffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:01.947447 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff39c9-f573-47d0-8f9c-efbf5efa648d admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:01.948492 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363e8896-1055-4ab5-a4f5-33a3777bdffb admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:01.952219 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26887c9e-8147-4ef5-9442-cd97719c5544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:01.952902 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26887c9e-8147-4ef5-9442-cd97719c5544 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:01.953219 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26887c9e-8147-4ef5-9442-cd97719c5544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:01.953494 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26887c9e-8147-4ef5-9442-cd97719c5544 admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:01.954211 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26887c9e-8147-4ef5-9442-cd97719c5544 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:01.956419 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26887c9e-8147-4ef5-9442-cd97719c5544 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:01.957809 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:01.963293 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 801/1591] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:01.963293 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e8896-1055-4ab5-a4f5-33a3777bdffb admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:01.969684 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 791/1592] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:01.969684 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26887c9e-8147-4ef5-9442-cd97719c5544 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:01.974992 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e8896-1055-4ab5-a4f5-33a3777bdffb admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:01.978494 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26887c9e-8147-4ef5-9442-cd97719c5544 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:01.980971 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888de475-bdf4-4588-a121-665f4c0b8968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:01.981638 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888de475-bdf4-4588-a121-665f4c0b8968 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:01.981923 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888de475-bdf4-4588-a121-665f4c0b8968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:01.982201 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888de475-bdf4-4588-a121-665f4c0b8968 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:01.982929 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888de475-bdf4-4588-a121-665f4c0b8968 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:01.983625 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ab79d-3a92-40b9-8143-d1a4716965a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:01.984426 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ab79d-3a92-40b9-8143-d1a4716965a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:01.984534 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888de475-bdf4-4588-a121-665f4c0b8968 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:01.984784 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ab79d-3a92-40b9-8143-d1a4716965a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:01.985078 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ab79d-3a92-40b9-8143-d1a4716965a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:01.986078 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9ab79d-3a92-40b9-8143-d1a4716965a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:01.986347 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:01.988829 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9ab79d-3a92-40b9-8143-d1a4716965a0 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:01.997881 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 802/1593] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:01.998930 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888de475-bdf4-4588-a121-665f4c0b8968 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:02.003054 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 792/1594] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:02.003054 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc689c2-1c31-4ffb-99d4-a44fc1a7006f None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:02.003054 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc689c2-1c31-4ffb-99d4-a44fc1a7006f None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:02.003054 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc689c2-1c31-4ffb-99d4-a44fc1a7006f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:02.012994 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888de475-bdf4-4588-a121-665f4c0b8968 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:02.017751 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1870d7f7-4f34-4726-8daf-07f39cb4503c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:02.018935 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870d7f7-4f34-4726-8daf-07f39cb4503c admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:02.019221 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870d7f7-4f34-4726-8daf-07f39cb4503c admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:02.019506 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870d7f7-4f34-4726-8daf-07f39cb4503c admin admin] PATH_INFO: `/v3/projects/fd4e2582757e45f1bf920e428d02df36/users/94d729112cc748e4abfb8a33a939348e/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:02.028234 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-bfc689c2-1c31-4ffb-99d4-a44fc1a7006f None None] MFA Rules not processed for user `d7049b6e4fe847a98968263944fad13c`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:02.029501 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-bfc689c2-1c31-4ffb-99d4-a44fc1a7006f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:02.033461 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1870d7f7-4f34-4726-8daf-07f39cb4503c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd4e2582757e45f1bf920e428d02df36, user_id=94d729112cc748e4abfb8a33a939348e, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:02.035175 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: WARNING py.warnings [None req-1870d7f7-4f34-4726-8daf-07f39cb4503c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:11:02.035175 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: warnings.warn(msg) Jun 20 06:11:02.035175 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: Jun 20 06:11:02.037119 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1870d7f7-4f34-4726-8daf-07f39cb4503c admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:02.051149 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 803/1595] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:01 2022] PUT /identity/v3/projects/fd4e2582757e45f1bf920e428d02df36/users/94d729112cc748e4abfb8a33a939348e/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:02.052333 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1870d7f7-4f34-4726-8daf-07f39cb4503c admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:02.100897 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 793/1596] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:01 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:02.104530 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc689c2-1c31-4ffb-99d4-a44fc1a7006f None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:02.112129 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc689c2-1c31-4ffb-99d4-a44fc1a7006f None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:02.122080 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1870d7f7-4f34-4726-8daf-07f39cb4503c admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:02.126835 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fcd91b-f555-4205-9463-ec7bf316d465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:02.127737 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fcd91b-f555-4205-9463-ec7bf316d465 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:02.128020 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fcd91b-f555-4205-9463-ec7bf316d465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:02.128309 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fcd91b-f555-4205-9463-ec7bf316d465 admin admin] PATH_INFO: `/v3/projects/0b2cb11b20af48f8b0e9f0a4cf1b9406/users/498822fcffaf4cc79532c487418cb11c/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:02.143468 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fcd91b-f555-4205-9463-ec7bf316d465 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b2cb11b20af48f8b0e9f0a4cf1b9406, user_id=498822fcffaf4cc79532c487418cb11c, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:02.146453 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fcd91b-f555-4205-9463-ec7bf316d465 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:02.160306 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 804/1597] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:02 2022] PUT /identity/v3/projects/0b2cb11b20af48f8b0e9f0a4cf1b9406/users/498822fcffaf4cc79532c487418cb11c/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:02.161327 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fcd91b-f555-4205-9463-ec7bf316d465 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:02.168961 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d82c2-fada-45fd-86c3-fb914ec73b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:02.169795 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d82c2-fada-45fd-86c3-fb914ec73b5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:02.170080 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d82c2-fada-45fd-86c3-fb914ec73b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:02.170358 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d82c2-fada-45fd-86c3-fb914ec73b5f admin admin] PATH_INFO: `/v3/projects/7782a6af4a7c4b0da1fa667510e62c45/users/90233eaed7c24bfca8e83f6e0f66c950/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:02.185291 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d82c2-fada-45fd-86c3-fb914ec73b5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7782a6af4a7c4b0da1fa667510e62c45, user_id=90233eaed7c24bfca8e83f6e0f66c950, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:02.188084 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d82c2-fada-45fd-86c3-fb914ec73b5f admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:02.202034 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 794/1598] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:02 2022] PUT /identity/v3/projects/7782a6af4a7c4b0da1fa667510e62c45/users/90233eaed7c24bfca8e83f6e0f66c950/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:02.203013 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d82c2-fada-45fd-86c3-fb914ec73b5f admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:02.225716 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fcd91b-f555-4205-9463-ec7bf316d465 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:02.263753 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:02.267803 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d82c2-fada-45fd-86c3-fb914ec73b5f admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:02.277767 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e3678-d41f-4f72-b307-b8435c2c7e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:02.278452 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e3678-d41f-4f72-b307-b8435c2c7e4c admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:02.278736 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e3678-d41f-4f72-b307-b8435c2c7e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:02.279026 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e3678-d41f-4f72-b307-b8435c2c7e4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:02.279761 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1e3678-d41f-4f72-b307-b8435c2c7e4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:02.281437 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1e3678-d41f-4f72-b307-b8435c2c7e4c admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:02.286304 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390b6259-cda7-47b7-93ee-c520ec181d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:02.286977 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b6259-cda7-47b7-93ee-c520ec181d04 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:02.287267 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b6259-cda7-47b7-93ee-c520ec181d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:02.287542 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b6259-cda7-47b7-93ee-c520ec181d04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:02.288273 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390b6259-cda7-47b7-93ee-c520ec181d04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:02.289892 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390b6259-cda7-47b7-93ee-c520ec181d04 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:02.291970 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:02.292459 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 795/1599] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:02 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:02.293336 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e3678-d41f-4f72-b307-b8435c2c7e4c admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:02.303065 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 805/1600] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:02 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:02.304259 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390b6259-cda7-47b7-93ee-c520ec181d04 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:02.306545 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e3678-d41f-4f72-b307-b8435c2c7e4c admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:02.312519 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75df956-0b51-4f3d-af2c-31d97c39b6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:02.313193 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75df956-0b51-4f3d-af2c-31d97c39b6bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:02.313523 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75df956-0b51-4f3d-af2c-31d97c39b6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:02.313754 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75df956-0b51-4f3d-af2c-31d97c39b6bd admin admin] PATH_INFO: `/v3/projects/9f7a1ff44e2a455ba4260b74ae06b50c/users/e1516d2903414b7caf082c32dcdac3eb/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:02.315862 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390b6259-cda7-47b7-93ee-c520ec181d04 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:02.321490 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b2a8c-b5f4-46e6-bba7-4bcd6286ce70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:02.322385 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b2a8c-b5f4-46e6-bba7-4bcd6286ce70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:02.322670 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b2a8c-b5f4-46e6-bba7-4bcd6286ce70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:02.322950 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b2a8c-b5f4-46e6-bba7-4bcd6286ce70 admin admin] PATH_INFO: `/v3/projects/873857d11992429d8f3a064665c1fc3e/users/b511b8f2ba394fa9b276f76a52247184/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:02.331536 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75df956-0b51-4f3d-af2c-31d97c39b6bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f7a1ff44e2a455ba4260b74ae06b50c, user_id=e1516d2903414b7caf082c32dcdac3eb, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:02.334234 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75df956-0b51-4f3d-af2c-31d97c39b6bd admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:02.338321 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b2a8c-b5f4-46e6-bba7-4bcd6286ce70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=873857d11992429d8f3a064665c1fc3e, user_id=b511b8f2ba394fa9b276f76a52247184, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:02.341000 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b2a8c-b5f4-46e6-bba7-4bcd6286ce70 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:02.347955 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 796/1601] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:02 2022] PUT /identity/v3/projects/9f7a1ff44e2a455ba4260b74ae06b50c/users/e1516d2903414b7caf082c32dcdac3eb/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:02.349403 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6e429-16c0-4d12-8322-60bfe12aea7d None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:02.349858 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6e429-16c0-4d12-8322-60bfe12aea7d None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:02.350142 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6e429-16c0-4d12-8322-60bfe12aea7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:02.358511 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 806/1602] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:02 2022] PUT /identity/v3/projects/873857d11992429d8f3a064665c1fc3e/users/b511b8f2ba394fa9b276f76a52247184/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:02.358511 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b2a8c-b5f4-46e6-bba7-4bcd6286ce70 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:02.384084 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-7ee6e429-16c0-4d12-8322-60bfe12aea7d None None] MFA Rules not processed for user `94d729112cc748e4abfb8a33a939348e`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:02.385475 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-7ee6e429-16c0-4d12-8322-60bfe12aea7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:02.421808 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b2a8c-b5f4-46e6-bba7-4bcd6286ce70 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:02.429380 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e41c1-d01e-4e89-9619-09408f2792db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:02.430195 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e41c1-d01e-4e89-9619-09408f2792db admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:02.430483 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e41c1-d01e-4e89-9619-09408f2792db admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:02.430760 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e41c1-d01e-4e89-9619-09408f2792db admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:02.431466 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590e41c1-d01e-4e89-9619-09408f2792db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:02.433452 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590e41c1-d01e-4e89-9619-09408f2792db admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:02.454956 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 797/1603] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:02.457308 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6d7ee-377e-475c-9a7e-5111d84e5fba None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:02.457618 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6d7ee-377e-475c-9a7e-5111d84e5fba None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:02.457893 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6d7ee-377e-475c-9a7e-5111d84e5fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:02.469154 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 807/1604] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:11:02 2022] POST /identity/v3/projects => generated 363 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:02.470694 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec835a-8a22-4fde-a8fa-d8c288e0210b None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:02.471609 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec835a-8a22-4fde-a8fa-d8c288e0210b None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:02.471907 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec835a-8a22-4fde-a8fa-d8c288e0210b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:02.476674 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-48a6d7ee-377e-475c-9a7e-5111d84e5fba None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:02.478013 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-48a6d7ee-377e-475c-9a7e-5111d84e5fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:02.499248 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-c7ec835a-8a22-4fde-a8fa-d8c288e0210b None None] MFA Rules not processed for user `90233eaed7c24bfca8e83f6e0f66c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:02.500487 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-c7ec835a-8a22-4fde-a8fa-d8c288e0210b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:02.539001 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 798/1605] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:02.539945 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6d7ee-377e-475c-9a7e-5111d84e5fba None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:02.550913 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6d7ee-377e-475c-9a7e-5111d84e5fba None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:02.555592 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ea3c1-d9ea-423f-bee3-c2402a7f419b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:02.556479 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ea3c1-d9ea-423f-bee3-c2402a7f419b admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:02.556792 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ea3c1-d9ea-423f-bee3-c2402a7f419b admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:02.557064 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ea3c1-d9ea-423f-bee3-c2402a7f419b admin admin] PATH_INFO: `/v3/projects/adba1d74cb2441a9a238dc0e6a47c112/users/68c4b81f2f704a9bbe15fd0f3326bb3e/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:02.565671 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 808/1606] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:02.570781 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec835a-8a22-4fde-a8fa-d8c288e0210b None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:02.573046 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130ea3c1-d9ea-423f-bee3-c2402a7f419b admin admin] RBAC: Authorizing `identity:create_grant(project_id=adba1d74cb2441a9a238dc0e6a47c112, user_id=68c4b81f2f704a9bbe15fd0f3326bb3e, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:02.575889 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130ea3c1-d9ea-423f-bee3-c2402a7f419b admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:02.581456 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec835a-8a22-4fde-a8fa-d8c288e0210b None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:02.586405 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba1687c-bbf3-4e17-a509-72ba055320df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:02.587315 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1687c-bbf3-4e17-a509-72ba055320df admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:02.587620 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1687c-bbf3-4e17-a509-72ba055320df admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:02.587868 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1687c-bbf3-4e17-a509-72ba055320df admin admin] PATH_INFO: `/v3/projects/a1c5be30cc344f1cacb822eb5b55d461/users/8f811cc65238425a85c2f8c5828984d7/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:02.589667 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 799/1607] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:02 2022] PUT /identity/v3/projects/adba1d74cb2441a9a238dc0e6a47c112/users/68c4b81f2f704a9bbe15fd0f3326bb3e/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:02.593784 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8b5a1-5d43-404d-a830-55e9f7f45dab None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:02.593784 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8b5a1-5d43-404d-a830-55e9f7f45dab None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:02.593784 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8b5a1-5d43-404d-a830-55e9f7f45dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:02.609477 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba1687c-bbf3-4e17-a509-72ba055320df admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1c5be30cc344f1cacb822eb5b55d461, user_id=8f811cc65238425a85c2f8c5828984d7, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:02.613190 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-18a8b5a1-5d43-404d-a830-55e9f7f45dab None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:02.614006 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba1687c-bbf3-4e17-a509-72ba055320df admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:02.614529 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-18a8b5a1-5d43-404d-a830-55e9f7f45dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:02.628566 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 809/1608] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:02 2022] PUT /identity/v3/projects/a1c5be30cc344f1cacb822eb5b55d461/users/8f811cc65238425a85c2f8c5828984d7/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:02.629937 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3393a-52f3-4f85-8ad9-b7aaeb484228 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:02.630223 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3393a-52f3-4f85-8ad9-b7aaeb484228 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:02.630494 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3393a-52f3-4f85-8ad9-b7aaeb484228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:02.646884 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:02.647438 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-5bf3393a-52f3-4f85-8ad9-b7aaeb484228 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:02.648416 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-5bf3393a-52f3-4f85-8ad9-b7aaeb484228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:02.667647 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:02.678777 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 800/1609] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:02.679381 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a8b5a1-5d43-404d-a830-55e9f7f45dab None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:02.689311 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a8b5a1-5d43-404d-a830-55e9f7f45dab None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:02.710704 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 810/1610] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:02.711516 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf3393a-52f3-4f85-8ad9-b7aaeb484228 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:02.720872 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf3393a-52f3-4f85-8ad9-b7aaeb484228 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:02.725986 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d4c0a-9841-42e2-916f-a4a3c21c985e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:02.726639 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d4c0a-9841-42e2-916f-a4a3c21c985e admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:02.726917 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d4c0a-9841-42e2-916f-a4a3c21c985e admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:02.727186 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d4c0a-9841-42e2-916f-a4a3c21c985e admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:02.727900 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5d4c0a-9841-42e2-916f-a4a3c21c985e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:02.729852 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5d4c0a-9841-42e2-916f-a4a3c21c985e admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:02.749167 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0e822-f6c8-4a86-ab3f-c83ea135562d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:02.749912 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0e822-f6c8-4a86-ab3f-c83ea135562d admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:02.750266 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0e822-f6c8-4a86-ab3f-c83ea135562d admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:02.750716 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0e822-f6c8-4a86-ab3f-c83ea135562d admin admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:02.754596 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 811/1611] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:11:02 2022] POST /identity/v3/users => generated 288 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:02.754760 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e0e822-f6c8-4a86-ab3f-c83ea135562d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:02.754874 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d4c0a-9841-42e2-916f-a4a3c21c985e admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:02.754978 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e0e822-f6c8-4a86-ab3f-c83ea135562d admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:02.780363 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 801/1612] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:11:02 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:02.781927 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4059b-a61a-4e18-b659-8a39a70653f7 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:02.782308 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4059b-a61a-4e18-b659-8a39a70653f7 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:02.782598 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4059b-a61a-4e18-b659-8a39a70653f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:02.801243 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-91c4059b-a61a-4e18-b659-8a39a70653f7 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:02.802451 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-91c4059b-a61a-4e18-b659-8a39a70653f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:02.808915 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d4c0a-9841-42e2-916f-a4a3c21c985e admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:02.858340 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93acf4b4-b4f7-4008-89a2-19ea3a9857a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:02.858998 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acf4b4-b4f7-4008-89a2-19ea3a9857a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:02.859283 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acf4b4-b4f7-4008-89a2-19ea3a9857a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:02.859559 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acf4b4-b4f7-4008-89a2-19ea3a9857a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:02.862777 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 802/1613] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:02.864126 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12ac87-f0b5-41e1-af0a-1544b48e9d83 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:02.864415 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12ac87-f0b5-41e1-af0a-1544b48e9d83 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:02.864691 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12ac87-f0b5-41e1-af0a-1544b48e9d83 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:02.866010 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 803/1614] 10.222.0.39 () {54 vars in 961 bytes} [Mon Jun 20 06:11:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:11:02.867063 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23290f44-ca23-4420-bff9-098f4a747f6b None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:02.867322 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23290f44-ca23-4420-bff9-098f4a747f6b None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:02.867671 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23290f44-ca23-4420-bff9-098f4a747f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:02.873763 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93acf4b4-b4f7-4008-89a2-19ea3a9857a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:02.875218 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93acf4b4-b4f7-4008-89a2-19ea3a9857a7 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:02.885403 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 812/1615] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:02.885919 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-23290f44-ca23-4420-bff9-098f4a747f6b None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:02.886221 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93acf4b4-b4f7-4008-89a2-19ea3a9857a7 service neutron] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:02.887133 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-23290f44-ca23-4420-bff9-098f4a747f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:02.896584 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93acf4b4-b4f7-4008-89a2-19ea3a9857a7 service neutron] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:02.897103 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 804/1616] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:02.897908 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23290f44-ca23-4420-bff9-098f4a747f6b None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:02.909922 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e293a-15af-469d-94d2-603c9a6c2b65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:02.910815 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23290f44-ca23-4420-bff9-098f4a747f6b None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:02.910939 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e293a-15af-469d-94d2-603c9a6c2b65 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:02.910939 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e293a-15af-469d-94d2-603c9a6c2b65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:02.911154 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e293a-15af-469d-94d2-603c9a6c2b65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:02.914781 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52452942-6815-4eb9-a3eb-dcf50d917b31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:02.915467 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52452942-6815-4eb9-a3eb-dcf50d917b31 service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:02.915743 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52452942-6815-4eb9-a3eb-dcf50d917b31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:02.916021 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52452942-6815-4eb9-a3eb-dcf50d917b31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:02.923109 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848e293a-15af-469d-94d2-603c9a6c2b65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:02.924392 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848e293a-15af-469d-94d2-603c9a6c2b65 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:02.926647 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52452942-6815-4eb9-a3eb-dcf50d917b31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:02.928111 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52452942-6815-4eb9-a3eb-dcf50d917b31 service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:02.935377 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 813/1617] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:02.936206 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e293a-15af-469d-94d2-603c9a6c2b65 service neutron] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:02.938312 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 805/1618] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:02.938973 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52452942-6815-4eb9-a3eb-dcf50d917b31 service neutron] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:02.946455 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e293a-15af-469d-94d2-603c9a6c2b65 service neutron] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:02.949216 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52452942-6815-4eb9-a3eb-dcf50d917b31 service neutron] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:02.951226 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95259074-bdca-4fda-9a25-dcb4ffc8bf97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:02.951885 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95259074-bdca-4fda-9a25-dcb4ffc8bf97 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:02.952167 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95259074-bdca-4fda-9a25-dcb4ffc8bf97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:02.952793 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95259074-bdca-4fda-9a25-dcb4ffc8bf97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:02.953360 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95259074-bdca-4fda-9a25-dcb4ffc8bf97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:02.954293 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99211d4e-607d-486c-bb67-d7f7f888d39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:02.954953 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99211d4e-607d-486c-bb67-d7f7f888d39b admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:02.955067 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95259074-bdca-4fda-9a25-dcb4ffc8bf97 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:02.955235 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99211d4e-607d-486c-bb67-d7f7f888d39b admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:02.956025 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99211d4e-607d-486c-bb67-d7f7f888d39b admin admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:02.957439 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99211d4e-607d-486c-bb67-d7f7f888d39b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:02.959371 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99211d4e-607d-486c-bb67-d7f7f888d39b admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:02.967163 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 814/1619] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:02.969458 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f27d8-4aa8-41ce-bde9-e142c93f6ef7 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:02.969764 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f27d8-4aa8-41ce-bde9-e142c93f6ef7 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:02.970080 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f27d8-4aa8-41ce-bde9-e142c93f6ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:02.992166 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-409f27d8-4aa8-41ce-bde9-e142c93f6ef7 None None] MFA Rules not processed for user `3cee106502e54829ad802ee41c9165fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:02.992622 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 806/1620] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:11:02 2022] POST /identity/v3/users => generated 297 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:02.993468 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-409f27d8-4aa8-41ce-bde9-e142c93f6ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:02.994141 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99211d4e-607d-486c-bb67-d7f7f888d39b admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:02.995929 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-99211d4e-607d-486c-bb67-d7f7f888d39b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:03.009904 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99211d4e-607d-486c-bb67-d7f7f888d39b admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:03.013681 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157458bb-0d4e-49f9-8240-741992991929 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:03.014953 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157458bb-0d4e-49f9-8240-741992991929 service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:03.014953 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157458bb-0d4e-49f9-8240-741992991929 service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:03.015180 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157458bb-0d4e-49f9-8240-741992991929 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:03.027995 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157458bb-0d4e-49f9-8240-741992991929 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:03.029485 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157458bb-0d4e-49f9-8240-741992991929 service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:03.038352 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:03.043813 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 807/1621] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:03.044474 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157458bb-0d4e-49f9-8240-741992991929 service neutron] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:03.054941 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157458bb-0d4e-49f9-8240-741992991929 service neutron] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:03.059342 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e3b93-3077-445e-91d6-5963df571c5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:03.060047 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e3b93-3077-445e-91d6-5963df571c5f service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:03.060339 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e3b93-3077-445e-91d6-5963df571c5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:03.061222 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e3b93-3077-445e-91d6-5963df571c5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:03.074770 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21e3b93-3077-445e-91d6-5963df571c5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:03.076674 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21e3b93-3077-445e-91d6-5963df571c5f service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:03.082755 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:03.083839 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 815/1622] 10.222.0.39 () {58 vars in 1058 bytes} [Mon Jun 20 06:11:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:03.084589 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409f27d8-4aa8-41ce-bde9-e142c93f6ef7 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:03.098915 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409f27d8-4aa8-41ce-bde9-e142c93f6ef7 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:03.102560 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 808/1623] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:03.103743 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e3b93-3077-445e-91d6-5963df571c5f service neutron] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:03.105022 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6c595-8236-4e8a-b3c3-a24f4aa49ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:03.106113 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6c595-8236-4e8a-b3c3-a24f4aa49ef2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:03.106493 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6c595-8236-4e8a-b3c3-a24f4aa49ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:03.106794 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6c595-8236-4e8a-b3c3-a24f4aa49ef2 admin admin] PATH_INFO: `/v3/projects/d75281e4bbf64c7faeb0794589b9e500/users/f8c54124b63f435d8bcc4b3f6ad05693/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:03.118738 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e3b93-3077-445e-91d6-5963df571c5f service neutron] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:03.126355 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd6c595-8236-4e8a-b3c3-a24f4aa49ef2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d75281e4bbf64c7faeb0794589b9e500, user_id=f8c54124b63f435d8bcc4b3f6ad05693, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:03.126526 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c68bda7-bf8f-4b40-ad95-3b3c54411325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:03.128274 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68bda7-bf8f-4b40-ad95-3b3c54411325 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:03.128274 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68bda7-bf8f-4b40-ad95-3b3c54411325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:03.128488 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68bda7-bf8f-4b40-ad95-3b3c54411325 admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:03.129290 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd6c595-8236-4e8a-b3c3-a24f4aa49ef2 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:03.129720 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c68bda7-bf8f-4b40-ad95-3b3c54411325 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:03.131956 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c68bda7-bf8f-4b40-ad95-3b3c54411325 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:03.149270 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 809/1624] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:03 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:03.150347 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c68bda7-bf8f-4b40-ad95-3b3c54411325 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:03.155292 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 816/1625] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:03 2022] PUT /identity/v3/projects/d75281e4bbf64c7faeb0794589b9e500/users/f8c54124b63f435d8bcc4b3f6ad05693/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:03.156414 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6c595-8236-4e8a-b3c3-a24f4aa49ef2 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:03.166501 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c68bda7-bf8f-4b40-ad95-3b3c54411325 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:03.248631 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6c595-8236-4e8a-b3c3-a24f4aa49ef2 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:03.255960 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14cec9f-ce56-4804-b034-a4a330730b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:03.257269 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cec9f-ce56-4804-b034-a4a330730b55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:03.257796 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cec9f-ce56-4804-b034-a4a330730b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:03.259623 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cec9f-ce56-4804-b034-a4a330730b55 admin admin] PATH_INFO: `/v3/projects/418f1b32c2654b64a3f555d7033ef62d/users/5dd5912ef6394f36aca53707bbc7ea91/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:03.269868 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8083f3f7-db1e-4966-b520-b62046e28156 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cee106502e54829ad802ee41c9165fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:03.270624 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8083f3f7-db1e-4966-b520-b62046e28156 service nova] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:03.271550 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8083f3f7-db1e-4966-b520-b62046e28156 service nova] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:03.271893 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8083f3f7-db1e-4966-b520-b62046e28156 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:03.281551 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14cec9f-ce56-4804-b034-a4a330730b55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=418f1b32c2654b64a3f555d7033ef62d, user_id=5dd5912ef6394f36aca53707bbc7ea91, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:03.286555 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14cec9f-ce56-4804-b034-a4a330730b55 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:03.314535 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 817/1626] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:03 2022] PUT /identity/v3/projects/418f1b32c2654b64a3f555d7033ef62d/users/5dd5912ef6394f36aca53707bbc7ea91/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:03.316614 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14cec9f-ce56-4804-b034-a4a330730b55 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:03.357593 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8083f3f7-db1e-4966-b520-b62046e28156 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:03.360296 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8083f3f7-db1e-4966-b520-b62046e28156 service nova] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:03.373256 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 810/1627] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:03.374124 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8083f3f7-db1e-4966-b520-b62046e28156 service nova] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:03.390965 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8083f3f7-db1e-4966-b520-b62046e28156 service nova] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:03.454175 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14cec9f-ce56-4804-b034-a4a330730b55 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:03.464663 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7c484-b692-463d-bdc5-a9adf0a9275f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:03.468074 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7c484-b692-463d-bdc5-a9adf0a9275f admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:03.468408 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7c484-b692-463d-bdc5-a9adf0a9275f admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:03.468692 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7c484-b692-463d-bdc5-a9adf0a9275f admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:03.471253 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f7c484-b692-463d-bdc5-a9adf0a9275f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:03.475097 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f7c484-b692-463d-bdc5-a9adf0a9275f admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:03.500202 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 818/1628] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:03 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:03.504558 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7c484-b692-463d-bdc5-a9adf0a9275f admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:03.517385 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59544b0-06d1-4814-847f-fc26206bac5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:03.519867 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59544b0-06d1-4814-847f-fc26206bac5f admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:03.520163 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59544b0-06d1-4814-847f-fc26206bac5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:03.520438 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59544b0-06d1-4814-847f-fc26206bac5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:03.523505 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59544b0-06d1-4814-847f-fc26206bac5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:03.526639 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59544b0-06d1-4814-847f-fc26206bac5f admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:03.527184 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7c484-b692-463d-bdc5-a9adf0a9275f admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:03.540199 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87943cd5-0c21-44de-81b4-705d857388d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:03.541603 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87943cd5-0c21-44de-81b4-705d857388d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:03.541943 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87943cd5-0c21-44de-81b4-705d857388d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:03.542368 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87943cd5-0c21-44de-81b4-705d857388d2 admin admin] PATH_INFO: `/v3/projects/d75281e4bbf64c7faeb0794589b9e500/users/f8c54124b63f435d8bcc4b3f6ad05693/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:03.547514 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87943cd5-0c21-44de-81b4-705d857388d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d75281e4bbf64c7faeb0794589b9e500, user_id=f8c54124b63f435d8bcc4b3f6ad05693, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:03.549980 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 811/1629] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:03 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:03.551441 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87943cd5-0c21-44de-81b4-705d857388d2 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:03.554157 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59544b0-06d1-4814-847f-fc26206bac5f admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:03.572005 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59544b0-06d1-4814-847f-fc26206bac5f admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:03.576378 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 819/1630] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:03 2022] PUT /identity/v3/projects/d75281e4bbf64c7faeb0794589b9e500/users/f8c54124b63f435d8bcc4b3f6ad05693/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:03.589860 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a45dc2-2ea0-4bb2-9892-6318daa39bcd None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:03.592227 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a45dc2-2ea0-4bb2-9892-6318daa39bcd None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:03.592512 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a45dc2-2ea0-4bb2-9892-6318daa39bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:03.620174 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:03.656934 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-d9a45dc2-2ea0-4bb2-9892-6318daa39bcd None None] MFA Rules not processed for user `f8c54124b63f435d8bcc4b3f6ad05693`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:03.659932 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-d9a45dc2-2ea0-4bb2-9892-6318daa39bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:03.670916 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:03.714843 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee40dcbf-db8f-4763-afc4-58d4415f8e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:03.715384 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40dcbf-db8f-4763-afc4-58d4415f8e65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:03.715668 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40dcbf-db8f-4763-afc4-58d4415f8e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:03.715894 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40dcbf-db8f-4763-afc4-58d4415f8e65 admin admin] PATH_INFO: `/v3/projects/418f1b32c2654b64a3f555d7033ef62d/users/5dd5912ef6394f36aca53707bbc7ea91/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:03.720509 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee40dcbf-db8f-4763-afc4-58d4415f8e65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=418f1b32c2654b64a3f555d7033ef62d, user_id=5dd5912ef6394f36aca53707bbc7ea91, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:03.723324 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee40dcbf-db8f-4763-afc4-58d4415f8e65 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:03.735473 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 812/1631] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:03 2022] PUT /identity/v3/projects/418f1b32c2654b64a3f555d7033ef62d/users/5dd5912ef6394f36aca53707bbc7ea91/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:03.749107 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01289ec0-2776-485e-835a-5eab86d841a4 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:03.749412 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01289ec0-2776-485e-835a-5eab86d841a4 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:03.750561 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01289ec0-2776-485e-835a-5eab86d841a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:03.791082 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-01289ec0-2776-485e-835a-5eab86d841a4 None None] MFA Rules not processed for user `5dd5912ef6394f36aca53707bbc7ea91`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:03.792899 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-01289ec0-2776-485e-835a-5eab86d841a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:03.813888 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 820/1632] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:03 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:03.813888 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab1765-549e-472a-a0b6-4e96e8c53925 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:03.813888 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab1765-549e-472a-a0b6-4e96e8c53925 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:03.813888 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab1765-549e-472a-a0b6-4e96e8c53925 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:03.813888 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 821/1633] 10.222.0.39 () {54 vars in 912 bytes} [Mon Jun 20 06:11:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:11:03.825633 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b982c-cf21-4413-9d0c-6319dd589690 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:03.825912 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b982c-cf21-4413-9d0c-6319dd589690 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:03.826200 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b982c-cf21-4413-9d0c-6319dd589690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:03.847703 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-7f3b982c-cf21-4413-9d0c-6319dd589690 None None] MFA Rules not processed for user `3cee106502e54829ad802ee41c9165fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:03.849281 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-7f3b982c-cf21-4413-9d0c-6319dd589690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:03.962243 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 813/1634] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:03 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:03.964812 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 822/1635] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Jun 20 06:11:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:03.964812 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b982c-cf21-4413-9d0c-6319dd589690 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:03.977949 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01289ec0-2776-485e-835a-5eab86d841a4 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:04.071267 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b982c-cf21-4413-9d0c-6319dd589690 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:04.075972 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed5e53c-b8e3-40c2-a8d9-075b189254a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:04.076710 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5e53c-b8e3-40c2-a8d9-075b189254a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:04.077011 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5e53c-b8e3-40c2-a8d9-075b189254a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:04.077290 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5e53c-b8e3-40c2-a8d9-075b189254a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:04.112837 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01289ec0-2776-485e-835a-5eab86d841a4 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:04.118228 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a1f9e3-a6ca-4dee-b3cf-b060b24f82bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:04.119099 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1f9e3-a6ca-4dee-b3cf-b060b24f82bc service cinder] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:04.119614 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1f9e3-a6ca-4dee-b3cf-b060b24f82bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:04.119738 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1f9e3-a6ca-4dee-b3cf-b060b24f82bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:04.140006 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a1f9e3-a6ca-4dee-b3cf-b060b24f82bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:04.143784 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a1f9e3-a6ca-4dee-b3cf-b060b24f82bc service cinder] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:04.162448 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 814/1636] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:03 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:11:04.197690 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:04.219425 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed5e53c-b8e3-40c2-a8d9-075b189254a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:04.227170 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed5e53c-b8e3-40c2-a8d9-075b189254a3 service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:04.229607 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a1f9e3-a6ca-4dee-b3cf-b060b24f82bc service cinder] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:04.241029 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a1f9e3-a6ca-4dee-b3cf-b060b24f82bc service cinder] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:04.241770 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 823/1637] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:03 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:04.246421 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fecdd0-1fdd-4ff4-ab40-e3ef186b9bd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:04.247205 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fecdd0-1fdd-4ff4-ab40-e3ef186b9bd7 service cinder] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:04.247358 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fecdd0-1fdd-4ff4-ab40-e3ef186b9bd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:04.247638 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fecdd0-1fdd-4ff4-ab40-e3ef186b9bd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:04.262238 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fecdd0-1fdd-4ff4-ab40-e3ef186b9bd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:04.263762 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fecdd0-1fdd-4ff4-ab40-e3ef186b9bd7 service cinder] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:04.278737 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 815/1638] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:11:04.450920 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed5e53c-b8e3-40c2-a8d9-075b189254a3 service cinder] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:04.482118 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed5e53c-b8e3-40c2-a8d9-075b189254a3 service cinder] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:04.489533 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d513be9-b6d4-446f-b98e-7681bb06b116 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:04.490309 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d513be9-b6d4-446f-b98e-7681bb06b116 service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:04.492022 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d513be9-b6d4-446f-b98e-7681bb06b116 service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:04.492366 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d513be9-b6d4-446f-b98e-7681bb06b116 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:04.633073 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d513be9-b6d4-446f-b98e-7681bb06b116 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:04.636792 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d513be9-b6d4-446f-b98e-7681bb06b116 service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:04.651299 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 824/1639] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:04 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:05.689536 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50834236-c5d8-4eea-a45a-03440a1b302e None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:05.691253 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50834236-c5d8-4eea-a45a-03440a1b302e None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:05.691832 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50834236-c5d8-4eea-a45a-03440a1b302e None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:05.694855 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 816/1640] 10.222.0.39 () {54 vars in 961 bytes} [Mon Jun 20 06:11:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:11:05.703352 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc18dc6-fa24-4aa6-aea9-455f7b2b034b None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:05.704459 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc18dc6-fa24-4aa6-aea9-455f7b2b034b None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:05.704944 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc18dc6-fa24-4aa6-aea9-455f7b2b034b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:05.761940 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-5bc18dc6-fa24-4aa6-aea9-455f7b2b034b None None] MFA Rules not processed for user `3cee106502e54829ad802ee41c9165fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:05.766329 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-5bc18dc6-fa24-4aa6-aea9-455f7b2b034b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:05.788989 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 825/1641] 10.222.0.39 () {58 vars in 1058 bytes} [Mon Jun 20 06:11:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:05.802929 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23013cc4-3665-44f9-8c61-d05db09574c9 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:05.803124 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23013cc4-3665-44f9-8c61-d05db09574c9 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:05.803414 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23013cc4-3665-44f9-8c61-d05db09574c9 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:05.805142 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 817/1642] 10.222.0.39 () {54 vars in 912 bytes} [Mon Jun 20 06:11:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:11:05.812850 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a778e-05a8-4221-afeb-0f1121eb3e06 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:05.813257 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a778e-05a8-4221-afeb-0f1121eb3e06 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:05.813659 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a778e-05a8-4221-afeb-0f1121eb3e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:05.851095 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23013cc4-3665-44f9-8c61-d05db09574c9 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:05.865060 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-154a778e-05a8-4221-afeb-0f1121eb3e06 None None] MFA Rules not processed for user `3cee106502e54829ad802ee41c9165fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:05.866782 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-154a778e-05a8-4221-afeb-0f1121eb3e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:05.902691 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 826/1643] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Jun 20 06:11:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:05.925599 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a778e-05a8-4221-afeb-0f1121eb3e06 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:05.935799 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:05.937974 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a778e-05a8-4221-afeb-0f1121eb3e06 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:05.953052 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e53720b-4ba5-40e3-a3bd-bb8ee2d320f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:05.953052 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53720b-4ba5-40e3-a3bd-bb8ee2d320f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:05.953406 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53720b-4ba5-40e3-a3bd-bb8ee2d320f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:05.953589 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53720b-4ba5-40e3-a3bd-bb8ee2d320f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:05.977032 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e53720b-4ba5-40e3-a3bd-bb8ee2d320f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:05.978487 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e53720b-4ba5-40e3-a3bd-bb8ee2d320f5 service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:05.993168 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23013cc4-3665-44f9-8c61-d05db09574c9 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:06.000809 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bfcd9e-90ba-4860-98ab-8c9b5808eecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:06.002454 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bfcd9e-90ba-4860-98ab-8c9b5808eecd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:06.003041 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bfcd9e-90ba-4860-98ab-8c9b5808eecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:06.003587 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bfcd9e-90ba-4860-98ab-8c9b5808eecd admin admin] PATH_INFO: `/v3/users/d7049b6e4fe847a98968263944fad13c` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:06.005392 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bfcd9e-90ba-4860-98ab-8c9b5808eecd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7049b6e4fe847a98968263944fad13c)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:06.008302 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bfcd9e-90ba-4860-98ab-8c9b5808eecd admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:06.015355 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 827/1644] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:06.135257 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-d7bfcd9e-90ba-4860-98ab-8c9b5808eecd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7049b6e4fe847a98968263944fad13c'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:06.152935 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-d7bfcd9e-90ba-4860-98ab-8c9b5808eecd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7049b6e4fe847a98968263944fad13c'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:06.154330 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-d7bfcd9e-90ba-4860-98ab-8c9b5808eecd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7049b6e4fe847a98968263944fad13c'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:06.155848 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-d7bfcd9e-90ba-4860-98ab-8c9b5808eecd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7049b6e4fe847a98968263944fad13c'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:06.178463 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-d7bfcd9e-90ba-4860-98ab-8c9b5808eecd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7049b6e4fe847a98968263944fad13c'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:06.259474 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 818/1645] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:11:05 2022] DELETE /identity/v3/users/d7049b6e4fe847a98968263944fad13c => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:11:06.259697 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad41e21-fa52-478b-bc52-2bc12b9c8ed7 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:06.259697 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad41e21-fa52-478b-bc52-2bc12b9c8ed7 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:06.259697 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad41e21-fa52-478b-bc52-2bc12b9c8ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:06.272919 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-3ad41e21-fa52-478b-bc52-2bc12b9c8ed7 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:06.275087 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-3ad41e21-fa52-478b-bc52-2bc12b9c8ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:06.438503 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 828/1646] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:06.496820 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bfcd9e-90ba-4860-98ab-8c9b5808eecd admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:06.498772 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-d7bfcd9e-90ba-4860-98ab-8c9b5808eecd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:06.652003 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bfcd9e-90ba-4860-98ab-8c9b5808eecd admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:06.665476 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b67343-baa8-45f7-a592-f9e1a3635118 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:06.666363 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b67343-baa8-45f7-a592-f9e1a3635118 service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:06.666651 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b67343-baa8-45f7-a592-f9e1a3635118 service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:06.666932 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b67343-baa8-45f7-a592-f9e1a3635118 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:06.682777 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b67343-baa8-45f7-a592-f9e1a3635118 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:06.684572 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b67343-baa8-45f7-a592-f9e1a3635118 service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:06.721437 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 819/1647] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:08.691389 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad41e21-fa52-478b-bc52-2bc12b9c8ed7 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:08.693144 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-3ad41e21-fa52-478b-bc52-2bc12b9c8ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:08.714761 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad41e21-fa52-478b-bc52-2bc12b9c8ed7 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:08.729612 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b34c1-9c9d-423c-8781-91c366de44c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:08.730841 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b34c1-9c9d-423c-8781-91c366de44c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:08.731391 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b34c1-9c9d-423c-8781-91c366de44c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:08.731966 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b34c1-9c9d-423c-8781-91c366de44c8 admin admin] PATH_INFO: `/v3/projects/a51e9b198bd94915b23fdfe8e7e4dafd` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:08.733747 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86b34c1-9c9d-423c-8781-91c366de44c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a51e9b198bd94915b23fdfe8e7e4dafd)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:08.736950 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86b34c1-9c9d-423c-8781-91c366de44c8 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:08.846763 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-b86b34c1-9c9d-423c-8781-91c366de44c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a51e9b198bd94915b23fdfe8e7e4dafd', 'request_id': 'req-b86b34c1-9c9d-423c-8781-91c366de44c8'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:08.848203 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:08.883487 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-b86b34c1-9c9d-423c-8781-91c366de44c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a51e9b198bd94915b23fdfe8e7e4dafd', 'request_id': 'req-b86b34c1-9c9d-423c-8781-91c366de44c8'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:08.906738 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-b86b34c1-9c9d-423c-8781-91c366de44c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a51e9b198bd94915b23fdfe8e7e4dafd', 'request_id': 'req-b86b34c1-9c9d-423c-8781-91c366de44c8'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:08.936252 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-b86b34c1-9c9d-423c-8781-91c366de44c8 admin admin] The token cache is being invalidate because project a51e9b198bd94915b23fdfe8e7e4dafd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:11:08.936252 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-b86b34c1-9c9d-423c-8781-91c366de44c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:08.941680 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-b86b34c1-9c9d-423c-8781-91c366de44c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:08.941680 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 829/1648] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:11:08 2022] DELETE /identity/v3/projects/a51e9b198bd94915b23fdfe8e7e4dafd => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:08.946333 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b67343-baa8-45f7-a592-f9e1a3635118 service neutron] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:08.976905 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b67343-baa8-45f7-a592-f9e1a3635118 service neutron] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:09.100204 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:09.117023 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee8d3cd-c134-4641-a65e-8f5f10ad487f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:09.118540 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8d3cd-c134-4641-a65e-8f5f10ad487f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:09.119382 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8d3cd-c134-4641-a65e-8f5f10ad487f admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:09.120122 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8d3cd-c134-4641-a65e-8f5f10ad487f admin admin] PATH_INFO: `/v3/users/f8c54124b63f435d8bcc4b3f6ad05693` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:09.121734 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee8d3cd-c134-4641-a65e-8f5f10ad487f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8c54124b63f435d8bcc4b3f6ad05693)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:09.124269 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee8d3cd-c134-4641-a65e-8f5f10ad487f admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:09.200803 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-aee8d3cd-c134-4641-a65e-8f5f10ad487f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8c54124b63f435d8bcc4b3f6ad05693'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:09.211964 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-aee8d3cd-c134-4641-a65e-8f5f10ad487f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8c54124b63f435d8bcc4b3f6ad05693'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:09.212689 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-aee8d3cd-c134-4641-a65e-8f5f10ad487f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8c54124b63f435d8bcc4b3f6ad05693'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:09.213480 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-aee8d3cd-c134-4641-a65e-8f5f10ad487f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8c54124b63f435d8bcc4b3f6ad05693'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:09.241379 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-aee8d3cd-c134-4641-a65e-8f5f10ad487f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8c54124b63f435d8bcc4b3f6ad05693'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:09.263167 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 820/1649] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:11:08 2022] DELETE /identity/v3/users/f8c54124b63f435d8bcc4b3f6ad05693 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:10.868556 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b34c1-9c9d-423c-8781-91c366de44c8 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:10.870143 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-b86b34c1-9c9d-423c-8781-91c366de44c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:10.897916 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b34c1-9c9d-423c-8781-91c366de44c8 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:11.061273 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b6676-8f6d-485f-a9a7-6f11c5d31e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:11.062277 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b6676-8f6d-485f-a9a7-6f11c5d31e67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:11.062575 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b6676-8f6d-485f-a9a7-6f11c5d31e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:11.062860 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b6676-8f6d-485f-a9a7-6f11c5d31e67 admin admin] PATH_INFO: `/v3/projects/d75281e4bbf64c7faeb0794589b9e500` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:11.081351 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832b6676-8f6d-485f-a9a7-6f11c5d31e67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d75281e4bbf64c7faeb0794589b9e500)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:11.083750 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832b6676-8f6d-485f-a9a7-6f11c5d31e67 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:11.242699 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-832b6676-8f6d-485f-a9a7-6f11c5d31e67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd75281e4bbf64c7faeb0794589b9e500', 'request_id': 'req-832b6676-8f6d-485f-a9a7-6f11c5d31e67'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:11.261098 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-832b6676-8f6d-485f-a9a7-6f11c5d31e67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd75281e4bbf64c7faeb0794589b9e500', 'request_id': 'req-832b6676-8f6d-485f-a9a7-6f11c5d31e67'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:11.279114 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-832b6676-8f6d-485f-a9a7-6f11c5d31e67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd75281e4bbf64c7faeb0794589b9e500', 'request_id': 'req-832b6676-8f6d-485f-a9a7-6f11c5d31e67'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:11.305296 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-832b6676-8f6d-485f-a9a7-6f11c5d31e67 admin admin] The token cache is being invalidate because project d75281e4bbf64c7faeb0794589b9e500 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:11:11.305596 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-832b6676-8f6d-485f-a9a7-6f11c5d31e67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:11.308473 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-832b6676-8f6d-485f-a9a7-6f11c5d31e67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:11.310387 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 830/1650] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:11:10 2022] DELETE /identity/v3/projects/d75281e4bbf64c7faeb0794589b9e500 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:11.320383 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3766a93-bd51-4f34-853a-b7d25b5bbc6e None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:11.320959 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3766a93-bd51-4f34-853a-b7d25b5bbc6e None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:11.320959 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3766a93-bd51-4f34-853a-b7d25b5bbc6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:11.369088 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-e3766a93-bd51-4f34-853a-b7d25b5bbc6e None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:11.370736 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-e3766a93-bd51-4f34-853a-b7d25b5bbc6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:11.512045 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 821/1651] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:11.519640 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae9bdc-77de-4d1f-8095-a340805c5c3b None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:11.519927 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae9bdc-77de-4d1f-8095-a340805c5c3b None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:11.520207 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae9bdc-77de-4d1f-8095-a340805c5c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:11.562028 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-9eae9bdc-77de-4d1f-8095-a340805c5c3b None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:11.563303 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-9eae9bdc-77de-4d1f-8095-a340805c5c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:11.581152 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 831/1652] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:11.582187 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3766a93-bd51-4f34-853a-b7d25b5bbc6e None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:11.596901 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3766a93-bd51-4f34-853a-b7d25b5bbc6e None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:11.612046 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18205e71-fe40-42f0-98b9-082bc035ad2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:11.613020 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18205e71-fe40-42f0-98b9-082bc035ad2c admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:11.613292 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18205e71-fe40-42f0-98b9-082bc035ad2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:11.613757 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18205e71-fe40-42f0-98b9-082bc035ad2c admin admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:11.614500 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18205e71-fe40-42f0-98b9-082bc035ad2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:11:11.614786 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18205e71-fe40-42f0-98b9-082bc035ad2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:11.616434 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18205e71-fe40-42f0-98b9-082bc035ad2c admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:11.649240 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 822/1653] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:11:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:11:11.653745 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae9bdc-77de-4d1f-8095-a340805c5c3b None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:11.672598 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae9bdc-77de-4d1f-8095-a340805c5c3b None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:11.680091 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff2ffa-0769-4b47-b9e2-fa13583ca188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:11.681454 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff2ffa-0769-4b47-b9e2-fa13583ca188 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:11.681454 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff2ffa-0769-4b47-b9e2-fa13583ca188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:11.681454 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff2ffa-0769-4b47-b9e2-fa13583ca188 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:11.682067 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ff2ffa-0769-4b47-b9e2-fa13583ca188 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:11.684020 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ff2ffa-0769-4b47-b9e2-fa13583ca188 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:11.739660 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18205e71-fe40-42f0-98b9-082bc035ad2c admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:11.749598 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 832/1654] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:11:11 2022] POST /identity/v3/projects => generated 383 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:11.750966 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18205e71-fe40-42f0-98b9-082bc035ad2c admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:11.819333 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:11.827720 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45625a91-e068-4470-8879-9de06517930b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:11.828431 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45625a91-e068-4470-8879-9de06517930b admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:11.830133 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45625a91-e068-4470-8879-9de06517930b admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:11.832922 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45625a91-e068-4470-8879-9de06517930b admin admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:11.833666 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45625a91-e068-4470-8879-9de06517930b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:11.838175 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45625a91-e068-4470-8879-9de06517930b admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:11.867639 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff2ffa-0769-4b47-b9e2-fa13583ca188 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:11.868094 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 823/1655] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:11:11 2022] POST /identity/v3/users => generated 292 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:11.879234 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff2ffa-0769-4b47-b9e2-fa13583ca188 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:11.885066 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b1b26-68d9-443e-81e9-d69331a7958d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:11.885970 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b1b26-68d9-443e-81e9-d69331a7958d admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:11.886405 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b1b26-68d9-443e-81e9-d69331a7958d admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:11.886871 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b1b26-68d9-443e-81e9-d69331a7958d admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:11.887771 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b1b26-68d9-443e-81e9-d69331a7958d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:11.889600 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b1b26-68d9-443e-81e9-d69331a7958d admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:11.906437 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45625a91-e068-4470-8879-9de06517930b admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:11.917024 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 833/1656] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:11.919734 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45625a91-e068-4470-8879-9de06517930b admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:11.926982 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e00b7a4-3ea8-4678-9ba2-13fc31e8275f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:11.927928 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00b7a4-3ea8-4678-9ba2-13fc31e8275f admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:11.928384 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00b7a4-3ea8-4678-9ba2-13fc31e8275f admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:11.928877 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00b7a4-3ea8-4678-9ba2-13fc31e8275f admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:11.930740 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e00b7a4-3ea8-4678-9ba2-13fc31e8275f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:11.933039 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e00b7a4-3ea8-4678-9ba2-13fc31e8275f admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:11.962618 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 824/1657] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:11.964070 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b1b26-68d9-443e-81e9-d69331a7958d admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:11.999066 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b1b26-68d9-443e-81e9-d69331a7958d admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:12.014947 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe958fa-039b-4808-8d6d-871e8da49263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:12.015931 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe958fa-039b-4808-8d6d-871e8da49263 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:12.016276 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe958fa-039b-4808-8d6d-871e8da49263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:12.016561 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe958fa-039b-4808-8d6d-871e8da49263 admin admin] PATH_INFO: `/v3/projects/40df3f20daa54af49fc8512fadc452d7/users/85c2bad722d942daad8a51790330e26d/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:12.081144 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe958fa-039b-4808-8d6d-871e8da49263 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40df3f20daa54af49fc8512fadc452d7, user_id=85c2bad722d942daad8a51790330e26d, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:12.089091 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe958fa-039b-4808-8d6d-871e8da49263 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:12.137392 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 834/1658] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:11 2022] PUT /identity/v3/projects/40df3f20daa54af49fc8512fadc452d7/users/85c2bad722d942daad8a51790330e26d/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:12.140360 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a63ec-4cbb-4306-bffa-3072433b71b5 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:12.140952 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a63ec-4cbb-4306-bffa-3072433b71b5 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:12.141478 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a63ec-4cbb-4306-bffa-3072433b71b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:12.230899 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-9d1a63ec-4cbb-4306-bffa-3072433b71b5 None None] MFA Rules not processed for user `85c2bad722d942daad8a51790330e26d`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:12.235107 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-9d1a63ec-4cbb-4306-bffa-3072433b71b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:12.410705 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 825/1659] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:12.412184 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe958fa-039b-4808-8d6d-871e8da49263 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:12.419066 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:12.772738 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe958fa-039b-4808-8d6d-871e8da49263 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:12.801122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fae7e3-e253-4f26-a480-ed58a34038a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:12.803463 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fae7e3-e253-4f26-a480-ed58a34038a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:12.803774 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fae7e3-e253-4f26-a480-ed58a34038a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:12.804063 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fae7e3-e253-4f26-a480-ed58a34038a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:12.806326 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fae7e3-e253-4f26-a480-ed58a34038a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:12.808189 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fae7e3-e253-4f26-a480-ed58a34038a6 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:12.910785 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 835/1660] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:11:12 2022] POST /identity/v3/projects => generated 379 bytes in 500 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:11:12.914868 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a63ec-4cbb-4306-bffa-3072433b71b5 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:12.928457 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a63ec-4cbb-4306-bffa-3072433b71b5 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:13.049801 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae0816-e309-4892-bef2-0425046231d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:13.050611 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae0816-e309-4892-bef2-0425046231d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:13.050804 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae0816-e309-4892-bef2-0425046231d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:13.051084 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae0816-e309-4892-bef2-0425046231d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:13.051849 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ae0816-e309-4892-bef2-0425046231d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:13.053771 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ae0816-e309-4892-bef2-0425046231d1 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:13.098678 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 826/1661] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:11:12 2022] POST /identity/v3/users => generated 296 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:13.099876 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fae7e3-e253-4f26-a480-ed58a34038a6 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:13.114033 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fae7e3-e253-4f26-a480-ed58a34038a6 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:13.128468 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5254b5f-3bfa-4292-a115-b3c0f49b521f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:13.130117 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5254b5f-3bfa-4292-a115-b3c0f49b521f admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:13.132071 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5254b5f-3bfa-4292-a115-b3c0f49b521f admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:13.132496 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5254b5f-3bfa-4292-a115-b3c0f49b521f admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:13.133512 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5254b5f-3bfa-4292-a115-b3c0f49b521f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:13.137966 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5254b5f-3bfa-4292-a115-b3c0f49b521f admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:13.168492 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 836/1662] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:11:13.173614 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae0816-e309-4892-bef2-0425046231d1 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:13.184055 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae0816-e309-4892-bef2-0425046231d1 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:13.205659 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5c3c5-856c-49de-ad5e-c7ae9ad07f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:13.206601 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5c3c5-856c-49de-ad5e-c7ae9ad07f60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:13.206889 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5c3c5-856c-49de-ad5e-c7ae9ad07f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:13.207167 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5c3c5-856c-49de-ad5e-c7ae9ad07f60 admin admin] PATH_INFO: `/v3/projects/3583cff9b7dd44818122091615696bad/users/39bd00f59dc444bd87be830f52f5dd15/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:13.247740 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e5c3c5-856c-49de-ad5e-c7ae9ad07f60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3583cff9b7dd44818122091615696bad, user_id=39bd00f59dc444bd87be830f52f5dd15, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:13.250967 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e5c3c5-856c-49de-ad5e-c7ae9ad07f60 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:13.301536 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 827/1663] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:13 2022] PUT /identity/v3/projects/3583cff9b7dd44818122091615696bad/users/39bd00f59dc444bd87be830f52f5dd15/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:13.302453 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5254b5f-3bfa-4292-a115-b3c0f49b521f admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:13.315354 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5254b5f-3bfa-4292-a115-b3c0f49b521f admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:13.467365 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dafcfd-1780-4c92-8332-4b63a172253a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:13.469931 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dafcfd-1780-4c92-8332-4b63a172253a admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:13.470409 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dafcfd-1780-4c92-8332-4b63a172253a admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:13.471954 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dafcfd-1780-4c92-8332-4b63a172253a admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:13.473125 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dafcfd-1780-4c92-8332-4b63a172253a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:13.476320 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dafcfd-1780-4c92-8332-4b63a172253a admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:13.518650 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 837/1664] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:13.523639 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5c3c5-856c-49de-ad5e-c7ae9ad07f60 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:13.541353 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5c3c5-856c-49de-ad5e-c7ae9ad07f60 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:13.553795 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba46c31b-5b38-40cb-b3db-cf4bf4d11a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:13.554811 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46c31b-5b38-40cb-b3db-cf4bf4d11a5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:13.555102 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46c31b-5b38-40cb-b3db-cf4bf4d11a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:13.557540 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46c31b-5b38-40cb-b3db-cf4bf4d11a5b admin admin] PATH_INFO: `/v3/projects/3583cff9b7dd44818122091615696bad/users/39bd00f59dc444bd87be830f52f5dd15/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:13.563553 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba46c31b-5b38-40cb-b3db-cf4bf4d11a5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3583cff9b7dd44818122091615696bad, user_id=39bd00f59dc444bd87be830f52f5dd15, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:13.574081 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba46c31b-5b38-40cb-b3db-cf4bf4d11a5b admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:13.614946 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 828/1665] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:13 2022] PUT /identity/v3/projects/3583cff9b7dd44818122091615696bad/users/39bd00f59dc444bd87be830f52f5dd15/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:13.623061 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49407a29-9456-4b3b-aa24-a4a0fe60b098 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:13.623663 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49407a29-9456-4b3b-aa24-a4a0fe60b098 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:13.624143 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49407a29-9456-4b3b-aa24-a4a0fe60b098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:13.691043 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-49407a29-9456-4b3b-aa24-a4a0fe60b098 None None] MFA Rules not processed for user `39bd00f59dc444bd87be830f52f5dd15`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:13.692930 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-49407a29-9456-4b3b-aa24-a4a0fe60b098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:13.886756 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:13.900959 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 838/1666] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:13 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:13.914119 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba46c31b-5b38-40cb-b3db-cf4bf4d11a5b admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:13.915942 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-ba46c31b-5b38-40cb-b3db-cf4bf4d11a5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:13.966631 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:14.048027 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba46c31b-5b38-40cb-b3db-cf4bf4d11a5b admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:14.057875 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84353446-0ff7-4291-a37f-f41e44e781d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:14.058475 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84353446-0ff7-4291-a37f-f41e44e781d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:14.058766 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84353446-0ff7-4291-a37f-f41e44e781d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:14.059094 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84353446-0ff7-4291-a37f-f41e44e781d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:14.083282 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84353446-0ff7-4291-a37f-f41e44e781d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:14.084856 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84353446-0ff7-4291-a37f-f41e44e781d4 service cinder] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:14.111244 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 829/1667] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:13 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:14.286127 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49407a29-9456-4b3b-aa24-a4a0fe60b098 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:14.300156 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49407a29-9456-4b3b-aa24-a4a0fe60b098 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:14.311125 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a81ae9-e1bb-4b69-b5b2-6297f2aee823 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:14.311728 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a81ae9-e1bb-4b69-b5b2-6297f2aee823 service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:14.312030 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a81ae9-e1bb-4b69-b5b2-6297f2aee823 service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:14.312292 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a81ae9-e1bb-4b69-b5b2-6297f2aee823 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:14.479669 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a81ae9-e1bb-4b69-b5b2-6297f2aee823 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:14.490885 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a81ae9-e1bb-4b69-b5b2-6297f2aee823 service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:14.505384 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 839/1668] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:15.109728 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84353446-0ff7-4291-a37f-f41e44e781d4 service cinder] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:15.211563 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84353446-0ff7-4291-a37f-f41e44e781d4 service cinder] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:15.227888 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e9557f-99d9-40e0-b782-d4e64841583d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:15.230978 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9557f-99d9-40e0-b782-d4e64841583d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:15.231423 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9557f-99d9-40e0-b782-d4e64841583d admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:15.231868 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9557f-99d9-40e0-b782-d4e64841583d admin admin] PATH_INFO: `/v3/users/85c2bad722d942daad8a51790330e26d` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:15.243536 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e9557f-99d9-40e0-b782-d4e64841583d admin admin] RBAC: Authorizing `identity:delete_user(user_id=85c2bad722d942daad8a51790330e26d)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:15.249501 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e9557f-99d9-40e0-b782-d4e64841583d admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:15.265213 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d23b4-a3fd-4363-982c-9601a176efe7 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:15.266407 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d23b4-a3fd-4363-982c-9601a176efe7 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:15.266834 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d23b4-a3fd-4363-982c-9601a176efe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:15.327804 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-5a7d23b4-a3fd-4363-982c-9601a176efe7 None None] MFA Rules not processed for user `8f811cc65238425a85c2f8c5828984d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:15.333914 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-5a7d23b4-a3fd-4363-982c-9601a176efe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:15.429045 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-d0e9557f-99d9-40e0-b782-d4e64841583d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85c2bad722d942daad8a51790330e26d'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:15.474178 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-d0e9557f-99d9-40e0-b782-d4e64841583d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85c2bad722d942daad8a51790330e26d'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:15.475181 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-d0e9557f-99d9-40e0-b782-d4e64841583d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85c2bad722d942daad8a51790330e26d'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:15.476566 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-d0e9557f-99d9-40e0-b782-d4e64841583d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85c2bad722d942daad8a51790330e26d'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:15.525378 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-d0e9557f-99d9-40e0-b782-d4e64841583d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85c2bad722d942daad8a51790330e26d'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:15.570925 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 830/1669] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:11:15 2022] DELETE /identity/v3/users/85c2bad722d942daad8a51790330e26d => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:15.575633 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfdb29e-0c9a-4b75-b2a4-2e9fa9fa5e0b None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:15.575925 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfdb29e-0c9a-4b75-b2a4-2e9fa9fa5e0b None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:15.576204 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfdb29e-0c9a-4b75-b2a4-2e9fa9fa5e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:15.607752 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 840/1670] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:15.614002 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4832b5b-6ee8-4452-a7e5-c40e8e04da4c None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:15.616368 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4832b5b-6ee8-4452-a7e5-c40e8e04da4c None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:15.616674 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4832b5b-6ee8-4452-a7e5-c40e8e04da4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:15.636405 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-3cfdb29e-0c9a-4b75-b2a4-2e9fa9fa5e0b None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:15.641465 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-3cfdb29e-0c9a-4b75-b2a4-2e9fa9fa5e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:15.668397 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-c4832b5b-6ee8-4452-a7e5-c40e8e04da4c None None] MFA Rules not processed for user `8f811cc65238425a85c2f8c5828984d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:15.673501 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-c4832b5b-6ee8-4452-a7e5-c40e8e04da4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:15.764452 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:15.843292 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 831/1671] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:15.854402 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfdb29e-0c9a-4b75-b2a4-2e9fa9fa5e0b None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:15.855807 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-3cfdb29e-0c9a-4b75-b2a4-2e9fa9fa5e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:15.886757 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 841/1672] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:15.894930 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4832b5b-6ee8-4452-a7e5-c40e8e04da4c None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:15.897521 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-c4832b5b-6ee8-4452-a7e5-c40e8e04da4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:15.983422 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfdb29e-0c9a-4b75-b2a4-2e9fa9fa5e0b None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:15.991756 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb573ab0-6dad-4d7f-a44e-261ccb96f9bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:15.992429 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb573ab0-6dad-4d7f-a44e-261ccb96f9bd service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:15.992773 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb573ab0-6dad-4d7f-a44e-261ccb96f9bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:15.993006 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb573ab0-6dad-4d7f-a44e-261ccb96f9bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:15.999464 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:16.013201 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb573ab0-6dad-4d7f-a44e-261ccb96f9bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:16.014666 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb573ab0-6dad-4d7f-a44e-261ccb96f9bd service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:16.039910 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 832/1673] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:11:16.059246 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4832b5b-6ee8-4452-a7e5-c40e8e04da4c None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:16.067276 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f63d5-395d-404e-95b5-7b221fdb5687 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cee106502e54829ad802ee41c9165fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:16.067963 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f63d5-395d-404e-95b5-7b221fdb5687 service nova] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:16.068249 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f63d5-395d-404e-95b5-7b221fdb5687 service nova] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:16.068727 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f63d5-395d-404e-95b5-7b221fdb5687 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:16.083370 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f63d5-395d-404e-95b5-7b221fdb5687 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:16.085906 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f63d5-395d-404e-95b5-7b221fdb5687 service nova] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:16.118502 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 842/1674] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:17.734621 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd8d42-ae88-4af2-b3c8-6bed954f0c4e None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:17.735176 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd8d42-ae88-4af2-b3c8-6bed954f0c4e None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:17.735176 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd8d42-ae88-4af2-b3c8-6bed954f0c4e None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:17.738542 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 833/1675] 10.222.0.39 () {54 vars in 912 bytes} [Mon Jun 20 06:11:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:11:17.744951 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5ce6c-459b-422a-aeb7-94b0cbd372cb None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:17.745468 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5ce6c-459b-422a-aeb7-94b0cbd372cb None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:17.745559 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5ce6c-459b-422a-aeb7-94b0cbd372cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:17.868502 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-e2b5ce6c-459b-422a-aeb7-94b0cbd372cb None None] MFA Rules not processed for user `83e77cb05c4546c7a98ada817573edf3`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:17.870638 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-e2b5ce6c-459b-422a-aeb7-94b0cbd372cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:17.900778 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 843/1676] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Jun 20 06:11:17 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:17.921807 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd8d42-ae88-4af2-b3c8-6bed954f0c4e None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:17.948015 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd8d42-ae88-4af2-b3c8-6bed954f0c4e None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:17.968740 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1452f7-1e0b-4d30-8ba2-eb0d914a35d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:17.969416 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1452f7-1e0b-4d30-8ba2-eb0d914a35d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:17.969699 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1452f7-1e0b-4d30-8ba2-eb0d914a35d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:17.969976 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1452f7-1e0b-4d30-8ba2-eb0d914a35d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:18.014514 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1452f7-1e0b-4d30-8ba2-eb0d914a35d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:18.015931 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1452f7-1e0b-4d30-8ba2-eb0d914a35d1 service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:18.041092 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 834/1677] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:18.167988 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b5ce6c-459b-422a-aeb7-94b0cbd372cb None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:18.169459 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-e2b5ce6c-459b-422a-aeb7-94b0cbd372cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:18.217899 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b5ce6c-459b-422a-aeb7-94b0cbd372cb None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:18.242027 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034b7c7-36a5-4c1e-9e50-73b33705128e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:18.244857 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034b7c7-36a5-4c1e-9e50-73b33705128e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:18.246253 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034b7c7-36a5-4c1e-9e50-73b33705128e admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:18.246548 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034b7c7-36a5-4c1e-9e50-73b33705128e admin admin] PATH_INFO: `/v3/projects/40df3f20daa54af49fc8512fadc452d7` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:18.254763 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2034b7c7-36a5-4c1e-9e50-73b33705128e admin admin] RBAC: Authorizing `identity:delete_project(project_id=40df3f20daa54af49fc8512fadc452d7)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:18.262669 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2034b7c7-36a5-4c1e-9e50-73b33705128e admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:18.414790 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-2034b7c7-36a5-4c1e-9e50-73b33705128e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40df3f20daa54af49fc8512fadc452d7', 'request_id': 'req-2034b7c7-36a5-4c1e-9e50-73b33705128e'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:18.439762 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-2034b7c7-36a5-4c1e-9e50-73b33705128e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40df3f20daa54af49fc8512fadc452d7', 'request_id': 'req-2034b7c7-36a5-4c1e-9e50-73b33705128e'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:18.473114 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-2034b7c7-36a5-4c1e-9e50-73b33705128e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40df3f20daa54af49fc8512fadc452d7', 'request_id': 'req-2034b7c7-36a5-4c1e-9e50-73b33705128e'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:18.500616 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-2034b7c7-36a5-4c1e-9e50-73b33705128e admin admin] The token cache is being invalidate because project 40df3f20daa54af49fc8512fadc452d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:11:18.500937 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-2034b7c7-36a5-4c1e-9e50-73b33705128e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:18.501606 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-2034b7c7-36a5-4c1e-9e50-73b33705128e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:18.508497 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 844/1678] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:11:18 2022] DELETE /identity/v3/projects/40df3f20daa54af49fc8512fadc452d7 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:18.512478 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1452f7-1e0b-4d30-8ba2-eb0d914a35d1 service neutron] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:18.544676 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1452f7-1e0b-4d30-8ba2-eb0d914a35d1 service neutron] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:18.715900 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6ceb3-1c7e-41db-b433-660490bca3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:18.716853 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6ceb3-1c7e-41db-b433-660490bca3af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:18.717897 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6ceb3-1c7e-41db-b433-660490bca3af admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:18.719506 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6ceb3-1c7e-41db-b433-660490bca3af admin admin] PATH_INFO: `/v3/users/39bd00f59dc444bd87be830f52f5dd15` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:18.723158 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc6ceb3-1c7e-41db-b433-660490bca3af admin admin] RBAC: Authorizing `identity:delete_user(user_id=39bd00f59dc444bd87be830f52f5dd15)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:18.737061 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc6ceb3-1c7e-41db-b433-660490bca3af admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:18.935981 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-bfc6ceb3-1c7e-41db-b433-660490bca3af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39bd00f59dc444bd87be830f52f5dd15'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:18.950861 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-bfc6ceb3-1c7e-41db-b433-660490bca3af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39bd00f59dc444bd87be830f52f5dd15'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:18.953148 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-bfc6ceb3-1c7e-41db-b433-660490bca3af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39bd00f59dc444bd87be830f52f5dd15'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:18.956263 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-bfc6ceb3-1c7e-41db-b433-660490bca3af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39bd00f59dc444bd87be830f52f5dd15'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:19.014508 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-bfc6ceb3-1c7e-41db-b433-660490bca3af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39bd00f59dc444bd87be830f52f5dd15'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:19.015967 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:19.056737 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 835/1679] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:11:18 2022] DELETE /identity/v3/users/39bd00f59dc444bd87be830f52f5dd15 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:19.316287 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b9c45-992e-450a-924a-a2b48fc6b013 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:19.316918 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b9c45-992e-450a-924a-a2b48fc6b013 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:19.317987 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b9c45-992e-450a-924a-a2b48fc6b013 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:19.321765 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 845/1680] 10.222.0.39 () {54 vars in 960 bytes} [Mon Jun 20 06:11:19 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:11:19.337985 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5bdca-c4be-4ccd-9d54-22d8da9d2616 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:19.338278 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5bdca-c4be-4ccd-9d54-22d8da9d2616 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:19.338589 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5bdca-c4be-4ccd-9d54-22d8da9d2616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:19.385248 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-2bc5bdca-c4be-4ccd-9d54-22d8da9d2616 None None] MFA Rules not processed for user `6f0f9248178049cda6571fa365a21225`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:19.387967 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-2bc5bdca-c4be-4ccd-9d54-22d8da9d2616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:19.503619 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70612c39-0c90-4651-895a-ef80fb565b0d None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:19.503914 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70612c39-0c90-4651-895a-ef80fb565b0d None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:19.504298 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70612c39-0c90-4651-895a-ef80fb565b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:19.552996 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 836/1681] 10.222.0.39 () {58 vars in 1057 bytes} [Mon Jun 20 06:11:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:19.561253 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5bdca-c4be-4ccd-9d54-22d8da9d2616 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:19.575063 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-70612c39-0c90-4651-895a-ef80fb565b0d None None] MFA Rules not processed for user `498822fcffaf4cc79532c487418cb11c`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:19.576357 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-70612c39-0c90-4651-895a-ef80fb565b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:19.585642 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5bdca-c4be-4ccd-9d54-22d8da9d2616 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:19.606463 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d2bb9-4297-4d60-96e4-b37f16b8dcf0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f0f9248178049cda6571fa365a21225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:19.608684 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d2bb9-4297-4d60-96e4-b37f16b8dcf0 service placement] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:19.610753 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d2bb9-4297-4d60-96e4-b37f16b8dcf0 service placement] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:19.612205 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d2bb9-4297-4d60-96e4-b37f16b8dcf0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:19.635088 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-190d2bb9-4297-4d60-96e4-b37f16b8dcf0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:19.692643 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d2bb9-4297-4d60-96e4-b37f16b8dcf0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:19.696360 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d2bb9-4297-4d60-96e4-b37f16b8dcf0 service placement] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:19.737233 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 846/1682] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:19.753367 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70612c39-0c90-4651-895a-ef80fb565b0d None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:19.762279 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-70612c39-0c90-4651-895a-ef80fb565b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:19.762954 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 837/1683] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:11:19.790730 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd0364-8dd7-42f3-b031-e9e280a4b0f1 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:19.791018 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd0364-8dd7-42f3-b031-e9e280a4b0f1 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:19.791297 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd0364-8dd7-42f3-b031-e9e280a4b0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:19.799846 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:19.922584 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-c3cd0364-8dd7-42f3-b031-e9e280a4b0f1 None None] MFA Rules not processed for user `b511b8f2ba394fa9b276f76a52247184`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:19.926391 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-c3cd0364-8dd7-42f3-b031-e9e280a4b0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:20.026124 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70612c39-0c90-4651-895a-ef80fb565b0d None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:20.047727 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846631fd-0ab9-4420-9c72-c7897927e47d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cee106502e54829ad802ee41c9165fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:20.048692 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846631fd-0ab9-4420-9c72-c7897927e47d service nova] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:20.050396 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846631fd-0ab9-4420-9c72-c7897927e47d service nova] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:20.051026 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846631fd-0ab9-4420-9c72-c7897927e47d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:20.063125 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846631fd-0ab9-4420-9c72-c7897927e47d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:20.065755 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846631fd-0ab9-4420-9c72-c7897927e47d service nova] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:20.092082 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 847/1684] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:20.237644 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 838/1685] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 448 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:20.270735 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846631fd-0ab9-4420-9c72-c7897927e47d service nova] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:20.278627 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-846631fd-0ab9-4420-9c72-c7897927e47d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:20.350364 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd0364-8dd7-42f3-b031-e9e280a4b0f1 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:20.352494 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-c3cd0364-8dd7-42f3-b031-e9e280a4b0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:20.388879 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846631fd-0ab9-4420-9c72-c7897927e47d service nova] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:20.411866 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5947fe48-a5c5-43ae-84f2-369b3bd56036 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cee106502e54829ad802ee41c9165fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:20.413122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947fe48-a5c5-43ae-84f2-369b3bd56036 service nova] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:20.413691 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947fe48-a5c5-43ae-84f2-369b3bd56036 service nova] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:20.414172 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947fe48-a5c5-43ae-84f2-369b3bd56036 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:20.455677 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5947fe48-a5c5-43ae-84f2-369b3bd56036 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:20.461869 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5947fe48-a5c5-43ae-84f2-369b3bd56036 service nova] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:20.516922 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 848/1686] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:20.557440 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd0364-8dd7-42f3-b031-e9e280a4b0f1 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:20.582231 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944dc184-9823-4bd5-87a3-624d8df2d650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:20.583181 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944dc184-9823-4bd5-87a3-624d8df2d650 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:20.583519 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944dc184-9823-4bd5-87a3-624d8df2d650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:20.583725 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944dc184-9823-4bd5-87a3-624d8df2d650 admin admin] PATH_INFO: `/v3/projects/3583cff9b7dd44818122091615696bad` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:20.594371 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944dc184-9823-4bd5-87a3-624d8df2d650 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3583cff9b7dd44818122091615696bad)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:20.595520 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: WARNING py.warnings [None req-944dc184-9823-4bd5-87a3-624d8df2d650 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:11:20.595520 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: warnings.warn(msg) Jun 20 06:11:20.595520 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: Jun 20 06:11:20.598437 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944dc184-9823-4bd5-87a3-624d8df2d650 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:20.618346 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:20.818464 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-944dc184-9823-4bd5-87a3-624d8df2d650 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3583cff9b7dd44818122091615696bad', 'request_id': 'req-944dc184-9823-4bd5-87a3-624d8df2d650'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:20.869311 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-944dc184-9823-4bd5-87a3-624d8df2d650 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3583cff9b7dd44818122091615696bad', 'request_id': 'req-944dc184-9823-4bd5-87a3-624d8df2d650'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:20.895177 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7c155-21d8-46af-8c7e-9602dbfa1587 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:20.895699 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7c155-21d8-46af-8c7e-9602dbfa1587 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:20.896860 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7c155-21d8-46af-8c7e-9602dbfa1587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:20.910632 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-944dc184-9823-4bd5-87a3-624d8df2d650 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3583cff9b7dd44818122091615696bad', 'request_id': 'req-944dc184-9823-4bd5-87a3-624d8df2d650'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:20.993810 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-12b7c155-21d8-46af-8c7e-9602dbfa1587 None None] MFA Rules not processed for user `e1516d2903414b7caf082c32dcdac3eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:20.999351 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-12b7c155-21d8-46af-8c7e-9602dbfa1587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:21.040304 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-944dc184-9823-4bd5-87a3-624d8df2d650 admin admin] The token cache is being invalidate because project 3583cff9b7dd44818122091615696bad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:11:21.041162 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-944dc184-9823-4bd5-87a3-624d8df2d650 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:21.045753 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-944dc184-9823-4bd5-87a3-624d8df2d650 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:21.058681 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 839/1687] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:11:20 2022] DELETE /identity/v3/projects/3583cff9b7dd44818122091615696bad => generated 0 bytes in 705 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:11:21.063432 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857672fa-2ed9-4850-ac22-710883ab789e None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:21.065953 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857672fa-2ed9-4850-ac22-710883ab789e None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:21.067779 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857672fa-2ed9-4850-ac22-710883ab789e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:21.161713 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-857672fa-2ed9-4850-ac22-710883ab789e None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:21.167250 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-857672fa-2ed9-4850-ac22-710883ab789e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:21.338580 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 849/1688] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 446 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:21.342676 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b7c155-21d8-46af-8c7e-9602dbfa1587 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:21.349548 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-12b7c155-21d8-46af-8c7e-9602dbfa1587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:21.367276 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 840/1689] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:21.377574 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec4156-c483-4148-abbe-a8b1edf7eea3 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:21.380296 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec4156-c483-4148-abbe-a8b1edf7eea3 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:21.380801 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec4156-c483-4148-abbe-a8b1edf7eea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:21.437815 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b7c155-21d8-46af-8c7e-9602dbfa1587 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:21.458256 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d54cd3-8229-4db1-a94c-5cd5a481b672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:21.461638 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d54cd3-8229-4db1-a94c-5cd5a481b672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:21.461928 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d54cd3-8229-4db1-a94c-5cd5a481b672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:21.464753 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d54cd3-8229-4db1-a94c-5cd5a481b672 admin admin] PATH_INFO: `/v3/users/90233eaed7c24bfca8e83f6e0f66c950` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:21.465651 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-8fec4156-c483-4148-abbe-a8b1edf7eea3 None None] MFA Rules not processed for user `e1516d2903414b7caf082c32dcdac3eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:21.470513 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d54cd3-8229-4db1-a94c-5cd5a481b672 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90233eaed7c24bfca8e83f6e0f66c950)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:21.473014 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-8fec4156-c483-4148-abbe-a8b1edf7eea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:21.478489 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: WARNING py.warnings [None req-76d54cd3-8229-4db1-a94c-5cd5a481b672 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:11:21.478489 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: warnings.warn(msg) Jun 20 06:11:21.478489 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: Jun 20 06:11:21.484041 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d54cd3-8229-4db1-a94c-5cd5a481b672 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:21.491136 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 841/1690] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:21.494521 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8fbf86-ffbd-4cfa-a11c-bdbb87c7e7e2 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:21.503962 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8fbf86-ffbd-4cfa-a11c-bdbb87c7e7e2 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:21.504486 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8fbf86-ffbd-4cfa-a11c-bdbb87c7e7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:21.569268 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-3d8fbf86-ffbd-4cfa-a11c-bdbb87c7e7e2 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:21.576626 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-3d8fbf86-ffbd-4cfa-a11c-bdbb87c7e7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:21.614726 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 842/1691] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:21.615732 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8fbf86-ffbd-4cfa-a11c-bdbb87c7e7e2 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:21.621453 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-3d8fbf86-ffbd-4cfa-a11c-bdbb87c7e7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:21.747115 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-76d54cd3-8229-4db1-a94c-5cd5a481b672 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90233eaed7c24bfca8e83f6e0f66c950'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:21.776998 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-76d54cd3-8229-4db1-a94c-5cd5a481b672 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90233eaed7c24bfca8e83f6e0f66c950'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:21.822553 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-76d54cd3-8229-4db1-a94c-5cd5a481b672 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90233eaed7c24bfca8e83f6e0f66c950'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:21.848451 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:21.889091 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-76d54cd3-8229-4db1-a94c-5cd5a481b672 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90233eaed7c24bfca8e83f6e0f66c950'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:21.890142 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-76d54cd3-8229-4db1-a94c-5cd5a481b672 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90233eaed7c24bfca8e83f6e0f66c950'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:21.907912 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 850/1692] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:11:21 2022] DELETE /identity/v3/users/90233eaed7c24bfca8e83f6e0f66c950 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:21.909455 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d54cd3-8229-4db1-a94c-5cd5a481b672 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:21.912138 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-76d54cd3-8229-4db1-a94c-5cd5a481b672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:22.026584 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8fbf86-ffbd-4cfa-a11c-bdbb87c7e7e2 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:22.105074 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:22.152612 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d54cd3-8229-4db1-a94c-5cd5a481b672 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:22.162171 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca460ad-0fe9-49bd-88c9-fcb38cab9054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:22.162994 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca460ad-0fe9-49bd-88c9-fcb38cab9054 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:22.163278 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca460ad-0fe9-49bd-88c9-fcb38cab9054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:22.163856 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca460ad-0fe9-49bd-88c9-fcb38cab9054 admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:22.164612 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca460ad-0fe9-49bd-88c9-fcb38cab9054 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:11:22.164946 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca460ad-0fe9-49bd-88c9-fcb38cab9054 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:22.171735 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca460ad-0fe9-49bd-88c9-fcb38cab9054 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:22.228642 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 851/1693] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:11:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:11:22.230059 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f614e5-ec68-4e83-b4a2-2f7704c95147 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:22.230349 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f614e5-ec68-4e83-b4a2-2f7704c95147 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:22.230660 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f614e5-ec68-4e83-b4a2-2f7704c95147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:22.350503 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-b5f614e5-ec68-4e83-b4a2-2f7704c95147 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:22.355006 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ba5fb-a341-400e-a692-fe156eb512dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cee106502e54829ad802ee41c9165fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:22.356220 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-b5f614e5-ec68-4e83-b4a2-2f7704c95147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:22.360181 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ba5fb-a341-400e-a692-fe156eb512dc service nova] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:22.367907 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ba5fb-a341-400e-a692-fe156eb512dc service nova] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:22.368414 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ba5fb-a341-400e-a692-fe156eb512dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:22.372955 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-ec4ba5fb-a341-400e-a692-fe156eb512dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:22.381391 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 852/1694] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:22.382530 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f614e5-ec68-4e83-b4a2-2f7704c95147 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:22.436323 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f614e5-ec68-4e83-b4a2-2f7704c95147 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:22.475793 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7867ed9-4d08-473c-b526-595d5cd4e9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:22.477303 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7867ed9-4d08-473c-b526-595d5cd4e9b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:22.477741 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7867ed9-4d08-473c-b526-595d5cd4e9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:22.478165 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7867ed9-4d08-473c-b526-595d5cd4e9b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:22.479748 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7867ed9-4d08-473c-b526-595d5cd4e9b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:22.484379 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7867ed9-4d08-473c-b526-595d5cd4e9b3 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:22.555341 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 853/1695] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:11:22 2022] POST /identity/v3/projects => generated 373 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:22.556505 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7867ed9-4d08-473c-b526-595d5cd4e9b3 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:22.563376 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4ba5fb-a341-400e-a692-fe156eb512dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:22.563904 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-b7867ed9-4d08-473c-b526-595d5cd4e9b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:22.569573 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4ba5fb-a341-400e-a692-fe156eb512dc service nova] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:22.626750 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 843/1696] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 1011 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:22.628281 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ba5fb-a341-400e-a692-fe156eb512dc service nova] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:22.670025 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ba5fb-a341-400e-a692-fe156eb512dc service nova] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:22.769281 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7867ed9-4d08-473c-b526-595d5cd4e9b3 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:22.786540 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537269b0-32f2-44bd-8f9b-a8c009ac7588 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:22.787864 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537269b0-32f2-44bd-8f9b-a8c009ac7588 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:22.788374 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537269b0-32f2-44bd-8f9b-a8c009ac7588 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:22.788877 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537269b0-32f2-44bd-8f9b-a8c009ac7588 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:22.810082 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e086141a-e48d-4154-a51e-6d70e00c543b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:22.813943 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086141a-e48d-4154-a51e-6d70e00c543b admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:22.814453 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086141a-e48d-4154-a51e-6d70e00c543b admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:22.815921 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086141a-e48d-4154-a51e-6d70e00c543b admin admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:22.816863 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e086141a-e48d-4154-a51e-6d70e00c543b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:22.823392 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e086141a-e48d-4154-a51e-6d70e00c543b admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:22.896594 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 844/1697] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:11:22 2022] POST /identity/v3/users => generated 287 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:22.900254 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e086141a-e48d-4154-a51e-6d70e00c543b admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:22.936556 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e086141a-e48d-4154-a51e-6d70e00c543b admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:22.955242 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a14852-3ac0-468b-ac9a-54c9b26960da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:22.956937 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a14852-3ac0-468b-ac9a-54c9b26960da admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:22.957453 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a14852-3ac0-468b-ac9a-54c9b26960da admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:22.957950 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a14852-3ac0-468b-ac9a-54c9b26960da admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:22.959357 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a14852-3ac0-468b-ac9a-54c9b26960da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:22.962246 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a14852-3ac0-468b-ac9a-54c9b26960da admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:22.976636 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 845/1698] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:22.980745 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a14852-3ac0-468b-ac9a-54c9b26960da admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:22.998275 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a14852-3ac0-468b-ac9a-54c9b26960da admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:23.001344 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537269b0-32f2-44bd-8f9b-a8c009ac7588 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:23.004827 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537269b0-32f2-44bd-8f9b-a8c009ac7588 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:23.007061 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49f2dcc-0e84-4332-ac90-3b9d6bd4b994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:23.007991 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f2dcc-0e84-4332-ac90-3b9d6bd4b994 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:23.008373 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f2dcc-0e84-4332-ac90-3b9d6bd4b994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:23.008825 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f2dcc-0e84-4332-ac90-3b9d6bd4b994 admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:23.009921 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49f2dcc-0e84-4332-ac90-3b9d6bd4b994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:23.012671 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49f2dcc-0e84-4332-ac90-3b9d6bd4b994 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:23.014671 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:23.026507 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 854/1699] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:23.037134 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 846/1700] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:23.042195 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537269b0-32f2-44bd-8f9b-a8c009ac7588 service neutron] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:23.078234 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537269b0-32f2-44bd-8f9b-a8c009ac7588 service neutron] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:23.099980 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed3fa4-23eb-4eb1-bc12-022afe41dcae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:23.101052 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed3fa4-23eb-4eb1-bc12-022afe41dcae admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:23.101395 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed3fa4-23eb-4eb1-bc12-022afe41dcae admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:23.101738 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed3fa4-23eb-4eb1-bc12-022afe41dcae admin admin] PATH_INFO: `/v3/projects/5ba760a2ee1f4e45870588c9706d5bf6/users/55fbe6b1b9f24fbeb59d2b5c1cea85ca/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:23.135926 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ed3fa4-23eb-4eb1-bc12-022afe41dcae admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ba760a2ee1f4e45870588c9706d5bf6, user_id=55fbe6b1b9f24fbeb59d2b5c1cea85ca, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:23.138958 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ed3fa4-23eb-4eb1-bc12-022afe41dcae admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:23.168347 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 855/1701] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:23 2022] PUT /identity/v3/projects/5ba760a2ee1f4e45870588c9706d5bf6/users/55fbe6b1b9f24fbeb59d2b5c1cea85ca/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:23.181144 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444fc7f-def9-49f8-9a4a-3564c1d142c4 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:23.181455 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444fc7f-def9-49f8-9a4a-3564c1d142c4 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:23.181706 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444fc7f-def9-49f8-9a4a-3564c1d142c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:23.255886 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-9444fc7f-def9-49f8-9a4a-3564c1d142c4 None None] MFA Rules not processed for user `55fbe6b1b9f24fbeb59d2b5c1cea85ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:23.257085 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-9444fc7f-def9-49f8-9a4a-3564c1d142c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:23.283837 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:23.415758 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed3fa4-23eb-4eb1-bc12-022afe41dcae admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:23.415989 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 847/1702] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:23.417620 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-f8ed3fa4-23eb-4eb1-bc12-022afe41dcae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:23.429497 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9444fc7f-def9-49f8-9a4a-3564c1d142c4 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:23.431401 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-9444fc7f-def9-49f8-9a4a-3564c1d142c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:23.524078 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed3fa4-23eb-4eb1-bc12-022afe41dcae admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:23.536469 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd43a181-c606-46de-a6a5-4068bd392cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:23.537402 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43a181-c606-46de-a6a5-4068bd392cbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:23.537685 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43a181-c606-46de-a6a5-4068bd392cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:23.537964 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43a181-c606-46de-a6a5-4068bd392cbb admin admin] PATH_INFO: `/v3/users/94d729112cc748e4abfb8a33a939348e` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:23.541871 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd43a181-c606-46de-a6a5-4068bd392cbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=94d729112cc748e4abfb8a33a939348e)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:23.543839 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd43a181-c606-46de-a6a5-4068bd392cbb admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:23.551631 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9444fc7f-def9-49f8-9a4a-3564c1d142c4 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:23.563543 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80390137-38d4-4111-bab7-b52f6b9ac3d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:23.565572 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80390137-38d4-4111-bab7-b52f6b9ac3d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:23.567023 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80390137-38d4-4111-bab7-b52f6b9ac3d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:23.568165 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80390137-38d4-4111-bab7-b52f6b9ac3d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:23.642261 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80390137-38d4-4111-bab7-b52f6b9ac3d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:23.647136 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80390137-38d4-4111-bab7-b52f6b9ac3d9 service cinder] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:23.693126 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 848/1703] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:11:23.706432 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-dd43a181-c606-46de-a6a5-4068bd392cbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94d729112cc748e4abfb8a33a939348e'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:23.732307 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-dd43a181-c606-46de-a6a5-4068bd392cbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94d729112cc748e4abfb8a33a939348e'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:23.764427 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-dd43a181-c606-46de-a6a5-4068bd392cbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94d729112cc748e4abfb8a33a939348e'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:23.809790 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-dd43a181-c606-46de-a6a5-4068bd392cbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94d729112cc748e4abfb8a33a939348e'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:23.810547 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-dd43a181-c606-46de-a6a5-4068bd392cbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94d729112cc748e4abfb8a33a939348e'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:23.831563 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 856/1704] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:11:23 2022] DELETE /identity/v3/users/94d729112cc748e4abfb8a33a939348e => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:23.833302 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c74f68-2c7c-484b-8789-cd49f95c8f5b None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:23.833693 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c74f68-2c7c-484b-8789-cd49f95c8f5b None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:23.834072 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c74f68-2c7c-484b-8789-cd49f95c8f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:23.886635 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-28c74f68-2c7c-484b-8789-cd49f95c8f5b None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:23.890275 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-28c74f68-2c7c-484b-8789-cd49f95c8f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:24.028593 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11a04f-d32b-495c-baf5-2a54bd88424b None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:24.028833 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11a04f-d32b-495c-baf5-2a54bd88424b None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:24.029024 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11a04f-d32b-495c-baf5-2a54bd88424b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:24.086746 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 849/1705] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:24.093934 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-8d11a04f-d32b-495c-baf5-2a54bd88424b None None] MFA Rules not processed for user `68c4b81f2f704a9bbe15fd0f3326bb3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:24.095183 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-8d11a04f-d32b-495c-baf5-2a54bd88424b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:24.183977 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c74f68-2c7c-484b-8789-cd49f95c8f5b None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:24.185868 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-28c74f68-2c7c-484b-8789-cd49f95c8f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:24.222710 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:24.268839 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 857/1706] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:24.271998 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0e64f-4343-4cb0-bef3-ad190817e5d9 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:24.299769 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0e64f-4343-4cb0-bef3-ad190817e5d9 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:24.301275 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0e64f-4343-4cb0-bef3-ad190817e5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:24.349836 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-d9b0e64f-4343-4cb0-bef3-ad190817e5d9 None None] MFA Rules not processed for user `8c0f131484cb48d289cae1f473ec2fbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:24.352357 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-d9b0e64f-4343-4cb0-bef3-ad190817e5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:24.465192 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c74f68-2c7c-484b-8789-cd49f95c8f5b None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:24.481408 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef73cd3-352f-400e-ba8e-dfcadb520cff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:24.482706 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef73cd3-352f-400e-ba8e-dfcadb520cff service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:24.482992 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef73cd3-352f-400e-ba8e-dfcadb520cff service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:24.483686 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef73cd3-352f-400e-ba8e-dfcadb520cff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:24.530237 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef73cd3-352f-400e-ba8e-dfcadb520cff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:24.531701 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef73cd3-352f-400e-ba8e-dfcadb520cff service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:24.541388 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:24.559879 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 850/1707] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:24.560861 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef73cd3-352f-400e-ba8e-dfcadb520cff service neutron] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:24.572179 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-3ef73cd3-352f-400e-ba8e-dfcadb520cff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:24.576473 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 858/1708] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Jun 20 06:11:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:24.762298 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef73cd3-352f-400e-ba8e-dfcadb520cff service neutron] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:24.770872 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e71b3-9fdf-4809-b811-08cd9f0e528a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cee106502e54829ad802ee41c9165fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:24.771536 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e71b3-9fdf-4809-b811-08cd9f0e528a service nova] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:24.771819 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e71b3-9fdf-4809-b811-08cd9f0e528a service nova] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:24.772089 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e71b3-9fdf-4809-b811-08cd9f0e528a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:24.781930 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4e71b3-9fdf-4809-b811-08cd9f0e528a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:24.784210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4e71b3-9fdf-4809-b811-08cd9f0e528a service nova] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:24.811314 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 851/1709] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:24.857880 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b0e64f-4343-4cb0-bef3-ad190817e5d9 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:24.859473 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-d9b0e64f-4343-4cb0-bef3-ad190817e5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:24.977534 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b0e64f-4343-4cb0-bef3-ad190817e5d9 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:24.983624 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaebdec-9ee8-4a59-abf8-83822ebf9a8d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b490cf71bc468da5ea2be04239e33f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:24.984307 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaebdec-9ee8-4a59-abf8-83822ebf9a8d service swift] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:24.984589 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaebdec-9ee8-4a59-abf8-83822ebf9a8d service swift] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:24.984951 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaebdec-9ee8-4a59-abf8-83822ebf9a8d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:24.997521 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaebdec-9ee8-4a59-abf8-83822ebf9a8d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:24.999761 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaebdec-9ee8-4a59-abf8-83822ebf9a8d service swift] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:25.020456 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 859/1710] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Jun 20 06:11:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 20 06:11:27.532783 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764a27c-51ac-4b0d-9f99-a6ad70f577e7 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:27.533880 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764a27c-51ac-4b0d-9f99-a6ad70f577e7 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:27.534631 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764a27c-51ac-4b0d-9f99-a6ad70f577e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:27.588505 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaebdec-9ee8-4a59-abf8-83822ebf9a8d service swift] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:27.591496 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-ecaebdec-9ee8-4a59-abf8-83822ebf9a8d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:27.607087 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-4764a27c-51ac-4b0d-9f99-a6ad70f577e7 None None] MFA Rules not processed for user `e1516d2903414b7caf082c32dcdac3eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:27.608659 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-4764a27c-51ac-4b0d-9f99-a6ad70f577e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:27.653974 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaebdec-9ee8-4a59-abf8-83822ebf9a8d service swift] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:27.682451 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53cdf21-2617-4b58-b34c-943354859c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:27.686370 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53cdf21-2617-4b58-b34c-943354859c17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:27.686754 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53cdf21-2617-4b58-b34c-943354859c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:27.686984 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53cdf21-2617-4b58-b34c-943354859c17 admin admin] PATH_INFO: `/v3/projects/7782a6af4a7c4b0da1fa667510e62c45` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:27.692581 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53cdf21-2617-4b58-b34c-943354859c17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7782a6af4a7c4b0da1fa667510e62c45)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:27.707019 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53cdf21-2617-4b58-b34c-943354859c17 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:27.723035 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 852/1711] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:27.780887 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4764a27c-51ac-4b0d-9f99-a6ad70f577e7 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:27.784884 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-4764a27c-51ac-4b0d-9f99-a6ad70f577e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:27.886535 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4764a27c-51ac-4b0d-9f99-a6ad70f577e7 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:27.909483 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-a53cdf21-2617-4b58-b34c-943354859c17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7782a6af4a7c4b0da1fa667510e62c45', 'request_id': 'req-a53cdf21-2617-4b58-b34c-943354859c17'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:27.930341 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-a53cdf21-2617-4b58-b34c-943354859c17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7782a6af4a7c4b0da1fa667510e62c45', 'request_id': 'req-a53cdf21-2617-4b58-b34c-943354859c17'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:27.952809 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-a53cdf21-2617-4b58-b34c-943354859c17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7782a6af4a7c4b0da1fa667510e62c45', 'request_id': 'req-a53cdf21-2617-4b58-b34c-943354859c17'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:27.989130 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-a53cdf21-2617-4b58-b34c-943354859c17 admin admin] The token cache is being invalidate because project 7782a6af4a7c4b0da1fa667510e62c45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:11:27.989433 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-a53cdf21-2617-4b58-b34c-943354859c17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:27.994402 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-a53cdf21-2617-4b58-b34c-943354859c17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:28.001477 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 860/1712] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:11:27 2022] DELETE /identity/v3/projects/7782a6af4a7c4b0da1fa667510e62c45 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:28.007446 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94a724-6167-4a19-bb86-ca20cc1ad920 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:28.007961 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94a724-6167-4a19-bb86-ca20cc1ad920 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:28.008399 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94a724-6167-4a19-bb86-ca20cc1ad920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:28.034226 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:28.071055 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4001c7c-80d3-44bc-b459-fa4efca88088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:28.072027 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4001c7c-80d3-44bc-b459-fa4efca88088 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:28.072316 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4001c7c-80d3-44bc-b459-fa4efca88088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:28.072623 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4001c7c-80d3-44bc-b459-fa4efca88088 admin admin] PATH_INFO: `/v3/projects/fd4e2582757e45f1bf920e428d02df36` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:28.075078 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4001c7c-80d3-44bc-b459-fa4efca88088 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd4e2582757e45f1bf920e428d02df36)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:28.078929 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4001c7c-80d3-44bc-b459-fa4efca88088 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:28.083246 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-ef94a724-6167-4a19-bb86-ca20cc1ad920 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:28.084651 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-ef94a724-6167-4a19-bb86-ca20cc1ad920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:28.122044 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 861/1713] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:28.123681 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98da14f-5cb9-4714-b666-35d311c53791 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:28.123970 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98da14f-5cb9-4714-b666-35d311c53791 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:28.124252 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98da14f-5cb9-4714-b666-35d311c53791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:28.155073 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:28.205783 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-c98da14f-5cb9-4714-b666-35d311c53791 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:28.208225 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-f4001c7c-80d3-44bc-b459-fa4efca88088 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd4e2582757e45f1bf920e428d02df36', 'request_id': 'req-f4001c7c-80d3-44bc-b459-fa4efca88088'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:28.208392 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-c98da14f-5cb9-4714-b666-35d311c53791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:28.227928 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-f4001c7c-80d3-44bc-b459-fa4efca88088 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd4e2582757e45f1bf920e428d02df36', 'request_id': 'req-f4001c7c-80d3-44bc-b459-fa4efca88088'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:28.253625 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-f4001c7c-80d3-44bc-b459-fa4efca88088 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd4e2582757e45f1bf920e428d02df36', 'request_id': 'req-f4001c7c-80d3-44bc-b459-fa4efca88088'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:28.305680 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-f4001c7c-80d3-44bc-b459-fa4efca88088 admin admin] The token cache is being invalidate because project fd4e2582757e45f1bf920e428d02df36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:11:28.307241 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-f4001c7c-80d3-44bc-b459-fa4efca88088 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:28.310505 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-f4001c7c-80d3-44bc-b459-fa4efca88088 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:28.320911 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 853/1714] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:11:27 2022] DELETE /identity/v3/projects/fd4e2582757e45f1bf920e428d02df36 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:28.323288 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4001c7c-80d3-44bc-b459-fa4efca88088 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:28.339149 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-f4001c7c-80d3-44bc-b459-fa4efca88088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:28.448972 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 862/1715] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:11:28.450650 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42daeb6-b626-4f9f-bd94-4f89d88184c5 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:28.450945 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42daeb6-b626-4f9f-bd94-4f89d88184c5 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:28.451235 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42daeb6-b626-4f9f-bd94-4f89d88184c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:28.514858 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-e42daeb6-b626-4f9f-bd94-4f89d88184c5 None None] MFA Rules not processed for user `b511b8f2ba394fa9b276f76a52247184`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:28.516435 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-e42daeb6-b626-4f9f-bd94-4f89d88184c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:28.551139 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4001c7c-80d3-44bc-b459-fa4efca88088 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:28.574115 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99abd424-4acc-4d1a-b096-6ef26e0476b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:28.574838 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abd424-4acc-4d1a-b096-6ef26e0476b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:28.575036 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abd424-4acc-4d1a-b096-6ef26e0476b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:28.575288 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abd424-4acc-4d1a-b096-6ef26e0476b1 admin admin] PATH_INFO: `/v3/users/5dd5912ef6394f36aca53707bbc7ea91` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:28.588367 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99abd424-4acc-4d1a-b096-6ef26e0476b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dd5912ef6394f36aca53707bbc7ea91)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:28.599115 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99abd424-4acc-4d1a-b096-6ef26e0476b1 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:28.766238 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 863/1716] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:28.767908 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42daeb6-b626-4f9f-bd94-4f89d88184c5 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:28.772377 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-99abd424-4acc-4d1a-b096-6ef26e0476b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dd5912ef6394f36aca53707bbc7ea91'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:28.792549 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-99abd424-4acc-4d1a-b096-6ef26e0476b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dd5912ef6394f36aca53707bbc7ea91'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:28.793681 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-99abd424-4acc-4d1a-b096-6ef26e0476b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dd5912ef6394f36aca53707bbc7ea91'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:28.794585 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-99abd424-4acc-4d1a-b096-6ef26e0476b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dd5912ef6394f36aca53707bbc7ea91'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:28.801099 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42daeb6-b626-4f9f-bd94-4f89d88184c5 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:28.819243 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9848c62e-9a66-4425-8868-df6bfce2672a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:28.820354 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9848c62e-9a66-4425-8868-df6bfce2672a admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:28.820966 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9848c62e-9a66-4425-8868-df6bfce2672a admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:28.822460 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9848c62e-9a66-4425-8868-df6bfce2672a admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:28.823491 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9848c62e-9a66-4425-8868-df6bfce2672a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:11:28.824376 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9848c62e-9a66-4425-8868-df6bfce2672a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:28.826578 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-99abd424-4acc-4d1a-b096-6ef26e0476b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dd5912ef6394f36aca53707bbc7ea91'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:28.829671 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9848c62e-9a66-4425-8868-df6bfce2672a admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:28.879169 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 854/1717] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:11:28 2022] DELETE /identity/v3/users/5dd5912ef6394f36aca53707bbc7ea91 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:28.880126 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 864/1718] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:11:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:11:28.881714 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9848c62e-9a66-4425-8868-df6bfce2672a admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:28.889690 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99abd424-4acc-4d1a-b096-6ef26e0476b1 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:28.901128 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-99abd424-4acc-4d1a-b096-6ef26e0476b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:28.903227 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-9848c62e-9a66-4425-8868-df6bfce2672a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:28.941655 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9848c62e-9a66-4425-8868-df6bfce2672a admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:29.047302 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:29.127955 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99abd424-4acc-4d1a-b096-6ef26e0476b1 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:29.163392 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ef265-6c21-4879-9d8c-d0c256d08e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:29.164610 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3bb33-540e-4d30-9be5-420228333c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:29.166925 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ef265-6c21-4879-9d8c-d0c256d08e41 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:29.167192 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ef265-6c21-4879-9d8c-d0c256d08e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:29.168287 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3bb33-540e-4d30-9be5-420228333c99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:29.168582 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3bb33-540e-4d30-9be5-420228333c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:29.170837 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ef265-6c21-4879-9d8c-d0c256d08e41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:29.171514 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3bb33-540e-4d30-9be5-420228333c99 admin admin] PATH_INFO: `/v3/users/55fbe6b1b9f24fbeb59d2b5c1cea85ca` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:29.173436 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ef265-6c21-4879-9d8c-d0c256d08e41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:29.177334 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc3bb33-540e-4d30-9be5-420228333c99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55fbe6b1b9f24fbeb59d2b5c1cea85ca)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:29.187718 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc3bb33-540e-4d30-9be5-420228333c99 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:29.188991 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ef265-6c21-4879-9d8c-d0c256d08e41 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:29.317936 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 855/1719] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:11:28 2022] POST /identity/v3/projects => generated 373 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:29.319425 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ef265-6c21-4879-9d8c-d0c256d08e41 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:29.352644 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:29.395363 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-8bc3bb33-540e-4d30-9be5-420228333c99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55fbe6b1b9f24fbeb59d2b5c1cea85ca'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:29.414194 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-8bc3bb33-540e-4d30-9be5-420228333c99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55fbe6b1b9f24fbeb59d2b5c1cea85ca'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:29.435202 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-8bc3bb33-540e-4d30-9be5-420228333c99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55fbe6b1b9f24fbeb59d2b5c1cea85ca'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:29.496048 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-8bc3bb33-540e-4d30-9be5-420228333c99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55fbe6b1b9f24fbeb59d2b5c1cea85ca'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:29.499167 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-8bc3bb33-540e-4d30-9be5-420228333c99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55fbe6b1b9f24fbeb59d2b5c1cea85ca'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:29.525715 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 865/1720] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:11:28 2022] DELETE /identity/v3/users/55fbe6b1b9f24fbeb59d2b5c1cea85ca => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:29.533614 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f060637-b63a-42ff-a230-f863e2bc6df5 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:29.533981 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f060637-b63a-42ff-a230-f863e2bc6df5 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:29.534183 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f060637-b63a-42ff-a230-f863e2bc6df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:29.597411 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-4f060637-b63a-42ff-a230-f863e2bc6df5 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:29.603591 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-4f060637-b63a-42ff-a230-f863e2bc6df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:29.627177 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ef265-6c21-4879-9d8c-d0c256d08e41 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:29.905674 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 866/1721] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:29.924580 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3191f418-eeed-4e7c-a68d-dbd9f574f953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:29.925501 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191f418-eeed-4e7c-a68d-dbd9f574f953 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:29.927566 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191f418-eeed-4e7c-a68d-dbd9f574f953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:29.931085 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191f418-eeed-4e7c-a68d-dbd9f574f953 admin admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:29.938690 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3191f418-eeed-4e7c-a68d-dbd9f574f953 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:29.941104 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3191f418-eeed-4e7c-a68d-dbd9f574f953 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:29.958652 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f060637-b63a-42ff-a230-f863e2bc6df5 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:29.960513 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-4f060637-b63a-42ff-a230-f863e2bc6df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:30.043606 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 856/1722] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:11:29 2022] POST /identity/v3/users => generated 287 bytes in 725 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:30.048264 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3191f418-eeed-4e7c-a68d-dbd9f574f953 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:30.059676 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-3191f418-eeed-4e7c-a68d-dbd9f574f953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:30.114235 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3191f418-eeed-4e7c-a68d-dbd9f574f953 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:30.144044 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ffa13-689e-423d-b8cc-5ad43ea2d52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:30.144784 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ffa13-689e-423d-b8cc-5ad43ea2d52a admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:30.145076 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ffa13-689e-423d-b8cc-5ad43ea2d52a admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:30.145355 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ffa13-689e-423d-b8cc-5ad43ea2d52a admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:30.146252 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772ffa13-689e-423d-b8cc-5ad43ea2d52a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:30.154200 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772ffa13-689e-423d-b8cc-5ad43ea2d52a admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:30.180831 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 857/1723] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:30.182413 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ffa13-689e-423d-b8cc-5ad43ea2d52a admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:30.209870 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ffa13-689e-423d-b8cc-5ad43ea2d52a admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:30.229209 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f060637-b63a-42ff-a230-f863e2bc6df5 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:30.230233 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc7074-8493-4042-870c-b074332650fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:30.231786 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc7074-8493-4042-870c-b074332650fc admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:30.231786 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc7074-8493-4042-870c-b074332650fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:30.231786 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc7074-8493-4042-870c-b074332650fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:30.232210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc7074-8493-4042-870c-b074332650fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:30.233877 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc7074-8493-4042-870c-b074332650fc admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:30.254367 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984c536-3ced-40f4-b430-3b1b837a80da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:30.258536 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984c536-3ced-40f4-b430-3b1b837a80da service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:30.260342 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984c536-3ced-40f4-b430-3b1b837a80da service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:30.260581 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984c536-3ced-40f4-b430-3b1b837a80da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:30.273672 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 858/1724] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:11:30.275159 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc7074-8493-4042-870c-b074332650fc admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:30.303473 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc7074-8493-4042-870c-b074332650fc admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:30.305424 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d984c536-3ced-40f4-b430-3b1b837a80da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:30.310755 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d984c536-3ced-40f4-b430-3b1b837a80da service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:30.328831 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5505fd9-d0c7-46eb-a3fd-70057633d2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:30.329891 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5505fd9-d0c7-46eb-a3fd-70057633d2c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:30.330235 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5505fd9-d0c7-46eb-a3fd-70057633d2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:30.330465 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5505fd9-d0c7-46eb-a3fd-70057633d2c5 admin admin] PATH_INFO: `/v3/projects/da88a172c2f54717b7c28cc0df71d24d/users/f68c2b977c204c67b0ed67bb3f97652b/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:30.379293 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5505fd9-d0c7-46eb-a3fd-70057633d2c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da88a172c2f54717b7c28cc0df71d24d, user_id=f68c2b977c204c67b0ed67bb3f97652b, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:30.382708 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5505fd9-d0c7-46eb-a3fd-70057633d2c5 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:30.395053 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 867/1725] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:11:30.415986 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 859/1726] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:30 2022] PUT /identity/v3/projects/da88a172c2f54717b7c28cc0df71d24d/users/f68c2b977c204c67b0ed67bb3f97652b/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:30.418968 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724964c-810e-4d98-a067-57ccd69f8b47 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:30.419264 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724964c-810e-4d98-a067-57ccd69f8b47 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:30.419548 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724964c-810e-4d98-a067-57ccd69f8b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:30.523540 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-b724964c-810e-4d98-a067-57ccd69f8b47 None None] MFA Rules not processed for user `f68c2b977c204c67b0ed67bb3f97652b`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:30.524777 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-b724964c-810e-4d98-a067-57ccd69f8b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:30.667679 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:30.860370 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 868/1727] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 443 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:30.869777 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5505fd9-d0c7-46eb-a3fd-70057633d2c5 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:30.894791 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f97ec-f3d2-4f0e-b1e0-b71f4e3858f7 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:30.895742 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f97ec-f3d2-4f0e-b1e0-b71f4e3858f7 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:30.896078 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f97ec-f3d2-4f0e-b1e0-b71f4e3858f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:30.949211 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:30.970871 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-047f97ec-f3d2-4f0e-b1e0-b71f4e3858f7 None None] MFA Rules not processed for user `83e77cb05c4546c7a98ada817573edf3`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:30.972342 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-047f97ec-f3d2-4f0e-b1e0-b71f4e3858f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:31.160120 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5505fd9-d0c7-46eb-a3fd-70057633d2c5 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:31.166556 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4cf9d-d15f-457c-a1a4-cadfe700ed42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:31.166759 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 869/1728] 10.222.0.42 () {58 vars in 1015 bytes} [Mon Jun 20 06:11:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:31.167690 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4cf9d-d15f-457c-a1a4-cadfe700ed42 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:31.168250 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4cf9d-d15f-457c-a1a4-cadfe700ed42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:31.169084 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4cf9d-d15f-457c-a1a4-cadfe700ed42 admin admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:31.171735 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c4cf9d-d15f-457c-a1a4-cadfe700ed42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:31.174213 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c4cf9d-d15f-457c-a1a4-cadfe700ed42 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:31.207993 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f97ec-f3d2-4f0e-b1e0-b71f4e3858f7 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:31.209857 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-047f97ec-f3d2-4f0e-b1e0-b71f4e3858f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:31.227840 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f97ec-f3d2-4f0e-b1e0-b71f4e3858f7 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:31.237309 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 860/1729] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:11:30 2022] POST /identity/v3/projects => generated 373 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:31.237510 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d68366-d2f0-45e0-bfdb-77d0769f2e47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:31.237510 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d68366-d2f0-45e0-bfdb-77d0769f2e47 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:31.237510 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d68366-d2f0-45e0-bfdb-77d0769f2e47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:31.237510 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d68366-d2f0-45e0-bfdb-77d0769f2e47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:31.238684 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4cf9d-d15f-457c-a1a4-cadfe700ed42 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:31.244155 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d68366-d2f0-45e0-bfdb-77d0769f2e47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:31.245861 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d68366-d2f0-45e0-bfdb-77d0769f2e47 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:31.277731 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 870/1730] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:31.450347 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4cf9d-d15f-457c-a1a4-cadfe700ed42 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:31.469151 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a96ced-2040-4927-a145-29dfe81bcd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:31.470210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a96ced-2040-4927-a145-29dfe81bcd9d admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:31.470210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a96ced-2040-4927-a145-29dfe81bcd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:31.470453 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a96ced-2040-4927-a145-29dfe81bcd9d admin admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:31.471735 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a96ced-2040-4927-a145-29dfe81bcd9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:31.482908 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a96ced-2040-4927-a145-29dfe81bcd9d admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:31.545600 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d68366-d2f0-45e0-bfdb-77d0769f2e47 service neutron] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:31.546139 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 861/1731] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:11:31 2022] POST /identity/v3/users => generated 293 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:31.563624 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d68366-d2f0-45e0-bfdb-77d0769f2e47 service neutron] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:31.584241 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823657e4-4ed1-4977-8aaa-a809f899ddb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:31.586206 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823657e4-4ed1-4977-8aaa-a809f899ddb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:31.586504 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823657e4-4ed1-4977-8aaa-a809f899ddb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:31.590740 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823657e4-4ed1-4977-8aaa-a809f899ddb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:31.591683 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823657e4-4ed1-4977-8aaa-a809f899ddb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:31.598021 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823657e4-4ed1-4977-8aaa-a809f899ddb9 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:31.659975 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 871/1732] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:31.661712 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a96ced-2040-4927-a145-29dfe81bcd9d admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:31.686487 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a96ced-2040-4927-a145-29dfe81bcd9d admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:31.715888 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d95b54-6f8f-452a-8c36-561498efedbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:31.716811 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d95b54-6f8f-452a-8c36-561498efedbf admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:31.717101 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d95b54-6f8f-452a-8c36-561498efedbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:31.717383 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d95b54-6f8f-452a-8c36-561498efedbf admin admin] PATH_INFO: `/v3/projects/85f77562325b4867b05676b8cdb18744/users/cbc5d2ea1653444fac98502ec9dc5395/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:31.730064 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e8e9e-5b4c-440f-a8c0-1710be7230e9 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:31.730358 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e8e9e-5b4c-440f-a8c0-1710be7230e9 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:31.730704 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e8e9e-5b4c-440f-a8c0-1710be7230e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:31.827745 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d95b54-6f8f-452a-8c36-561498efedbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=85f77562325b4867b05676b8cdb18744, user_id=cbc5d2ea1653444fac98502ec9dc5395, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:31.831346 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d95b54-6f8f-452a-8c36-561498efedbf admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:31.885326 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 862/1733] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:31 2022] PUT /identity/v3/projects/85f77562325b4867b05676b8cdb18744/users/cbc5d2ea1653444fac98502ec9dc5395/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:31.887858 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d95b54-6f8f-452a-8c36-561498efedbf admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:32.115395 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d95b54-6f8f-452a-8c36-561498efedbf admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:32.131493 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f38b7-11bf-4ece-8501-e0fd0408817f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:32.132252 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f38b7-11bf-4ece-8501-e0fd0408817f admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:32.132536 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f38b7-11bf-4ece-8501-e0fd0408817f admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:32.132833 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f38b7-11bf-4ece-8501-e0fd0408817f admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:32.133638 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05f38b7-11bf-4ece-8501-e0fd0408817f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:32.135417 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05f38b7-11bf-4ece-8501-e0fd0408817f admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:32.149675 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:32.151590 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-cf7e8e9e-5b4c-440f-a8c0-1710be7230e9 None None] MFA Rules not processed for user `498822fcffaf4cc79532c487418cb11c`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:32.154336 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-cf7e8e9e-5b4c-440f-a8c0-1710be7230e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:32.166921 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 863/1734] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:32.166921 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f38b7-11bf-4ece-8501-e0fd0408817f admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:32.169238 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-e05f38b7-11bf-4ece-8501-e0fd0408817f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:32.195324 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f38b7-11bf-4ece-8501-e0fd0408817f admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:32.207614 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d6dab-8e97-4db3-aa66-d857018d7d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:32.208497 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d6dab-8e97-4db3-aa66-d857018d7d08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:32.208846 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d6dab-8e97-4db3-aa66-d857018d7d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:32.209106 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d6dab-8e97-4db3-aa66-d857018d7d08 admin admin] PATH_INFO: `/v3/projects/418f1b32c2654b64a3f555d7033ef62d` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:32.210932 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d6dab-8e97-4db3-aa66-d857018d7d08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=418f1b32c2654b64a3f555d7033ef62d)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:32.215023 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d6dab-8e97-4db3-aa66-d857018d7d08 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:32.328061 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-680d6dab-8e97-4db3-aa66-d857018d7d08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '418f1b32c2654b64a3f555d7033ef62d', 'request_id': 'req-680d6dab-8e97-4db3-aa66-d857018d7d08'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:32.340915 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-680d6dab-8e97-4db3-aa66-d857018d7d08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '418f1b32c2654b64a3f555d7033ef62d', 'request_id': 'req-680d6dab-8e97-4db3-aa66-d857018d7d08'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:32.352469 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-680d6dab-8e97-4db3-aa66-d857018d7d08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '418f1b32c2654b64a3f555d7033ef62d', 'request_id': 'req-680d6dab-8e97-4db3-aa66-d857018d7d08'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:32.378819 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-680d6dab-8e97-4db3-aa66-d857018d7d08 admin admin] The token cache is being invalidate because project 418f1b32c2654b64a3f555d7033ef62d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:11:32.379179 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-680d6dab-8e97-4db3-aa66-d857018d7d08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:32.381564 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-680d6dab-8e97-4db3-aa66-d857018d7d08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:32.387912 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 864/1735] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:11:32 2022] DELETE /identity/v3/projects/418f1b32c2654b64a3f555d7033ef62d => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:32.388922 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d6dab-8e97-4db3-aa66-d857018d7d08 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:32.390500 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-680d6dab-8e97-4db3-aa66-d857018d7d08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:32.437293 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 872/1736] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 708 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:11:32.444811 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857fc1a-8402-4a35-8e63-8bfb401918ce None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:32.444811 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857fc1a-8402-4a35-8e63-8bfb401918ce None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:32.444811 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857fc1a-8402-4a35-8e63-8bfb401918ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:32.534778 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-a857fc1a-8402-4a35-8e63-8bfb401918ce None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:32.538589 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-a857fc1a-8402-4a35-8e63-8bfb401918ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:32.593718 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d6dab-8e97-4db3-aa66-d857018d7d08 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:32.610096 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb3746-27fd-4bfc-b437-a790fe6cfdc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:32.612326 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb3746-27fd-4bfc-b437-a790fe6cfdc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:32.613235 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb3746-27fd-4bfc-b437-a790fe6cfdc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:32.613855 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb3746-27fd-4bfc-b437-a790fe6cfdc5 admin admin] PATH_INFO: `/v3/projects/85f77562325b4867b05676b8cdb18744/users/cbc5d2ea1653444fac98502ec9dc5395/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:32.617294 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdb3746-27fd-4bfc-b437-a790fe6cfdc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85f77562325b4867b05676b8cdb18744, user_id=cbc5d2ea1653444fac98502ec9dc5395, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:32.624084 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdb3746-27fd-4bfc-b437-a790fe6cfdc5 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:32.656598 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 865/1737] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:32 2022] PUT /identity/v3/projects/85f77562325b4867b05676b8cdb18744/users/cbc5d2ea1653444fac98502ec9dc5395/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:32.668220 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376fa1cc-a43c-417a-99cc-253a04ac6d46 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:32.668920 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376fa1cc-a43c-417a-99cc-253a04ac6d46 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:32.669688 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376fa1cc-a43c-417a-99cc-253a04ac6d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:32.813709 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-376fa1cc-a43c-417a-99cc-253a04ac6d46 None None] MFA Rules not processed for user `cbc5d2ea1653444fac98502ec9dc5395`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:32.815056 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-376fa1cc-a43c-417a-99cc-253a04ac6d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:32.823412 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 873/1738] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:32.835503 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d7f81-b918-4620-b216-fe2181b29cc8 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:32.836058 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d7f81-b918-4620-b216-fe2181b29cc8 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:32.836779 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d7f81-b918-4620-b216-fe2181b29cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:32.888297 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-219d7f81-b918-4620-b216-fe2181b29cc8 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:32.894566 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-219d7f81-b918-4620-b216-fe2181b29cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:32.915198 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:33.019949 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 866/1739] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:32 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:33.038270 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376fa1cc-a43c-417a-99cc-253a04ac6d46 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:33.039788 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-376fa1cc-a43c-417a-99cc-253a04ac6d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:33.045135 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:33.119227 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 874/1740] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:11:33.123755 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d7f81-b918-4620-b216-fe2181b29cc8 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:33.155316 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d7f81-b918-4620-b216-fe2181b29cc8 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:33.171106 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937e4c6-f82e-4979-a8e5-45fbe0af4fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:33.173072 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937e4c6-f82e-4979-a8e5-45fbe0af4fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:33.174771 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937e4c6-f82e-4979-a8e5-45fbe0af4fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:33.175157 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937e4c6-f82e-4979-a8e5-45fbe0af4fc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:33.176045 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0937e4c6-f82e-4979-a8e5-45fbe0af4fc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:11:33.178313 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0937e4c6-f82e-4979-a8e5-45fbe0af4fc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:33.184667 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0937e4c6-f82e-4979-a8e5-45fbe0af4fc9 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:33.209150 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376fa1cc-a43c-417a-99cc-253a04ac6d46 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:33.219728 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 875/1741] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:11:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:11:33.224841 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70301b35-398f-46d6-9fc6-94ea165e28ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:33.225974 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937e4c6-f82e-4979-a8e5-45fbe0af4fc9 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:33.226122 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70301b35-398f-46d6-9fc6-94ea165e28ec service cinder] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:33.226122 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70301b35-398f-46d6-9fc6-94ea165e28ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:33.226309 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70301b35-398f-46d6-9fc6-94ea165e28ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:33.252862 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937e4c6-f82e-4979-a8e5-45fbe0af4fc9 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:33.253883 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70301b35-398f-46d6-9fc6-94ea165e28ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:33.255384 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70301b35-398f-46d6-9fc6-94ea165e28ec service cinder] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:33.273172 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad8c654-5582-4713-b418-ed811d86d842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:33.274970 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8c654-5582-4713-b418-ed811d86d842 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:33.275365 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8c654-5582-4713-b418-ed811d86d842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:33.278675 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8c654-5582-4713-b418-ed811d86d842 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:33.279065 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 867/1742] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:33 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:33.279532 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad8c654-5582-4713-b418-ed811d86d842 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:33.284913 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad8c654-5582-4713-b418-ed811d86d842 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:33.349792 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e915561-5257-4ac6-bc0f-534a7ae7cc20 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:33.350101 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e915561-5257-4ac6-bc0f-534a7ae7cc20 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:33.350446 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e915561-5257-4ac6-bc0f-534a7ae7cc20 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:33.353168 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 868/1743] 10.222.0.39 () {54 vars in 912 bytes} [Mon Jun 20 06:11:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:11:33.369827 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6ee9b-5097-4d38-a906-1b8c3ca9c341 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:33.370138 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6ee9b-5097-4d38-a906-1b8c3ca9c341 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:33.370395 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6ee9b-5097-4d38-a906-1b8c3ca9c341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:33.384002 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 876/1744] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:11:33 2022] POST /identity/v3/projects => generated 399 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:33.386705 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad8c654-5582-4713-b418-ed811d86d842 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:33.410180 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-8fd6ee9b-5097-4d38-a906-1b8c3ca9c341 None None] MFA Rules not processed for user `83e77cb05c4546c7a98ada817573edf3`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:33.416171 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-8fd6ee9b-5097-4d38-a906-1b8c3ca9c341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:33.683507 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad8c654-5582-4713-b418-ed811d86d842 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:33.692656 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 869/1745] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Jun 20 06:11:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:11:33.694037 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd6ee9b-5097-4d38-a906-1b8c3ca9c341 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:33.708416 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-8fd6ee9b-5097-4d38-a906-1b8c3ca9c341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:33.712739 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032eb40a-dfbf-4025-8d1e-aa6508382980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:33.713635 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032eb40a-dfbf-4025-8d1e-aa6508382980 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:33.713911 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032eb40a-dfbf-4025-8d1e-aa6508382980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:33.716095 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032eb40a-dfbf-4025-8d1e-aa6508382980 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:33.718400 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032eb40a-dfbf-4025-8d1e-aa6508382980 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:33.726442 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032eb40a-dfbf-4025-8d1e-aa6508382980 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:33.755142 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd6ee9b-5097-4d38-a906-1b8c3ca9c341 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:33.778620 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8939ca-328b-4bc0-80f4-bd6d9cae7da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:33.785103 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8939ca-328b-4bc0-80f4-bd6d9cae7da8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:33.788449 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8939ca-328b-4bc0-80f4-bd6d9cae7da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:33.788449 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8939ca-328b-4bc0-80f4-bd6d9cae7da8 admin admin] PATH_INFO: `/v3/projects/5ba760a2ee1f4e45870588c9706d5bf6` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:33.791720 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 877/1746] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:11:33 2022] POST /identity/v3/users => generated 300 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:33.792589 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032eb40a-dfbf-4025-8d1e-aa6508382980 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:33.796023 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8939ca-328b-4bc0-80f4-bd6d9cae7da8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ba760a2ee1f4e45870588c9706d5bf6)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:33.800580 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-032eb40a-dfbf-4025-8d1e-aa6508382980 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:33.805285 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8939ca-328b-4bc0-80f4-bd6d9cae7da8 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:33.850109 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032eb40a-dfbf-4025-8d1e-aa6508382980 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:33.874215 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fcb7e1-c565-4309-a04c-6cedf1256006 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:33.875387 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fcb7e1-c565-4309-a04c-6cedf1256006 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:33.875868 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fcb7e1-c565-4309-a04c-6cedf1256006 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:33.876384 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fcb7e1-c565-4309-a04c-6cedf1256006 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:33.893789 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fcb7e1-c565-4309-a04c-6cedf1256006 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:33.895547 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fcb7e1-c565-4309-a04c-6cedf1256006 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:33.913263 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 878/1747] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:33.914427 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fcb7e1-c565-4309-a04c-6cedf1256006 service neutron] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:33.943758 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fcb7e1-c565-4309-a04c-6cedf1256006 service neutron] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:34.030062 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-6a8939ca-328b-4bc0-80f4-bd6d9cae7da8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ba760a2ee1f4e45870588c9706d5bf6', 'request_id': 'req-6a8939ca-328b-4bc0-80f4-bd6d9cae7da8'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:34.056184 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:34.075530 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-6a8939ca-328b-4bc0-80f4-bd6d9cae7da8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ba760a2ee1f4e45870588c9706d5bf6', 'request_id': 'req-6a8939ca-328b-4bc0-80f4-bd6d9cae7da8'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:34.101644 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad288dc-8c37-42de-9444-2b32fd4f37d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:34.102658 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad288dc-8c37-42de-9444-2b32fd4f37d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:34.104066 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-6a8939ca-328b-4bc0-80f4-bd6d9cae7da8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ba760a2ee1f4e45870588c9706d5bf6', 'request_id': 'req-6a8939ca-328b-4bc0-80f4-bd6d9cae7da8'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:34.106548 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad288dc-8c37-42de-9444-2b32fd4f37d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:34.107252 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad288dc-8c37-42de-9444-2b32fd4f37d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:34.108985 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad288dc-8c37-42de-9444-2b32fd4f37d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:34.114952 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad288dc-8c37-42de-9444-2b32fd4f37d7 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:34.129049 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-6a8939ca-328b-4bc0-80f4-bd6d9cae7da8 admin admin] The token cache is being invalidate because project 5ba760a2ee1f4e45870588c9706d5bf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:11:34.129342 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-6a8939ca-328b-4bc0-80f4-bd6d9cae7da8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:34.131179 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-6a8939ca-328b-4bc0-80f4-bd6d9cae7da8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:34.134769 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 870/1748] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:11:33 2022] DELETE /identity/v3/projects/5ba760a2ee1f4e45870588c9706d5bf6 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:34.140544 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8939ca-328b-4bc0-80f4-bd6d9cae7da8 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:34.141994 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-6a8939ca-328b-4bc0-80f4-bd6d9cae7da8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:34.162847 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8939ca-328b-4bc0-80f4-bd6d9cae7da8 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:34.166022 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 879/1749] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:33 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:34.175599 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951fed14-f410-4283-8857-c114fea9daee None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:34.176220 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951fed14-f410-4283-8857-c114fea9daee None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:34.176753 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951fed14-f410-4283-8857-c114fea9daee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:34.200690 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8524b35e-eae5-4857-9734-1404ee4c4877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:34.202054 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524b35e-eae5-4857-9734-1404ee4c4877 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:34.202369 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524b35e-eae5-4857-9734-1404ee4c4877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:34.202602 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524b35e-eae5-4857-9734-1404ee4c4877 admin admin] PATH_INFO: `/v3/users/f68c2b977c204c67b0ed67bb3f97652b` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:34.203924 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8524b35e-eae5-4857-9734-1404ee4c4877 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f68c2b977c204c67b0ed67bb3f97652b)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:34.206535 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8524b35e-eae5-4857-9734-1404ee4c4877 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:34.271656 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-951fed14-f410-4283-8857-c114fea9daee None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:34.273219 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-951fed14-f410-4283-8857-c114fea9daee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:34.281820 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:34.298267 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 880/1750] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:34.301580 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951fed14-f410-4283-8857-c114fea9daee None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:34.306795 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-951fed14-f410-4283-8857-c114fea9daee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:34.340398 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-8524b35e-eae5-4857-9734-1404ee4c4877 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f68c2b977c204c67b0ed67bb3f97652b'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:34.342898 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951fed14-f410-4283-8857-c114fea9daee None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:34.357500 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-8524b35e-eae5-4857-9734-1404ee4c4877 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f68c2b977c204c67b0ed67bb3f97652b'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:34.358891 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-8524b35e-eae5-4857-9734-1404ee4c4877 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f68c2b977c204c67b0ed67bb3f97652b'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:34.362264 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-8524b35e-eae5-4857-9734-1404ee4c4877 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f68c2b977c204c67b0ed67bb3f97652b'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:34.390129 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4aa938-fddf-4b53-9e15-55e0cb97c3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:34.398207 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4aa938-fddf-4b53-9e15-55e0cb97c3a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:34.398868 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4aa938-fddf-4b53-9e15-55e0cb97c3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:34.399168 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4aa938-fddf-4b53-9e15-55e0cb97c3a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:34.416218 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4aa938-fddf-4b53-9e15-55e0cb97c3a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:34.426722 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4aa938-fddf-4b53-9e15-55e0cb97c3a1 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:34.426870 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-8524b35e-eae5-4857-9734-1404ee4c4877 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f68c2b977c204c67b0ed67bb3f97652b'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:34.464895 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 881/1751] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:34 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:34.471382 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07cec6f-9155-4e24-ad94-e0409bf1995e None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:34.471711 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07cec6f-9155-4e24-ad94-e0409bf1995e None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:34.472035 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07cec6f-9155-4e24-ad94-e0409bf1995e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:34.484255 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 871/1752] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:11:34 2022] DELETE /identity/v3/users/f68c2b977c204c67b0ed67bb3f97652b => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:34.487056 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8524b35e-eae5-4857-9734-1404ee4c4877 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:34.495687 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-8524b35e-eae5-4857-9734-1404ee4c4877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:34.540909 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-e07cec6f-9155-4e24-ad94-e0409bf1995e None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:34.544995 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-e07cec6f-9155-4e24-ad94-e0409bf1995e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:34.723412 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 882/1753] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:34.726248 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad957c-7b86-40e2-9ed8-ca7774db60ad None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:34.726560 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad957c-7b86-40e2-9ed8-ca7774db60ad None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:34.726931 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad957c-7b86-40e2-9ed8-ca7774db60ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:34.754211 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-55ad957c-7b86-40e2-9ed8-ca7774db60ad None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:34.756096 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-55ad957c-7b86-40e2-9ed8-ca7774db60ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:34.769828 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 883/1754] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:34.771312 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3f6ed-d5fd-4da2-b0a4-bde2189b3b6e None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:34.771596 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3f6ed-d5fd-4da2-b0a4-bde2189b3b6e None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:34.771870 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3f6ed-d5fd-4da2-b0a4-bde2189b3b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:34.784858 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8524b35e-eae5-4857-9734-1404ee4c4877 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:34.799927 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f8365-5735-4292-ba2d-f0884ca753c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:34.800276 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-93f3f6ed-d5fd-4da2-b0a4-bde2189b3b6e None None] MFA Rules not processed for user `68c4b81f2f704a9bbe15fd0f3326bb3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:34.801797 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-93f3f6ed-d5fd-4da2-b0a4-bde2189b3b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:34.804728 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f8365-5735-4292-ba2d-f0884ca753c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:34.808773 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f8365-5735-4292-ba2d-f0884ca753c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:34.808930 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f8365-5735-4292-ba2d-f0884ca753c9 admin admin] PATH_INFO: `/v3/projects/2b0e6a032a114e03a1bcff4868f8f42e/users/ca886001e94947abafe862c27d20d1f1/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:34.880193 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f8365-5735-4292-ba2d-f0884ca753c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b0e6a032a114e03a1bcff4868f8f42e, user_id=ca886001e94947abafe862c27d20d1f1, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:34.885139 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f8365-5735-4292-ba2d-f0884ca753c9 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:34.933875 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 872/1755] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:34 2022] PUT /identity/v3/projects/2b0e6a032a114e03a1bcff4868f8f42e/users/ca886001e94947abafe862c27d20d1f1/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:34.944484 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f8365-5735-4292-ba2d-f0884ca753c9 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:35.015566 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 884/1756] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:35.027086 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3f6ed-d5fd-4da2-b0a4-bde2189b3b6e None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:35.028821 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-93f3f6ed-d5fd-4da2-b0a4-bde2189b3b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:35.145576 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f8365-5735-4292-ba2d-f0884ca753c9 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:35.188012 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90967e37-5bef-4591-9c50-1baca1f251b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:35.192787 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90967e37-5bef-4591-9c50-1baca1f251b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:35.193791 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90967e37-5bef-4591-9c50-1baca1f251b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:35.194236 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90967e37-5bef-4591-9c50-1baca1f251b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:35.195527 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90967e37-5bef-4591-9c50-1baca1f251b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:11:35.197276 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90967e37-5bef-4591-9c50-1baca1f251b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:35.199081 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90967e37-5bef-4591-9c50-1baca1f251b2 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:35.205660 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3f6ed-d5fd-4da2-b0a4-bde2189b3b6e None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:35.253575 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 873/1757] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:11:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:11:35.265462 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc82aab-ee9b-4ced-9947-bbd667960015 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:35.265799 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc82aab-ee9b-4ced-9947-bbd667960015 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:35.266084 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc82aab-ee9b-4ced-9947-bbd667960015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:35.350408 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:35.382410 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-2dc82aab-ee9b-4ced-9947-bbd667960015 None None] MFA Rules not processed for user `ca886001e94947abafe862c27d20d1f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:35.383688 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-2dc82aab-ee9b-4ced-9947-bbd667960015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:35.444513 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:35.469684 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b30d2d-46a4-4b8e-be10-1688a652695b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:35.471073 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b30d2d-46a4-4b8e-be10-1688a652695b service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:35.471419 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b30d2d-46a4-4b8e-be10-1688a652695b service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:35.471685 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b30d2d-46a4-4b8e-be10-1688a652695b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:35.525092 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b30d2d-46a4-4b8e-be10-1688a652695b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:35.526568 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b30d2d-46a4-4b8e-be10-1688a652695b service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:35.582607 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 885/1758] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:35.583509 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b30d2d-46a4-4b8e-be10-1688a652695b service neutron] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:35.629370 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b30d2d-46a4-4b8e-be10-1688a652695b service neutron] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:35.651830 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ccee2-70f0-4a97-9928-6718a7ffd0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:35.652642 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ccee2-70f0-4a97-9928-6718a7ffd0ee admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:35.653028 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ccee2-70f0-4a97-9928-6718a7ffd0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:35.653302 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ccee2-70f0-4a97-9928-6718a7ffd0ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:35.654186 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2ccee2-70f0-4a97-9928-6718a7ffd0ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:35.656371 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2ccee2-70f0-4a97-9928-6718a7ffd0ee admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:35.665920 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 874/1759] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:35 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:35.671146 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc82aab-ee9b-4ced-9947-bbd667960015 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:35.697640 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc82aab-ee9b-4ced-9947-bbd667960015 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:35.714653 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe74c19-7381-4089-9a0e-0b231644d60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:35.715636 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe74c19-7381-4089-9a0e-0b231644d60c admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:35.716161 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe74c19-7381-4089-9a0e-0b231644d60c admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:35.716847 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe74c19-7381-4089-9a0e-0b231644d60c admin admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:35.717796 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe74c19-7381-4089-9a0e-0b231644d60c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:35.719963 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe74c19-7381-4089-9a0e-0b231644d60c admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:35.762925 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 886/1760] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:11:35 2022] POST /identity/v3/projects => generated 371 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:35.773920 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ccee2-70f0-4a97-9928-6718a7ffd0ee admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:35.813953 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 875/1761] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:11:35 2022] POST /identity/v3/projects => generated 401 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:35.816462 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe74c19-7381-4089-9a0e-0b231644d60c admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:35.943541 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ccee2-70f0-4a97-9928-6718a7ffd0ee admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:35.943677 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe74c19-7381-4089-9a0e-0b231644d60c admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:35.962377 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dbbe74-45da-4fbf-9e83-d53ca8ce9f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:35.969166 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce8003d-2329-42b1-82dd-8dfaa01623c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:35.969468 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dbbe74-45da-4fbf-9e83-d53ca8ce9f04 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:35.969767 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dbbe74-45da-4fbf-9e83-d53ca8ce9f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:35.969870 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8003d-2329-42b1-82dd-8dfaa01623c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:35.970048 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dbbe74-45da-4fbf-9e83-d53ca8ce9f04 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:35.970152 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8003d-2329-42b1-82dd-8dfaa01623c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:35.970493 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8003d-2329-42b1-82dd-8dfaa01623c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:35.970816 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dbbe74-45da-4fbf-9e83-d53ca8ce9f04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:35.974651 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce8003d-2329-42b1-82dd-8dfaa01623c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:35.975144 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dbbe74-45da-4fbf-9e83-d53ca8ce9f04 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:35.988601 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce8003d-2329-42b1-82dd-8dfaa01623c2 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:36.029654 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 887/1762] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:11:35 2022] POST /identity/v3/users => generated 286 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:36.033929 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dbbe74-45da-4fbf-9e83-d53ca8ce9f04 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:36.072411 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 876/1763] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:11:35 2022] POST /identity/v3/users => generated 307 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:36.074200 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce8003d-2329-42b1-82dd-8dfaa01623c2 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:36.075318 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dbbe74-45da-4fbf-9e83-d53ca8ce9f04 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:36.099632 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb50df-997b-4024-82f9-30480f575e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:36.100344 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb50df-997b-4024-82f9-30480f575e0e admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:36.100629 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb50df-997b-4024-82f9-30480f575e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:36.100934 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb50df-997b-4024-82f9-30480f575e0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:36.101508 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce8003d-2329-42b1-82dd-8dfaa01623c2 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:36.101710 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb50df-997b-4024-82f9-30480f575e0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:36.103866 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb50df-997b-4024-82f9-30480f575e0e admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:36.115658 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8e7ea-d022-48e5-81c5-fed051cb85f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:36.116354 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8e7ea-d022-48e5-81c5-fed051cb85f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:36.117268 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8e7ea-d022-48e5-81c5-fed051cb85f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:36.118139 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8e7ea-d022-48e5-81c5-fed051cb85f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:36.120223 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e8e7ea-d022-48e5-81c5-fed051cb85f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:36.124196 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e8e7ea-d022-48e5-81c5-fed051cb85f6 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:36.135135 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 888/1764] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:36.138994 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb50df-997b-4024-82f9-30480f575e0e admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:36.152786 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 877/1765] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:36.160589 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8e7ea-d022-48e5-81c5-fed051cb85f6 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:36.170908 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb50df-997b-4024-82f9-30480f575e0e admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:36.180688 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f58cd9-6ac5-48b5-8c37-dd86695e4559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:36.181961 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f58cd9-6ac5-48b5-8c37-dd86695e4559 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:36.182569 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f58cd9-6ac5-48b5-8c37-dd86695e4559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:36.183134 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f58cd9-6ac5-48b5-8c37-dd86695e4559 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:36.184107 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f58cd9-6ac5-48b5-8c37-dd86695e4559 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:36.186142 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f58cd9-6ac5-48b5-8c37-dd86695e4559 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:36.188963 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8e7ea-d022-48e5-81c5-fed051cb85f6 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:36.207676 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa752a8-8dd7-4bb1-a0ac-af090843446f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:36.208734 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa752a8-8dd7-4bb1-a0ac-af090843446f admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:36.209951 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa752a8-8dd7-4bb1-a0ac-af090843446f admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:36.211946 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa752a8-8dd7-4bb1-a0ac-af090843446f admin admin] PATH_INFO: `/v3/projects/f27fcd86e2c6437c87e9618a4fb5d076/users/d3bbe19735d74b0ba7002303c8ebf589/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:36.232996 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 889/1766] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:11:36.238335 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f58cd9-6ac5-48b5-8c37-dd86695e4559 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:36.268919 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa752a8-8dd7-4bb1-a0ac-af090843446f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f27fcd86e2c6437c87e9618a4fb5d076, user_id=d3bbe19735d74b0ba7002303c8ebf589, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:36.279463 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa752a8-8dd7-4bb1-a0ac-af090843446f admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:36.294152 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f58cd9-6ac5-48b5-8c37-dd86695e4559 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:36.323998 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 878/1767] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:36 2022] PUT /identity/v3/projects/f27fcd86e2c6437c87e9618a4fb5d076/users/d3bbe19735d74b0ba7002303c8ebf589/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:36.326972 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa752a8-8dd7-4bb1-a0ac-af090843446f admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:36.524958 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:36.583955 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa752a8-8dd7-4bb1-a0ac-af090843446f admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:36.595523 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0791b94-022b-41b5-a920-684e80dfec29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:36.595824 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0791b94-022b-41b5-a920-684e80dfec29 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:36.595987 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4918f1ae-8ea6-4a1c-b4a3-ba0f7701d20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:36.596120 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0791b94-022b-41b5-a920-684e80dfec29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:36.597121 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918f1ae-8ea6-4a1c-b4a3-ba0f7701d20f admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:36.597275 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0791b94-022b-41b5-a920-684e80dfec29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:36.600482 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0791b94-022b-41b5-a920-684e80dfec29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:36.602546 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918f1ae-8ea6-4a1c-b4a3-ba0f7701d20f admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:36.602986 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918f1ae-8ea6-4a1c-b4a3-ba0f7701d20f admin admin] PATH_INFO: `/v3/projects/248f06d996aa4a20a2c56fdef9550e12/users/04f84a274d4547e0a02716c7fc0e72be/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:36.606531 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0791b94-022b-41b5-a920-684e80dfec29 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:36.649533 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 879/1768] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:36.652374 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0791b94-022b-41b5-a920-684e80dfec29 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:36.672304 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4918f1ae-8ea6-4a1c-b4a3-ba0f7701d20f admin admin] RBAC: Authorizing `identity:create_grant(project_id=248f06d996aa4a20a2c56fdef9550e12, user_id=04f84a274d4547e0a02716c7fc0e72be, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:36.675134 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0791b94-022b-41b5-a920-684e80dfec29 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:36.679167 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4918f1ae-8ea6-4a1c-b4a3-ba0f7701d20f admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:36.695104 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c841e-a360-44ee-bb16-8bd1ce82c90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:36.699589 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:36.704531 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c841e-a360-44ee-bb16-8bd1ce82c90e admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:36.706267 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c841e-a360-44ee-bb16-8bd1ce82c90e admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:36.706584 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c841e-a360-44ee-bb16-8bd1ce82c90e admin admin] PATH_INFO: `/v3/projects/f27fcd86e2c6437c87e9618a4fb5d076/users/d3bbe19735d74b0ba7002303c8ebf589/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:36.713095 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 890/1769] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:36 2022] PUT /identity/v3/projects/248f06d996aa4a20a2c56fdef9550e12/users/04f84a274d4547e0a02716c7fc0e72be/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:36.719906 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c841e-a360-44ee-bb16-8bd1ce82c90e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f27fcd86e2c6437c87e9618a4fb5d076, user_id=d3bbe19735d74b0ba7002303c8ebf589, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:36.723829 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee014d0-fcb5-4e2b-b90a-6d788ba62bd5 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:36.724195 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee014d0-fcb5-4e2b-b90a-6d788ba62bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:36.724544 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee014d0-fcb5-4e2b-b90a-6d788ba62bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:36.750643 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c841e-a360-44ee-bb16-8bd1ce82c90e admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:36.826859 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 880/1770] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:36 2022] PUT /identity/v3/projects/f27fcd86e2c6437c87e9618a4fb5d076/users/d3bbe19735d74b0ba7002303c8ebf589/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:36.838318 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeaad88-5d30-49ec-8785-c93b2af86d49 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:36.840322 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeaad88-5d30-49ec-8785-c93b2af86d49 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:36.840848 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeaad88-5d30-49ec-8785-c93b2af86d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:36.868323 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-bee014d0-fcb5-4e2b-b90a-6d788ba62bd5 None None] MFA Rules not processed for user `04f84a274d4547e0a02716c7fc0e72be`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:36.869623 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-bee014d0-fcb5-4e2b-b90a-6d788ba62bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:37.040672 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-cdeaad88-5d30-49ec-8785-c93b2af86d49 None None] MFA Rules not processed for user `d3bbe19735d74b0ba7002303c8ebf589`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:37.054312 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-cdeaad88-5d30-49ec-8785-c93b2af86d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:37.163519 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 891/1771] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 440 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:11:37.175696 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee014d0-fcb5-4e2b-b90a-6d788ba62bd5 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:37.178586 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-bee014d0-fcb5-4e2b-b90a-6d788ba62bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:37.403843 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 881/1772] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:36 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 566 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:11:37.407751 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5599b0c5-6f03-44b7-a2d2-8dba28ccda8a None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:37.408891 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5599b0c5-6f03-44b7-a2d2-8dba28ccda8a None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:37.409102 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5599b0c5-6f03-44b7-a2d2-8dba28ccda8a None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:37.411179 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 882/1773] 10.222.0.39 () {54 vars in 921 bytes} [Mon Jun 20 06:11:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:11:37.415947 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5599b0c5-6f03-44b7-a2d2-8dba28ccda8a None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:37.420258 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-5599b0c5-6f03-44b7-a2d2-8dba28ccda8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:37.478137 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee014d0-fcb5-4e2b-b90a-6d788ba62bd5 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:37.495290 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81c77f-2df7-4a76-8948-05baa9ed392f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cb22811a754357ab9d839b70d44261', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:37.495991 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81c77f-2df7-4a76-8948-05baa9ed392f service glance] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:37.496310 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81c77f-2df7-4a76-8948-05baa9ed392f service glance] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:37.497221 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81c77f-2df7-4a76-8948-05baa9ed392f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:37.544930 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df81c77f-2df7-4a76-8948-05baa9ed392f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:37.546343 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df81c77f-2df7-4a76-8948-05baa9ed392f service glance] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:37.573029 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 892/1774] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:11:37.573905 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81c77f-2df7-4a76-8948-05baa9ed392f service glance] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:37.601600 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-df81c77f-2df7-4a76-8948-05baa9ed392f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:37.745031 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5599b0c5-6f03-44b7-a2d2-8dba28ccda8a None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:37.754896 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491f559-c431-4dc0-8dd9-18630573a702 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:37.755739 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491f559-c431-4dc0-8dd9-18630573a702 service cinder] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:37.756759 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491f559-c431-4dc0-8dd9-18630573a702 service cinder] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:37.756759 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491f559-c431-4dc0-8dd9-18630573a702 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:37.801901 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2491f559-c431-4dc0-8dd9-18630573a702 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:37.804041 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2491f559-c431-4dc0-8dd9-18630573a702 service cinder] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:37.851741 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 883/1775] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:37 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:11:37.853819 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d132e9-faaa-4d34-9c82-39ca4ac0b601 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:37.856508 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d132e9-faaa-4d34-9c82-39ca4ac0b601 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:37.857237 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d132e9-faaa-4d34-9c82-39ca4ac0b601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:37.860801 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81c77f-2df7-4a76-8948-05baa9ed392f service glance] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:37.881477 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177553a-6417-416e-ad7d-8d20c5e91d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:37.885324 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177553a-6417-416e-ad7d-8d20c5e91d70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:37.885659 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177553a-6417-416e-ad7d-8d20c5e91d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:37.886000 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177553a-6417-416e-ad7d-8d20c5e91d70 admin admin] PATH_INFO: `/v3/projects/da88a172c2f54717b7c28cc0df71d24d` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:37.893091 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c177553a-6417-416e-ad7d-8d20c5e91d70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da88a172c2f54717b7c28cc0df71d24d)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:37.895244 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c177553a-6417-416e-ad7d-8d20c5e91d70 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:37.935495 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-c8d132e9-faaa-4d34-9c82-39ca4ac0b601 None None] MFA Rules not processed for user `3cee106502e54829ad802ee41c9165fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:37.945888 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-c8d132e9-faaa-4d34-9c82-39ca4ac0b601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:37.973554 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:38.071951 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-c177553a-6417-416e-ad7d-8d20c5e91d70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da88a172c2f54717b7c28cc0df71d24d', 'request_id': 'req-c177553a-6417-416e-ad7d-8d20c5e91d70'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:38.093970 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-c177553a-6417-416e-ad7d-8d20c5e91d70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da88a172c2f54717b7c28cc0df71d24d', 'request_id': 'req-c177553a-6417-416e-ad7d-8d20c5e91d70'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:38.117315 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-c177553a-6417-416e-ad7d-8d20c5e91d70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da88a172c2f54717b7c28cc0df71d24d', 'request_id': 'req-c177553a-6417-416e-ad7d-8d20c5e91d70'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:38.145161 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-c177553a-6417-416e-ad7d-8d20c5e91d70 admin admin] The token cache is being invalidate because project da88a172c2f54717b7c28cc0df71d24d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:11:38.145475 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-c177553a-6417-416e-ad7d-8d20c5e91d70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:38.147741 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-c177553a-6417-416e-ad7d-8d20c5e91d70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:38.150405 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 893/1776] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:11:37 2022] DELETE /identity/v3/projects/da88a172c2f54717b7c28cc0df71d24d => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:38.151136 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177553a-6417-416e-ad7d-8d20c5e91d70 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:38.154458 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-c177553a-6417-416e-ad7d-8d20c5e91d70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:38.171919 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:38.231407 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 884/1777] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Jun 20 06:11:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:38.232366 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d132e9-faaa-4d34-9c82-39ca4ac0b601 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:38.236042 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-c8d132e9-faaa-4d34-9c82-39ca4ac0b601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:38.265327 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d132e9-faaa-4d34-9c82-39ca4ac0b601 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:38.359445 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177553a-6417-416e-ad7d-8d20c5e91d70 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:38.375827 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87ec8ba-a49a-48e2-aa48-2a73c4777bcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:38.380836 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ec8ba-a49a-48e2-aa48-2a73c4777bcb service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:38.381682 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ec8ba-a49a-48e2-aa48-2a73c4777bcb service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:38.382343 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ec8ba-a49a-48e2-aa48-2a73c4777bcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:38.389383 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-e87ec8ba-a49a-48e2-aa48-2a73c4777bcb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:38.567740 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca420bbb-70b8-4e1c-860c-c19e054c1123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:38.569258 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca420bbb-70b8-4e1c-860c-c19e054c1123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:38.569525 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca420bbb-70b8-4e1c-860c-c19e054c1123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:38.569804 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca420bbb-70b8-4e1c-860c-c19e054c1123 admin admin] PATH_INFO: `/v3/users/cbc5d2ea1653444fac98502ec9dc5395` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:38.571458 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca420bbb-70b8-4e1c-860c-c19e054c1123 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbc5d2ea1653444fac98502ec9dc5395)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:38.578767 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca420bbb-70b8-4e1c-860c-c19e054c1123 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:38.616468 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87ec8ba-a49a-48e2-aa48-2a73c4777bcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:38.619796 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87ec8ba-a49a-48e2-aa48-2a73c4777bcb service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:38.643607 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 894/1778] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:38 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:38.764413 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-ca420bbb-70b8-4e1c-860c-c19e054c1123 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbc5d2ea1653444fac98502ec9dc5395'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:38.788326 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-ca420bbb-70b8-4e1c-860c-c19e054c1123 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbc5d2ea1653444fac98502ec9dc5395'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:38.789179 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-ca420bbb-70b8-4e1c-860c-c19e054c1123 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbc5d2ea1653444fac98502ec9dc5395'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:38.790311 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-ca420bbb-70b8-4e1c-860c-c19e054c1123 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbc5d2ea1653444fac98502ec9dc5395'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:38.847022 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-ca420bbb-70b8-4e1c-860c-c19e054c1123 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbc5d2ea1653444fac98502ec9dc5395'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:38.927411 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 885/1779] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:11:38 2022] DELETE /identity/v3/users/cbc5d2ea1653444fac98502ec9dc5395 => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:40.032949 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f83f8-c047-4d71-a31a-96160ebc3500 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:40.034034 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f83f8-c047-4d71-a31a-96160ebc3500 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:40.034439 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f83f8-c047-4d71-a31a-96160ebc3500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:40.081406 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-c81f83f8-c047-4d71-a31a-96160ebc3500 None None] MFA Rules not processed for user `8c0f131484cb48d289cae1f473ec2fbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:40.082947 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-c81f83f8-c047-4d71-a31a-96160ebc3500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:40.264192 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 895/1780] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Jun 20 06:11:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:40.293501 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca420bbb-70b8-4e1c-860c-c19e054c1123 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:40.295879 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-ca420bbb-70b8-4e1c-860c-c19e054c1123 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:40.476950 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca420bbb-70b8-4e1c-860c-c19e054c1123 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:40.487101 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ecdb9b-a8a8-49a2-bba2-3b19bd1058a7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b490cf71bc468da5ea2be04239e33f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:40.488126 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecdb9b-a8a8-49a2-bba2-3b19bd1058a7 service swift] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:40.488614 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecdb9b-a8a8-49a2-bba2-3b19bd1058a7 service swift] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:40.489144 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecdb9b-a8a8-49a2-bba2-3b19bd1058a7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:40.507224 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ecdb9b-a8a8-49a2-bba2-3b19bd1058a7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:40.510001 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ecdb9b-a8a8-49a2-bba2-3b19bd1058a7 service swift] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:40.525750 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:40.537097 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 886/1781] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Jun 20 06:11:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 06:11:40.596497 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9646aa2-226b-48e6-acea-6b1a5d70fea0 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:40.597182 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9646aa2-226b-48e6-acea-6b1a5d70fea0 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:40.600779 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9646aa2-226b-48e6-acea-6b1a5d70fea0 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:40.602905 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 896/1782] 10.222.0.39 () {54 vars in 921 bytes} [Mon Jun 20 06:11:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:11:40.683481 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa7b3d5-74d9-48e4-b61d-3e87f0e02c55 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:40.684155 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa7b3d5-74d9-48e4-b61d-3e87f0e02c55 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:40.684660 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa7b3d5-74d9-48e4-b61d-3e87f0e02c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:40.726537 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-9aa7b3d5-74d9-48e4-b61d-3e87f0e02c55 None None] MFA Rules not processed for user `3cee106502e54829ad802ee41c9165fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:40.737027 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-9aa7b3d5-74d9-48e4-b61d-3e87f0e02c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:40.996380 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 887/1783] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Jun 20 06:11:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:42.163141 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9646aa2-226b-48e6-acea-6b1a5d70fea0 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:42.169785 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-b9646aa2-226b-48e6-acea-6b1a5d70fea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:42.212138 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:42.299733 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9646aa2-226b-48e6-acea-6b1a5d70fea0 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:42.307761 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde63bd3-1fe1-4884-949a-d6e4b51e60bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:42.308739 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde63bd3-1fe1-4884-949a-d6e4b51e60bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:42.309020 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde63bd3-1fe1-4884-949a-d6e4b51e60bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:42.309300 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde63bd3-1fe1-4884-949a-d6e4b51e60bf admin admin] PATH_INFO: `/v3/projects/85f77562325b4867b05676b8cdb18744` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:42.311434 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde63bd3-1fe1-4884-949a-d6e4b51e60bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=85f77562325b4867b05676b8cdb18744)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:42.313819 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde63bd3-1fe1-4884-949a-d6e4b51e60bf admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:42.362782 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa7b3d5-74d9-48e4-b61d-3e87f0e02c55 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:42.372094 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-9aa7b3d5-74d9-48e4-b61d-3e87f0e02c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:42.400465 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa7b3d5-74d9-48e4-b61d-3e87f0e02c55 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:42.410362 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-dde63bd3-1fe1-4884-949a-d6e4b51e60bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85f77562325b4867b05676b8cdb18744', 'request_id': 'req-dde63bd3-1fe1-4884-949a-d6e4b51e60bf'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:42.421884 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-dde63bd3-1fe1-4884-949a-d6e4b51e60bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85f77562325b4867b05676b8cdb18744', 'request_id': 'req-dde63bd3-1fe1-4884-949a-d6e4b51e60bf'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:42.432863 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-dde63bd3-1fe1-4884-949a-d6e4b51e60bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85f77562325b4867b05676b8cdb18744', 'request_id': 'req-dde63bd3-1fe1-4884-949a-d6e4b51e60bf'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:42.451038 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-dde63bd3-1fe1-4884-949a-d6e4b51e60bf admin admin] The token cache is being invalidate because project 85f77562325b4867b05676b8cdb18744 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:11:42.451493 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-dde63bd3-1fe1-4884-949a-d6e4b51e60bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:42.452427 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-dde63bd3-1fe1-4884-949a-d6e4b51e60bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:42.459407 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 897/1784] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:11:42 2022] DELETE /identity/v3/projects/85f77562325b4867b05676b8cdb18744 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:42.472855 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f07137-4d03-472b-8ab9-c0543d06349a None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:42.473361 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f07137-4d03-472b-8ab9-c0543d06349a None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:42.473987 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f07137-4d03-472b-8ab9-c0543d06349a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:42.498688 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-91f07137-4d03-472b-8ab9-c0543d06349a None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:42.500163 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-91f07137-4d03-472b-8ab9-c0543d06349a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:42.570274 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32eff0d-06cd-4077-bb40-7262323fb2e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cee106502e54829ad802ee41c9165fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:42.570930 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32eff0d-06cd-4077-bb40-7262323fb2e6 service nova] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:42.571219 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32eff0d-06cd-4077-bb40-7262323fb2e6 service nova] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:42.571496 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32eff0d-06cd-4077-bb40-7262323fb2e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:42.575974 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-d32eff0d-06cd-4077-bb40-7262323fb2e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:42.599159 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32eff0d-06cd-4077-bb40-7262323fb2e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:42.601460 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32eff0d-06cd-4077-bb40-7262323fb2e6 service nova] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:42.613915 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 898/1785] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:42.637967 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1dbf56-712a-418e-a78b-c12afd573c84 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:42.641043 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1dbf56-712a-418e-a78b-c12afd573c84 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:42.641372 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1dbf56-712a-418e-a78b-c12afd573c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:42.646597 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 888/1786] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:42.664580 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-1d1dbf56-712a-418e-a78b-c12afd573c84 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:42.666539 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-1d1dbf56-712a-418e-a78b-c12afd573c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:42.680587 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 899/1787] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:11:42.681336 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32eff0d-06cd-4077-bb40-7262323fb2e6 service nova] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:42.695771 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32eff0d-06cd-4077-bb40-7262323fb2e6 service nova] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:42.708493 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48def66e-7c1f-4a5e-9a8a-935817939c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:42.709204 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48def66e-7c1f-4a5e-9a8a-935817939c3a admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:42.709496 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48def66e-7c1f-4a5e-9a8a-935817939c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:42.709783 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48def66e-7c1f-4a5e-9a8a-935817939c3a admin admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:42.711032 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48def66e-7c1f-4a5e-9a8a-935817939c3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:11:42.712340 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48def66e-7c1f-4a5e-9a8a-935817939c3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:42.714567 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48def66e-7c1f-4a5e-9a8a-935817939c3a admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:42.739056 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1dbf56-712a-418e-a78b-c12afd573c84 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:42.753812 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1dbf56-712a-418e-a78b-c12afd573c84 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:42.757772 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 889/1788] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:11:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:11:42.759956 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b3e42-2b75-4f8a-951b-dc07f2cf28e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:42.760793 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b3e42-2b75-4f8a-951b-dc07f2cf28e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:42.761174 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b3e42-2b75-4f8a-951b-dc07f2cf28e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:42.761805 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b3e42-2b75-4f8a-951b-dc07f2cf28e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:42.762794 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4b3e42-2b75-4f8a-951b-dc07f2cf28e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:42.765396 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4b3e42-2b75-4f8a-951b-dc07f2cf28e6 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:42.805572 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 900/1789] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:11:42 2022] POST /identity/v3/projects => generated 377 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:42.809499 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48def66e-7c1f-4a5e-9a8a-935817939c3a admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:42.823354 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48def66e-7c1f-4a5e-9a8a-935817939c3a admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:42.964842 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a78824-9794-48fb-8551-6063fe709ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:42.965652 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a78824-9794-48fb-8551-6063fe709ccd admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:42.965947 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a78824-9794-48fb-8551-6063fe709ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:42.966224 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a78824-9794-48fb-8551-6063fe709ccd admin admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:42.966928 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a78824-9794-48fb-8551-6063fe709ccd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:42.968916 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a78824-9794-48fb-8551-6063fe709ccd admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:42.979078 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:43.013221 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 890/1790] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:11:42 2022] POST /identity/v3/users => generated 289 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:43.016840 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b3e42-2b75-4f8a-951b-dc07f2cf28e6 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:43.032159 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b3e42-2b75-4f8a-951b-dc07f2cf28e6 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:43.042272 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1a49d-4612-4e27-9c4b-05b37b91ea08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:43.045326 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a78824-9794-48fb-8551-6063fe709ccd admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:43.052946 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-b8a78824-9794-48fb-8551-6063fe709ccd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:43.054047 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1a49d-4612-4e27-9c4b-05b37b91ea08 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:43.057487 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1a49d-4612-4e27-9c4b-05b37b91ea08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:43.058791 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1a49d-4612-4e27-9c4b-05b37b91ea08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:43.058791 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c1a49d-4612-4e27-9c4b-05b37b91ea08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:43.062062 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c1a49d-4612-4e27-9c4b-05b37b91ea08 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:43.084870 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 901/1791] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:43.088369 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1a49d-4612-4e27-9c4b-05b37b91ea08 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:43.120562 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1a49d-4612-4e27-9c4b-05b37b91ea08 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:43.136981 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e04f477-58ab-49de-8162-85f4e73b08e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:43.138888 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04f477-58ab-49de-8162-85f4e73b08e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:43.159055 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04f477-58ab-49de-8162-85f4e73b08e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:43.159622 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04f477-58ab-49de-8162-85f4e73b08e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:43.161757 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e04f477-58ab-49de-8162-85f4e73b08e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:43.163962 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a78824-9794-48fb-8551-6063fe709ccd admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:43.170845 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e04f477-58ab-49de-8162-85f4e73b08e6 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:43.177263 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:43.207860 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 902/1792] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:43.208356 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf55ab9-dc4c-408d-96ef-0e4a48f27fdc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cee106502e54829ad802ee41c9165fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:43.208825 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e04f477-58ab-49de-8162-85f4e73b08e6 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:43.209674 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf55ab9-dc4c-408d-96ef-0e4a48f27fdc service nova] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:43.210055 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf55ab9-dc4c-408d-96ef-0e4a48f27fdc service nova] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:43.210434 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf55ab9-dc4c-408d-96ef-0e4a48f27fdc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:43.213133 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-9bf55ab9-dc4c-408d-96ef-0e4a48f27fdc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:43.228937 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e04f477-58ab-49de-8162-85f4e73b08e6 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:43.229703 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf55ab9-dc4c-408d-96ef-0e4a48f27fdc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:43.231697 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf55ab9-dc4c-408d-96ef-0e4a48f27fdc service nova] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:43.244214 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611896b8-ff7e-4740-b977-39633a891743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:43.245191 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611896b8-ff7e-4740-b977-39633a891743 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:43.245506 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611896b8-ff7e-4740-b977-39633a891743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:43.245880 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611896b8-ff7e-4740-b977-39633a891743 admin admin] PATH_INFO: `/v3/projects/36677c8274df4b0ba176eee7eaac2b1c/users/b3cf609d010e4b99a7f3f9115fea1673/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:43.250737 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 891/1793] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:11:43.278310 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611896b8-ff7e-4740-b977-39633a891743 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36677c8274df4b0ba176eee7eaac2b1c, user_id=b3cf609d010e4b99a7f3f9115fea1673, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:43.278310 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611896b8-ff7e-4740-b977-39633a891743 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:43.296344 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 903/1794] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:43 2022] PUT /identity/v3/projects/36677c8274df4b0ba176eee7eaac2b1c/users/b3cf609d010e4b99a7f3f9115fea1673/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:43.309006 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453264d-cc91-4916-aa4b-a916bcccdd83 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:43.309628 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453264d-cc91-4916-aa4b-a916bcccdd83 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:43.310174 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453264d-cc91-4916-aa4b-a916bcccdd83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:43.377606 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-6453264d-cc91-4916-aa4b-a916bcccdd83 None None] MFA Rules not processed for user `b3cf609d010e4b99a7f3f9115fea1673`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:43.379793 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-6453264d-cc91-4916-aa4b-a916bcccdd83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:43.554841 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611896b8-ff7e-4740-b977-39633a891743 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:43.566307 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 892/1795] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:43.663026 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611896b8-ff7e-4740-b977-39633a891743 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:43.668197 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c11359-af35-4779-9d20-dc8a0fc300be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:43.669029 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c11359-af35-4779-9d20-dc8a0fc300be admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:43.669346 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c11359-af35-4779-9d20-dc8a0fc300be admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:43.669612 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c11359-af35-4779-9d20-dc8a0fc300be admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:43.670483 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c11359-af35-4779-9d20-dc8a0fc300be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:43.672360 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c11359-af35-4779-9d20-dc8a0fc300be admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:43.706026 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 904/1796] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:11:43 2022] POST /identity/v3/projects => generated 375 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:11:43.711452 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453264d-cc91-4916-aa4b-a916bcccdd83 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:43.725323 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453264d-cc91-4916-aa4b-a916bcccdd83 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:43.799443 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e00479-8608-474c-a541-f0520c030320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:43.800510 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e00479-8608-474c-a541-f0520c030320 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:43.800922 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e00479-8608-474c-a541-f0520c030320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:43.801205 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e00479-8608-474c-a541-f0520c030320 admin admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:43.801920 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e00479-8608-474c-a541-f0520c030320 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:43.804161 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e00479-8608-474c-a541-f0520c030320 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:43.821021 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:43.832493 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c11359-af35-4779-9d20-dc8a0fc300be admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:43.832768 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 893/1797] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:11:43 2022] POST /identity/v3/users => generated 294 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:43.843044 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c11359-af35-4779-9d20-dc8a0fc300be admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:43.847774 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f91b44-7b7d-4381-baf6-766e511141c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:43.848451 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f91b44-7b7d-4381-baf6-766e511141c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:43.848764 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f91b44-7b7d-4381-baf6-766e511141c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:43.849047 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f91b44-7b7d-4381-baf6-766e511141c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:43.849782 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f91b44-7b7d-4381-baf6-766e511141c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:43.851606 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f91b44-7b7d-4381-baf6-766e511141c0 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:43.863832 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 905/1798] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:11:43.868050 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e00479-8608-474c-a541-f0520c030320 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:43.879157 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e00479-8608-474c-a541-f0520c030320 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:43.883807 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec6937-29ed-476b-8ed0-97a2e6228e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:43.884716 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec6937-29ed-476b-8ed0-97a2e6228e33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:43.885007 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec6937-29ed-476b-8ed0-97a2e6228e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:43.885285 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec6937-29ed-476b-8ed0-97a2e6228e33 admin admin] PATH_INFO: `/v3/projects/ef88a89e92554568a75d01d1bc95cc59/users/6c93bba080ac4514bd3b69323baf5acd/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:43.902039 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ec6937-29ed-476b-8ed0-97a2e6228e33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef88a89e92554568a75d01d1bc95cc59, user_id=6c93bba080ac4514bd3b69323baf5acd, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:43.904959 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ec6937-29ed-476b-8ed0-97a2e6228e33 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:43.919071 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 894/1799] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:43 2022] PUT /identity/v3/projects/ef88a89e92554568a75d01d1bc95cc59/users/6c93bba080ac4514bd3b69323baf5acd/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:43.923036 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f91b44-7b7d-4381-baf6-766e511141c0 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:43.934294 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f91b44-7b7d-4381-baf6-766e511141c0 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:43.993081 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aee711-0d5e-4405-9bd5-5e05ae841fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:43.993781 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aee711-0d5e-4405-9bd5-5e05ae841fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:43.994072 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aee711-0d5e-4405-9bd5-5e05ae841fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:43.994336 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aee711-0d5e-4405-9bd5-5e05ae841fd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:43.995731 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aee711-0d5e-4405-9bd5-5e05ae841fd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:43.997540 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aee711-0d5e-4405-9bd5-5e05ae841fd7 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:44.011190 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 906/1800] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:44.015156 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec6937-29ed-476b-8ed0-97a2e6228e33 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:44.026461 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec6937-29ed-476b-8ed0-97a2e6228e33 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:44.032270 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc887b-0169-4c61-b456-a03d77875a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:44.033477 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc887b-0169-4c61-b456-a03d77875a0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:44.033765 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc887b-0169-4c61-b456-a03d77875a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:44.034089 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc887b-0169-4c61-b456-a03d77875a0a admin admin] PATH_INFO: `/v3/projects/ef88a89e92554568a75d01d1bc95cc59/users/6c93bba080ac4514bd3b69323baf5acd/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:44.036346 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fc887b-0169-4c61-b456-a03d77875a0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef88a89e92554568a75d01d1bc95cc59, user_id=6c93bba080ac4514bd3b69323baf5acd, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:44.039012 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fc887b-0169-4c61-b456-a03d77875a0a admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:44.051120 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 895/1801] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:44 2022] PUT /identity/v3/projects/ef88a89e92554568a75d01d1bc95cc59/users/6c93bba080ac4514bd3b69323baf5acd/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:44.062133 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da9e1b-1083-424c-b1de-d2214ec9e79d None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:44.062399 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da9e1b-1083-424c-b1de-d2214ec9e79d None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:44.062968 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da9e1b-1083-424c-b1de-d2214ec9e79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:44.092176 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-73da9e1b-1083-424c-b1de-d2214ec9e79d None None] MFA Rules not processed for user `6c93bba080ac4514bd3b69323baf5acd`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:44.093446 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-73da9e1b-1083-424c-b1de-d2214ec9e79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:44.132404 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:44.187144 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 907/1802] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:44 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:44.190041 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc887b-0169-4c61-b456-a03d77875a0a admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:44.192189 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-24fc887b-0169-4c61-b456-a03d77875a0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:44.255548 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc887b-0169-4c61-b456-a03d77875a0a admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:44.259379 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ad4e8-6bf7-4cd1-b81d-56830c2bf406 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:44.260137 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ad4e8-6bf7-4cd1-b81d-56830c2bf406 service cinder] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:44.260427 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ad4e8-6bf7-4cd1-b81d-56830c2bf406 service cinder] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:44.260868 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ad4e8-6bf7-4cd1-b81d-56830c2bf406 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:44.319909 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87ad4e8-6bf7-4cd1-b81d-56830c2bf406 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:44.321396 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87ad4e8-6bf7-4cd1-b81d-56830c2bf406 service cinder] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:44.330798 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 896/1803] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:44.843004 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da9e1b-1083-424c-b1de-d2214ec9e79d None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:44.844447 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-73da9e1b-1083-424c-b1de-d2214ec9e79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:44.911637 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da9e1b-1083-424c-b1de-d2214ec9e79d None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:44.916073 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2842768b-1540-492d-a3bc-1f451b035a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:44.916974 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842768b-1540-492d-a3bc-1f451b035a69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:44.917252 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842768b-1540-492d-a3bc-1f451b035a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:44.917520 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842768b-1540-492d-a3bc-1f451b035a69 admin admin] PATH_INFO: `/v3/users/ca886001e94947abafe862c27d20d1f1` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:44.918701 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2842768b-1540-492d-a3bc-1f451b035a69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca886001e94947abafe862c27d20d1f1)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:44.920606 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2842768b-1540-492d-a3bc-1f451b035a69 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:44.968892 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-2842768b-1540-492d-a3bc-1f451b035a69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca886001e94947abafe862c27d20d1f1'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:44.979621 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-2842768b-1540-492d-a3bc-1f451b035a69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca886001e94947abafe862c27d20d1f1'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:44.988394 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-2842768b-1540-492d-a3bc-1f451b035a69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca886001e94947abafe862c27d20d1f1'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:45.004754 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-2842768b-1540-492d-a3bc-1f451b035a69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca886001e94947abafe862c27d20d1f1'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:45.005663 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-2842768b-1540-492d-a3bc-1f451b035a69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca886001e94947abafe862c27d20d1f1'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:45.011922 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 908/1804] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:11:44 2022] DELETE /identity/v3/users/ca886001e94947abafe862c27d20d1f1 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:45.016812 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d81be-65ab-4e45-9dce-6ff64e3f953a None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:45.018488 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d81be-65ab-4e45-9dce-6ff64e3f953a None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:45.018869 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d81be-65ab-4e45-9dce-6ff64e3f953a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:45.037495 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-d26d81be-65ab-4e45-9dce-6ff64e3f953a None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:45.038702 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-d26d81be-65ab-4e45-9dce-6ff64e3f953a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:45.098552 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 897/1805] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:11:45.108243 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2842768b-1540-492d-a3bc-1f451b035a69 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:45.109628 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-2842768b-1540-492d-a3bc-1f451b035a69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:45.166872 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2842768b-1540-492d-a3bc-1f451b035a69 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:45.170397 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ac773-3210-410a-bc91-a4a76dfce4e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:45.171035 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ac773-3210-410a-bc91-a4a76dfce4e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:45.171317 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ac773-3210-410a-bc91-a4a76dfce4e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:45.171592 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ac773-3210-410a-bc91-a4a76dfce4e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:45.177454 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:45.182152 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636ac773-3210-410a-bc91-a4a76dfce4e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:45.184434 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636ac773-3210-410a-bc91-a4a76dfce4e2 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:45.195146 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 909/1806] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:45.842520 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d81be-65ab-4e45-9dce-6ff64e3f953a None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:45.846346 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-d26d81be-65ab-4e45-9dce-6ff64e3f953a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:45.879071 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d81be-65ab-4e45-9dce-6ff64e3f953a None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:45.898178 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276062d8-47cd-4e26-8e38-6e074a27e499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:45.900225 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276062d8-47cd-4e26-8e38-6e074a27e499 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:45.900521 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276062d8-47cd-4e26-8e38-6e074a27e499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:45.900819 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276062d8-47cd-4e26-8e38-6e074a27e499 admin admin] PATH_INFO: `/v3/projects/2b0e6a032a114e03a1bcff4868f8f42e` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:45.905451 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276062d8-47cd-4e26-8e38-6e074a27e499 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b0e6a032a114e03a1bcff4868f8f42e)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:45.909810 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276062d8-47cd-4e26-8e38-6e074a27e499 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:45.938880 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:46.005965 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-276062d8-47cd-4e26-8e38-6e074a27e499 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b0e6a032a114e03a1bcff4868f8f42e', 'request_id': 'req-276062d8-47cd-4e26-8e38-6e074a27e499'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:46.018933 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-276062d8-47cd-4e26-8e38-6e074a27e499 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b0e6a032a114e03a1bcff4868f8f42e', 'request_id': 'req-276062d8-47cd-4e26-8e38-6e074a27e499'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:46.029957 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-276062d8-47cd-4e26-8e38-6e074a27e499 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b0e6a032a114e03a1bcff4868f8f42e', 'request_id': 'req-276062d8-47cd-4e26-8e38-6e074a27e499'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:46.044780 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-276062d8-47cd-4e26-8e38-6e074a27e499 admin admin] The token cache is being invalidate because project 2b0e6a032a114e03a1bcff4868f8f42e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:11:46.045080 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-276062d8-47cd-4e26-8e38-6e074a27e499 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:46.045955 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-276062d8-47cd-4e26-8e38-6e074a27e499 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:46.047715 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 898/1807] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:11:45 2022] DELETE /identity/v3/projects/2b0e6a032a114e03a1bcff4868f8f42e => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:46.054698 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ac773-3210-410a-bc91-a4a76dfce4e2 service neutron] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:46.067203 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ac773-3210-410a-bc91-a4a76dfce4e2 service neutron] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:46.135392 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3ba2d-5891-48d2-baac-239de8e2442f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:46.136309 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3ba2d-5891-48d2-baac-239de8e2442f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:46.136592 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3ba2d-5891-48d2-baac-239de8e2442f admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:46.136899 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3ba2d-5891-48d2-baac-239de8e2442f admin admin] PATH_INFO: `/v3/users/d3bbe19735d74b0ba7002303c8ebf589` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:46.138128 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a3ba2d-5891-48d2-baac-239de8e2442f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3bbe19735d74b0ba7002303c8ebf589)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:46.140060 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a3ba2d-5891-48d2-baac-239de8e2442f admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:46.191470 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-21a3ba2d-5891-48d2-baac-239de8e2442f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3bbe19735d74b0ba7002303c8ebf589'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:46.200235 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-21a3ba2d-5891-48d2-baac-239de8e2442f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3bbe19735d74b0ba7002303c8ebf589'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:46.208084 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-21a3ba2d-5891-48d2-baac-239de8e2442f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3bbe19735d74b0ba7002303c8ebf589'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:46.222513 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-21a3ba2d-5891-48d2-baac-239de8e2442f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3bbe19735d74b0ba7002303c8ebf589'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:46.223745 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-21a3ba2d-5891-48d2-baac-239de8e2442f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3bbe19735d74b0ba7002303c8ebf589'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:46.231676 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 910/1808] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:11:46 2022] DELETE /identity/v3/users/d3bbe19735d74b0ba7002303c8ebf589 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:46.600328 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276062d8-47cd-4e26-8e38-6e074a27e499 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:46.602162 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-276062d8-47cd-4e26-8e38-6e074a27e499 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:46.633965 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276062d8-47cd-4e26-8e38-6e074a27e499 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:46.729274 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972fa7ac-5fc7-401e-abad-53d9c9a3bb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:46.730435 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972fa7ac-5fc7-401e-abad-53d9c9a3bb75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:46.730599 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972fa7ac-5fc7-401e-abad-53d9c9a3bb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:46.730887 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972fa7ac-5fc7-401e-abad-53d9c9a3bb75 admin admin] PATH_INFO: `/v3/projects/f27fcd86e2c6437c87e9618a4fb5d076` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:46.733359 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972fa7ac-5fc7-401e-abad-53d9c9a3bb75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f27fcd86e2c6437c87e9618a4fb5d076)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:46.735826 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972fa7ac-5fc7-401e-abad-53d9c9a3bb75 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:46.812203 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-972fa7ac-5fc7-401e-abad-53d9c9a3bb75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f27fcd86e2c6437c87e9618a4fb5d076', 'request_id': 'req-972fa7ac-5fc7-401e-abad-53d9c9a3bb75'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:46.822270 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-972fa7ac-5fc7-401e-abad-53d9c9a3bb75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f27fcd86e2c6437c87e9618a4fb5d076', 'request_id': 'req-972fa7ac-5fc7-401e-abad-53d9c9a3bb75'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:46.828406 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-972fa7ac-5fc7-401e-abad-53d9c9a3bb75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f27fcd86e2c6437c87e9618a4fb5d076', 'request_id': 'req-972fa7ac-5fc7-401e-abad-53d9c9a3bb75'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:46.844119 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-972fa7ac-5fc7-401e-abad-53d9c9a3bb75 admin admin] The token cache is being invalidate because project f27fcd86e2c6437c87e9618a4fb5d076 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:11:46.844406 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-972fa7ac-5fc7-401e-abad-53d9c9a3bb75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:46.845168 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-972fa7ac-5fc7-401e-abad-53d9c9a3bb75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:11:46.847559 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 899/1809] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:11:46 2022] DELETE /identity/v3/projects/f27fcd86e2c6437c87e9618a4fb5d076 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:46.851951 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669c1e5-6f03-4f5f-897e-7890d984a6fc None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:46.852280 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669c1e5-6f03-4f5f-897e-7890d984a6fc None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:46.852556 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669c1e5-6f03-4f5f-897e-7890d984a6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:46.879188 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-7669c1e5-6f03-4f5f-897e-7890d984a6fc None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:46.880576 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-7669c1e5-6f03-4f5f-897e-7890d984a6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:46.957272 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 911/1810] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:46.965151 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee1cf9-f46d-48e0-a24e-0b79d200885b None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:46.965453 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee1cf9-f46d-48e0-a24e-0b79d200885b None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:46.965755 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee1cf9-f46d-48e0-a24e-0b79d200885b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:47.000130 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-c2ee1cf9-f46d-48e0-a24e-0b79d200885b None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:47.001948 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-c2ee1cf9-f46d-48e0-a24e-0b79d200885b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:47.011457 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 900/1811] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:47.015678 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7669c1e5-6f03-4f5f-897e-7890d984a6fc None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:47.026581 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7669c1e5-6f03-4f5f-897e-7890d984a6fc None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:47.031485 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d50f4-a088-4aed-82f2-219329ac5e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:47.032152 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d50f4-a088-4aed-82f2-219329ac5e4b admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:47.032431 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d50f4-a088-4aed-82f2-219329ac5e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:47.032936 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d50f4-a088-4aed-82f2-219329ac5e4b admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:47.033878 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d50f4-a088-4aed-82f2-219329ac5e4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:11:47.034364 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d50f4-a088-4aed-82f2-219329ac5e4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:47.035960 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d50f4-a088-4aed-82f2-219329ac5e4b admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:47.045643 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:47.053908 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 912/1812] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:11:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:11:47.056313 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee1cf9-f46d-48e0-a24e-0b79d200885b None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:47.075418 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee1cf9-f46d-48e0-a24e-0b79d200885b None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:47.083228 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b98b98-a56a-4d63-9bd5-d421e8c6d383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:47.084194 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b98b98-a56a-4d63-9bd5-d421e8c6d383 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:47.084669 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b98b98-a56a-4d63-9bd5-d421e8c6d383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:47.085147 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b98b98-a56a-4d63-9bd5-d421e8c6d383 admin admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:47.086185 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b98b98-a56a-4d63-9bd5-d421e8c6d383 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:47.091107 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b98b98-a56a-4d63-9bd5-d421e8c6d383 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:47.116272 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:47.125948 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 901/1813] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:11:47 2022] POST /identity/v3/projects => generated 373 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:47.131111 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d50f4-a088-4aed-82f2-219329ac5e4b admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:47.143887 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d50f4-a088-4aed-82f2-219329ac5e4b admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:47.203124 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919cc1c-bb13-4014-abde-bdfee86a9332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:47.203820 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919cc1c-bb13-4014-abde-bdfee86a9332 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:47.204073 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919cc1c-bb13-4014-abde-bdfee86a9332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:47.204354 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919cc1c-bb13-4014-abde-bdfee86a9332 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:47.205467 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7919cc1c-bb13-4014-abde-bdfee86a9332 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:47.207393 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7919cc1c-bb13-4014-abde-bdfee86a9332 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:47.228238 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 913/1814] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:11:47 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:11:47.232294 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b98b98-a56a-4d63-9bd5-d421e8c6d383 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:47.244805 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b98b98-a56a-4d63-9bd5-d421e8c6d383 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:47.249637 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b26d588-9ba2-4c80-becb-2660f69b32e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:47.250382 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26d588-9ba2-4c80-becb-2660f69b32e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:47.250775 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26d588-9ba2-4c80-becb-2660f69b32e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:47.251119 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26d588-9ba2-4c80-becb-2660f69b32e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:47.252490 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b26d588-9ba2-4c80-becb-2660f69b32e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:47.254178 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b26d588-9ba2-4c80-becb-2660f69b32e4 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:47.268178 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 902/1815] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:11:47.271248 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919cc1c-bb13-4014-abde-bdfee86a9332 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:47.291331 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919cc1c-bb13-4014-abde-bdfee86a9332 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:47.306411 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab7326-15e9-498e-a66b-64859c915c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:47.307214 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab7326-15e9-498e-a66b-64859c915c8f admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:47.307525 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab7326-15e9-498e-a66b-64859c915c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:47.307784 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab7326-15e9-498e-a66b-64859c915c8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:47.308611 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ab7326-15e9-498e-a66b-64859c915c8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:47.310334 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ab7326-15e9-498e-a66b-64859c915c8f admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:47.322218 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 914/1816] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:47.326635 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b26d588-9ba2-4c80-becb-2660f69b32e4 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:47.336648 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b26d588-9ba2-4c80-becb-2660f69b32e4 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:47.341413 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18050e5-7474-49d5-9352-48b7da75c45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:47.342396 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18050e5-7474-49d5-9352-48b7da75c45a admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:47.342680 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18050e5-7474-49d5-9352-48b7da75c45a admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:47.342957 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18050e5-7474-49d5-9352-48b7da75c45a admin admin] PATH_INFO: `/v3/projects/fd120b21f87143948c6b26d2ee8402e8/users/a9e4816c294744bfb309a57824121f99/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:47.362999 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18050e5-7474-49d5-9352-48b7da75c45a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd120b21f87143948c6b26d2ee8402e8, user_id=a9e4816c294744bfb309a57824121f99, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:47.366295 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18050e5-7474-49d5-9352-48b7da75c45a admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:47.394541 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd991b-ca84-4762-aa68-0679876d8dc6 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:47.395341 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd991b-ca84-4762-aa68-0679876d8dc6 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:47.395902 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd991b-ca84-4762-aa68-0679876d8dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:47.397500 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 903/1817] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:47 2022] PUT /identity/v3/projects/fd120b21f87143948c6b26d2ee8402e8/users/a9e4816c294744bfb309a57824121f99/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:47.433968 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-fcfd991b-ca84-4762-aa68-0679876d8dc6 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:47.435541 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-fcfd991b-ca84-4762-aa68-0679876d8dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:47.568609 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 915/1818] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:11:47.578434 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18050e5-7474-49d5-9352-48b7da75c45a admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:47.581238 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-f18050e5-7474-49d5-9352-48b7da75c45a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:47.702018 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18050e5-7474-49d5-9352-48b7da75c45a admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:47.705711 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b50a83-7293-4de9-9967-0328414f7b7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:47.706482 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b50a83-7293-4de9-9967-0328414f7b7e service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:47.707323 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b50a83-7293-4de9-9967-0328414f7b7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:47.707323 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b50a83-7293-4de9-9967-0328414f7b7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:47.716382 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b50a83-7293-4de9-9967-0328414f7b7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:47.717912 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b50a83-7293-4de9-9967-0328414f7b7e service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:47.728867 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 904/1819] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:48.529302 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499566c-7a29-4010-ac86-531944779a38 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:48.529302 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499566c-7a29-4010-ac86-531944779a38 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:48.529302 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499566c-7a29-4010-ac86-531944779a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:48.567504 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-f499566c-7a29-4010-ac86-531944779a38 None None] MFA Rules not processed for user `a9e4816c294744bfb309a57824121f99`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:48.568784 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-f499566c-7a29-4010-ac86-531944779a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:48.639379 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 916/1820] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:48.640535 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b50a83-7293-4de9-9967-0328414f7b7e service neutron] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:48.675419 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b50a83-7293-4de9-9967-0328414f7b7e service neutron] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:48.680850 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d12092f-88f7-4cf0-a930-b74dcef3c046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:48.681582 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12092f-88f7-4cf0-a930-b74dcef3c046 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:48.681929 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12092f-88f7-4cf0-a930-b74dcef3c046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:48.682323 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12092f-88f7-4cf0-a930-b74dcef3c046 admin admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:48.683106 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d12092f-88f7-4cf0-a930-b74dcef3c046 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:48.685113 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d12092f-88f7-4cf0-a930-b74dcef3c046 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:48.726271 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 905/1821] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:11:48 2022] POST /identity/v3/projects => generated 371 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:11:48.730243 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499566c-7a29-4010-ac86-531944779a38 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:48.742789 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499566c-7a29-4010-ac86-531944779a38 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:48.761589 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:48.843696 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7009663-6375-413f-bc3b-8d5ec012a630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:48.844490 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7009663-6375-413f-bc3b-8d5ec012a630 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:48.844807 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7009663-6375-413f-bc3b-8d5ec012a630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:48.845788 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7009663-6375-413f-bc3b-8d5ec012a630 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:48.846550 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7009663-6375-413f-bc3b-8d5ec012a630 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:48.848919 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7009663-6375-413f-bc3b-8d5ec012a630 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:48.872807 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 917/1822] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:11:48 2022] POST /identity/v3/users => generated 292 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:11:48.874084 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d12092f-88f7-4cf0-a930-b74dcef3c046 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:48.886344 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d12092f-88f7-4cf0-a930-b74dcef3c046 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:48.898693 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090b01e-a4c3-420d-bd1c-2d3085d52217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:48.899462 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090b01e-a4c3-420d-bd1c-2d3085d52217 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:48.899843 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090b01e-a4c3-420d-bd1c-2d3085d52217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:48.900027 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090b01e-a4c3-420d-bd1c-2d3085d52217 admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:48.900910 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a090b01e-a4c3-420d-bd1c-2d3085d52217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:48.902653 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a090b01e-a4c3-420d-bd1c-2d3085d52217 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:48.918084 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 906/1823] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:48.922397 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7009663-6375-413f-bc3b-8d5ec012a630 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:48.933016 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7009663-6375-413f-bc3b-8d5ec012a630 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:48.937917 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c62968-61a1-4f15-ae01-fe5142a329bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:48.941626 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c62968-61a1-4f15-ae01-fe5142a329bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:48.941914 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c62968-61a1-4f15-ae01-fe5142a329bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:48.942192 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c62968-61a1-4f15-ae01-fe5142a329bd admin admin] PATH_INFO: `/v3/projects/53be6eab48a34c05a44fa3fdaa67cf85/users/d83d10c0650a4dd7baa481d796379180/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:48.958560 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c62968-61a1-4f15-ae01-fe5142a329bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=53be6eab48a34c05a44fa3fdaa67cf85, user_id=d83d10c0650a4dd7baa481d796379180, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:48.961264 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c62968-61a1-4f15-ae01-fe5142a329bd admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:48.974134 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 918/1824] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:48 2022] PUT /identity/v3/projects/53be6eab48a34c05a44fa3fdaa67cf85/users/d83d10c0650a4dd7baa481d796379180/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:48.978035 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090b01e-a4c3-420d-bd1c-2d3085d52217 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:48.988891 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090b01e-a4c3-420d-bd1c-2d3085d52217 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:49.048500 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1591866e-62e1-4b89-9201-3377ec7a5657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:49.049273 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1591866e-62e1-4b89-9201-3377ec7a5657 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:49.049561 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1591866e-62e1-4b89-9201-3377ec7a5657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:49.049835 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1591866e-62e1-4b89-9201-3377ec7a5657 admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:49.050720 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1591866e-62e1-4b89-9201-3377ec7a5657 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:49.052343 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1591866e-62e1-4b89-9201-3377ec7a5657 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:49.062939 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 907/1825] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:11:49.067867 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c62968-61a1-4f15-ae01-fe5142a329bd admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:49.078960 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c62968-61a1-4f15-ae01-fe5142a329bd admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:49.084967 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a1b637-e176-45ee-9313-41d50e12a115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:49.085862 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1b637-e176-45ee-9313-41d50e12a115 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:49.086143 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1b637-e176-45ee-9313-41d50e12a115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:49.086419 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1b637-e176-45ee-9313-41d50e12a115 admin admin] PATH_INFO: `/v3/projects/53be6eab48a34c05a44fa3fdaa67cf85/users/d83d10c0650a4dd7baa481d796379180/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:49.088443 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a1b637-e176-45ee-9313-41d50e12a115 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53be6eab48a34c05a44fa3fdaa67cf85, user_id=d83d10c0650a4dd7baa481d796379180, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:49.091107 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a1b637-e176-45ee-9313-41d50e12a115 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:49.102401 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 919/1826] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:11:49 2022] PUT /identity/v3/projects/53be6eab48a34c05a44fa3fdaa67cf85/users/d83d10c0650a4dd7baa481d796379180/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:11:49.736968 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2346910-e2c6-44bb-8ac8-0d37ca6e8f5c None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:49.737499 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2346910-e2c6-44bb-8ac8-0d37ca6e8f5c None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:49.737595 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2346910-e2c6-44bb-8ac8-0d37ca6e8f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:49.764024 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-b2346910-e2c6-44bb-8ac8-0d37ca6e8f5c None None] MFA Rules not processed for user `d83d10c0650a4dd7baa481d796379180`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:49.765271 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-b2346910-e2c6-44bb-8ac8-0d37ca6e8f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:49.785072 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:49.854283 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 908/1827] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:11:49 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:49.866141 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a1b637-e176-45ee-9313-41d50e12a115 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:49.867994 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-60a1b637-e176-45ee-9313-41d50e12a115 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:49.941107 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a1b637-e176-45ee-9313-41d50e12a115 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:49.945394 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a2737c-7208-4222-8992-256372bf9ac2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:49.946122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2737c-7208-4222-8992-256372bf9ac2 service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:49.946401 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2737c-7208-4222-8992-256372bf9ac2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:49.946673 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2737c-7208-4222-8992-256372bf9ac2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:50.010969 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a2737c-7208-4222-8992-256372bf9ac2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:50.012426 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a2737c-7208-4222-8992-256372bf9ac2 service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:50.023667 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 920/1828] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:51.219388 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2346910-e2c6-44bb-8ac8-0d37ca6e8f5c None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:51.239843 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2346910-e2c6-44bb-8ac8-0d37ca6e8f5c None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:51.244014 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09bd38-4a5f-4ca4-a678-c37ae5b96d0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:51.244711 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09bd38-4a5f-4ca4-a678-c37ae5b96d0e service cinder] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:51.245002 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09bd38-4a5f-4ca4-a678-c37ae5b96d0e service cinder] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:51.245298 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09bd38-4a5f-4ca4-a678-c37ae5b96d0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:51.247096 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-5b09bd38-4a5f-4ca4-a678-c37ae5b96d0e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:51.313989 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09bd38-4a5f-4ca4-a678-c37ae5b96d0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:51.315427 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09bd38-4a5f-4ca4-a678-c37ae5b96d0e service cinder] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:51.325469 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 909/1829] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:51 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:51.389142 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a2737c-7208-4222-8992-256372bf9ac2 service cinder] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:51.390602 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-61a2737c-7208-4222-8992-256372bf9ac2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:51.401688 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a2737c-7208-4222-8992-256372bf9ac2 service cinder] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:51.405340 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9660fdb2-c18c-443b-9d23-f50f525d6813 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:51.405991 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660fdb2-c18c-443b-9d23-f50f525d6813 service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:51.406279 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660fdb2-c18c-443b-9d23-f50f525d6813 service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:51.406558 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660fdb2-c18c-443b-9d23-f50f525d6813 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:51.417291 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9660fdb2-c18c-443b-9d23-f50f525d6813 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:51.418712 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9660fdb2-c18c-443b-9d23-f50f525d6813 service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:51.429508 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 921/1830] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:51 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:58.578873 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0abf5a-e2c0-4f6e-b3f1-470d48538c70 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:58.579805 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0abf5a-e2c0-4f6e-b3f1-470d48538c70 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:58.580056 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0abf5a-e2c0-4f6e-b3f1-470d48538c70 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:58.581852 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 910/1831] 10.222.0.39 () {54 vars in 921 bytes} [Mon Jun 20 06:11:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:11:58.591552 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458d5fa-4f38-4102-a01c-acca694e5cd1 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:58.592047 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458d5fa-4f38-4102-a01c-acca694e5cd1 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:58.592135 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458d5fa-4f38-4102-a01c-acca694e5cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:58.599808 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:58.614745 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-9458d5fa-4f38-4102-a01c-acca694e5cd1 None None] MFA Rules not processed for user `3cee106502e54829ad802ee41c9165fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:58.615866 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-9458d5fa-4f38-4102-a01c-acca694e5cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:58.695366 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 922/1832] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Jun 20 06:11:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:58.709175 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0abf5a-e2c0-4f6e-b3f1-470d48538c70 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:58.711187 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-9f0abf5a-e2c0-4f6e-b3f1-470d48538c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:58.733000 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0abf5a-e2c0-4f6e-b3f1-470d48538c70 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:58.739350 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e12ec-7634-4b7f-9d5c-46c096035039 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cee106502e54829ad802ee41c9165fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:58.739999 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e12ec-7634-4b7f-9d5c-46c096035039 service nova] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:58.740285 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e12ec-7634-4b7f-9d5c-46c096035039 service nova] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:58.740565 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e12ec-7634-4b7f-9d5c-46c096035039 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:58.749847 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26e12ec-7634-4b7f-9d5c-46c096035039 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:58.751504 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26e12ec-7634-4b7f-9d5c-46c096035039 service nova] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:58.762528 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 911/1833] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:12:08.684786 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=30 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:08.758070 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=56 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:22.463244 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687b971-3172-4808-8898-0640da1e58c9 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:22.463733 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687b971-3172-4808-8898-0640da1e58c9 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:22.463841 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687b971-3172-4808-8898-0640da1e58c9 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:22.465231 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 923/1834] 10.222.0.39 () {54 vars in 921 bytes} [Mon Jun 20 06:12:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:12:22.487870 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316006bb-046a-4310-99d2-47202d180d2d None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:22.488326 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316006bb-046a-4310-99d2-47202d180d2d None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:22.488441 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316006bb-046a-4310-99d2-47202d180d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:22.507273 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-316006bb-046a-4310-99d2-47202d180d2d None None] MFA Rules not processed for user `6f0f9248178049cda6571fa365a21225`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:22.508558 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-316006bb-046a-4310-99d2-47202d180d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:22.596731 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 912/1835] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Jun 20 06:12:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:12:22.607959 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6687b971-3172-4808-8898-0640da1e58c9 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:22.609687 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-6687b971-3172-4808-8898-0640da1e58c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:22.637971 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6687b971-3172-4808-8898-0640da1e58c9 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:22.645309 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca11ffe-044b-4b9a-a89a-70f0d39d2d58 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f0f9248178049cda6571fa365a21225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:22.646718 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca11ffe-044b-4b9a-a89a-70f0d39d2d58 service placement] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:22.647161 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca11ffe-044b-4b9a-a89a-70f0d39d2d58 service placement] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:22.647588 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca11ffe-044b-4b9a-a89a-70f0d39d2d58 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:22.658289 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca11ffe-044b-4b9a-a89a-70f0d39d2d58 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:22.660068 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca11ffe-044b-4b9a-a89a-70f0d39d2d58 service placement] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:22.682305 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 924/1836] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:12:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:12:23.238192 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f00a1-4ae9-4761-be16-e703a394dfa3 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:23.238486 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f00a1-4ae9-4761-be16-e703a394dfa3 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:23.238764 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f00a1-4ae9-4761-be16-e703a394dfa3 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:23.240336 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 913/1837] 10.222.0.39 () {54 vars in 921 bytes} [Mon Jun 20 06:12:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:12:23.250315 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1a3a0-d0c3-407c-8e56-8f86de181d29 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:23.250844 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1a3a0-d0c3-407c-8e56-8f86de181d29 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:23.251121 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1a3a0-d0c3-407c-8e56-8f86de181d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:23.269869 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-b7e1a3a0-d0c3-407c-8e56-8f86de181d29 None None] MFA Rules not processed for user `6f0f9248178049cda6571fa365a21225`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:23.271085 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-b7e1a3a0-d0c3-407c-8e56-8f86de181d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:23.279817 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 925/1838] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Jun 20 06:12:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:23.302077 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f00a1-4ae9-4761-be16-e703a394dfa3 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:23.316336 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f00a1-4ae9-4761-be16-e703a394dfa3 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:23.321680 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dfeeae-1e41-4df0-832d-dde29647eae9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f0f9248178049cda6571fa365a21225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:23.322443 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfeeae-1e41-4df0-832d-dde29647eae9 service placement] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:23.322832 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfeeae-1e41-4df0-832d-dde29647eae9 service placement] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:23.323210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfeeae-1e41-4df0-832d-dde29647eae9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:23.333639 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dfeeae-1e41-4df0-832d-dde29647eae9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:23.335321 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dfeeae-1e41-4df0-832d-dde29647eae9 service placement] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:23.337296 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1a3a0-d0c3-407c-8e56-8f86de181d29 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:23.351275 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 914/1839] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:12:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:12:23.408503 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1a3a0-d0c3-407c-8e56-8f86de181d29 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:23.413139 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8778bd9-61fc-46eb-b049-d5ca63cdfc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:23.414009 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8778bd9-61fc-46eb-b049-d5ca63cdfc79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:23.414296 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8778bd9-61fc-46eb-b049-d5ca63cdfc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:23.414574 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8778bd9-61fc-46eb-b049-d5ca63cdfc79 admin admin] PATH_INFO: `/v3/users/a9e4816c294744bfb309a57824121f99` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:23.415786 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8778bd9-61fc-46eb-b049-d5ca63cdfc79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9e4816c294744bfb309a57824121f99)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:23.417755 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8778bd9-61fc-46eb-b049-d5ca63cdfc79 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:23.464662 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-b8778bd9-61fc-46eb-b049-d5ca63cdfc79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9e4816c294744bfb309a57824121f99'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:23.471263 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-b8778bd9-61fc-46eb-b049-d5ca63cdfc79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9e4816c294744bfb309a57824121f99'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:23.478023 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-b8778bd9-61fc-46eb-b049-d5ca63cdfc79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9e4816c294744bfb309a57824121f99'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:23.490610 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-b8778bd9-61fc-46eb-b049-d5ca63cdfc79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9e4816c294744bfb309a57824121f99'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:23.491272 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-b8778bd9-61fc-46eb-b049-d5ca63cdfc79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9e4816c294744bfb309a57824121f99'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:23.497160 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 926/1840] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:12:23 2022] DELETE /identity/v3/users/a9e4816c294744bfb309a57824121f99 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:23.680116 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dfeeae-1e41-4df0-832d-dde29647eae9 service placement] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:23.696024 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dfeeae-1e41-4df0-832d-dde29647eae9 service placement] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:23.767832 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d837c8-fe9e-40a8-ada0-856d46ae1a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:23.768733 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d837c8-fe9e-40a8-ada0-856d46ae1a46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:23.774859 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d837c8-fe9e-40a8-ada0-856d46ae1a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:23.775190 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d837c8-fe9e-40a8-ada0-856d46ae1a46 admin admin] PATH_INFO: `/v3/projects/fd120b21f87143948c6b26d2ee8402e8` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:23.776941 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d837c8-fe9e-40a8-ada0-856d46ae1a46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd120b21f87143948c6b26d2ee8402e8)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:23.779518 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d837c8-fe9e-40a8-ada0-856d46ae1a46 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:23.849662 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-b8d837c8-fe9e-40a8-ada0-856d46ae1a46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd120b21f87143948c6b26d2ee8402e8', 'request_id': 'req-b8d837c8-fe9e-40a8-ada0-856d46ae1a46'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:23.858775 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-b8d837c8-fe9e-40a8-ada0-856d46ae1a46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd120b21f87143948c6b26d2ee8402e8', 'request_id': 'req-b8d837c8-fe9e-40a8-ada0-856d46ae1a46'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:23.867318 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-b8d837c8-fe9e-40a8-ada0-856d46ae1a46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd120b21f87143948c6b26d2ee8402e8', 'request_id': 'req-b8d837c8-fe9e-40a8-ada0-856d46ae1a46'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:23.879762 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-b8d837c8-fe9e-40a8-ada0-856d46ae1a46 admin admin] The token cache is being invalidate because project fd120b21f87143948c6b26d2ee8402e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:12:23.880105 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-b8d837c8-fe9e-40a8-ada0-856d46ae1a46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:23.880865 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-b8d837c8-fe9e-40a8-ada0-856d46ae1a46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:23.882743 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 915/1841] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:12:23 2022] DELETE /identity/v3/projects/fd120b21f87143948c6b26d2ee8402e8 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:23.886559 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8778bd9-61fc-46eb-b049-d5ca63cdfc79 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:23.888188 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-b8778bd9-61fc-46eb-b049-d5ca63cdfc79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:23.897881 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d837c8-fe9e-40a8-ada0-856d46ae1a46 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:23.900926 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-b8d837c8-fe9e-40a8-ada0-856d46ae1a46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:23.907145 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8778bd9-61fc-46eb-b049-d5ca63cdfc79 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:23.921171 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:24.020957 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68da4b-bae3-4614-a1bd-ebf2e6c46f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:24.028492 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d837c8-fe9e-40a8-ada0-856d46ae1a46 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:24.034436 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2806f40b-1810-4789-b559-b0a73c94b8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:24.035446 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2806f40b-1810-4789-b559-b0a73c94b8be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:24.035599 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68da4b-bae3-4614-a1bd-ebf2e6c46f8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:24.035818 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68da4b-bae3-4614-a1bd-ebf2e6c46f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:24.035922 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2806f40b-1810-4789-b559-b0a73c94b8be admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:24.036110 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68da4b-bae3-4614-a1bd-ebf2e6c46f8b admin admin] PATH_INFO: `/v3/users/d83d10c0650a4dd7baa481d796379180` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:24.036210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2806f40b-1810-4789-b559-b0a73c94b8be admin admin] PATH_INFO: `/v3/users/b3cf609d010e4b99a7f3f9115fea1673` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:24.037612 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d68da4b-bae3-4614-a1bd-ebf2e6c46f8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d83d10c0650a4dd7baa481d796379180)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:24.037828 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2806f40b-1810-4789-b559-b0a73c94b8be admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3cf609d010e4b99a7f3f9115fea1673)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:24.039870 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2806f40b-1810-4789-b559-b0a73c94b8be admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:24.041496 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d68da4b-bae3-4614-a1bd-ebf2e6c46f8b admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:24.044222 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:24.104977 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-2806f40b-1810-4789-b559-b0a73c94b8be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3cf609d010e4b99a7f3f9115fea1673'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:24.110783 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-2d68da4b-bae3-4614-a1bd-ebf2e6c46f8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd83d10c0650a4dd7baa481d796379180'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:24.115853 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-2806f40b-1810-4789-b559-b0a73c94b8be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3cf609d010e4b99a7f3f9115fea1673'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:24.116737 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-2806f40b-1810-4789-b559-b0a73c94b8be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3cf609d010e4b99a7f3f9115fea1673'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:24.117616 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-2806f40b-1810-4789-b559-b0a73c94b8be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3cf609d010e4b99a7f3f9115fea1673'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:24.120964 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-2d68da4b-bae3-4614-a1bd-ebf2e6c46f8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd83d10c0650a4dd7baa481d796379180'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:24.132206 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-2d68da4b-bae3-4614-a1bd-ebf2e6c46f8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd83d10c0650a4dd7baa481d796379180'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:24.135719 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-2806f40b-1810-4789-b559-b0a73c94b8be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3cf609d010e4b99a7f3f9115fea1673'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:24.146550 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-2d68da4b-bae3-4614-a1bd-ebf2e6c46f8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd83d10c0650a4dd7baa481d796379180'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:24.147614 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-2d68da4b-bae3-4614-a1bd-ebf2e6c46f8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd83d10c0650a4dd7baa481d796379180'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:24.151595 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 916/1842] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:12:23 2022] DELETE /identity/v3/users/b3cf609d010e4b99a7f3f9115fea1673 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:24.156304 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6c62a-0bc1-4dc7-88bb-6dc12f779e58 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:24.157218 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6c62a-0bc1-4dc7-88bb-6dc12f779e58 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:24.157868 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 927/1843] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:12:23 2022] DELETE /identity/v3/users/d83d10c0650a4dd7baa481d796379180 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:12:24.158069 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6c62a-0bc1-4dc7-88bb-6dc12f779e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:24.180119 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-57b6c62a-0bc1-4dc7-88bb-6dc12f779e58 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:24.181381 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-57b6c62a-0bc1-4dc7-88bb-6dc12f779e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:24.276212 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 917/1844] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:12:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:24.286920 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68da4b-bae3-4614-a1bd-ebf2e6c46f8b admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:24.288867 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-2d68da4b-bae3-4614-a1bd-ebf2e6c46f8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:24.347537 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68da4b-bae3-4614-a1bd-ebf2e6c46f8b admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:24.351338 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d5801-5c3a-4380-9e7f-7a11934535f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:24.352019 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d5801-5c3a-4380-9e7f-7a11934535f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:24.352301 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d5801-5c3a-4380-9e7f-7a11934535f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:24.352585 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d5801-5c3a-4380-9e7f-7a11934535f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:24.363899 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9d5801-5c3a-4380-9e7f-7a11934535f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:24.365376 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9d5801-5c3a-4380-9e7f-7a11934535f8 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:24.376480 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 928/1845] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:12:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:12:24.702350 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6c62a-0bc1-4dc7-88bb-6dc12f779e58 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:24.704591 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-57b6c62a-0bc1-4dc7-88bb-6dc12f779e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:24.722602 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6c62a-0bc1-4dc7-88bb-6dc12f779e58 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:24.729304 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea75c8-2836-42c4-a7e0-142ebe4c964e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:24.730335 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea75c8-2836-42c4-a7e0-142ebe4c964e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:24.730529 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea75c8-2836-42c4-a7e0-142ebe4c964e admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:24.730863 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea75c8-2836-42c4-a7e0-142ebe4c964e admin admin] PATH_INFO: `/v3/projects/36677c8274df4b0ba176eee7eaac2b1c` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:24.732339 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eea75c8-2836-42c4-a7e0-142ebe4c964e admin admin] RBAC: Authorizing `identity:delete_project(project_id=36677c8274df4b0ba176eee7eaac2b1c)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:24.734440 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eea75c8-2836-42c4-a7e0-142ebe4c964e admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:24.787863 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:24.831180 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-5eea75c8-2836-42c4-a7e0-142ebe4c964e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36677c8274df4b0ba176eee7eaac2b1c', 'request_id': 'req-5eea75c8-2836-42c4-a7e0-142ebe4c964e'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:24.831537 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d5801-5c3a-4380-9e7f-7a11934535f8 service neutron] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:24.833110 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-8f9d5801-5c3a-4380-9e7f-7a11934535f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:24.848204 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-5eea75c8-2836-42c4-a7e0-142ebe4c964e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36677c8274df4b0ba176eee7eaac2b1c', 'request_id': 'req-5eea75c8-2836-42c4-a7e0-142ebe4c964e'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:24.857421 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d5801-5c3a-4380-9e7f-7a11934535f8 service neutron] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:24.864258 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-5eea75c8-2836-42c4-a7e0-142ebe4c964e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36677c8274df4b0ba176eee7eaac2b1c', 'request_id': 'req-5eea75c8-2836-42c4-a7e0-142ebe4c964e'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:24.886145 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-5eea75c8-2836-42c4-a7e0-142ebe4c964e admin admin] The token cache is being invalidate because project 36677c8274df4b0ba176eee7eaac2b1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:12:24.886444 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-5eea75c8-2836-42c4-a7e0-142ebe4c964e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:24.887427 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-5eea75c8-2836-42c4-a7e0-142ebe4c964e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:24.903942 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 918/1846] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:12:24 2022] DELETE /identity/v3/projects/36677c8274df4b0ba176eee7eaac2b1c => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:24.905040 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea75c8-2836-42c4-a7e0-142ebe4c964e admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:24.906470 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-5eea75c8-2836-42c4-a7e0-142ebe4c964e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:24.941102 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4071cb-4c8e-48b2-870e-1ee376b5185b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:24.942160 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4071cb-4c8e-48b2-870e-1ee376b5185b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:24.942706 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4071cb-4c8e-48b2-870e-1ee376b5185b admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:24.943095 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4071cb-4c8e-48b2-870e-1ee376b5185b admin admin] PATH_INFO: `/v3/projects/53be6eab48a34c05a44fa3fdaa67cf85` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:24.944449 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4071cb-4c8e-48b2-870e-1ee376b5185b admin admin] RBAC: Authorizing `identity:delete_project(project_id=53be6eab48a34c05a44fa3fdaa67cf85)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:24.946499 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4071cb-4c8e-48b2-870e-1ee376b5185b admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:24.987178 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:25.023461 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea75c8-2836-42c4-a7e0-142ebe4c964e admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:25.031060 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-1e4071cb-4c8e-48b2-870e-1ee376b5185b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53be6eab48a34c05a44fa3fdaa67cf85', 'request_id': 'req-1e4071cb-4c8e-48b2-870e-1ee376b5185b'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:25.050446 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-1e4071cb-4c8e-48b2-870e-1ee376b5185b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53be6eab48a34c05a44fa3fdaa67cf85', 'request_id': 'req-1e4071cb-4c8e-48b2-870e-1ee376b5185b'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:25.067501 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-1e4071cb-4c8e-48b2-870e-1ee376b5185b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53be6eab48a34c05a44fa3fdaa67cf85', 'request_id': 'req-1e4071cb-4c8e-48b2-870e-1ee376b5185b'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:25.090416 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-1e4071cb-4c8e-48b2-870e-1ee376b5185b admin admin] The token cache is being invalidate because project 53be6eab48a34c05a44fa3fdaa67cf85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:12:25.090942 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-1e4071cb-4c8e-48b2-870e-1ee376b5185b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:25.098493 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-1e4071cb-4c8e-48b2-870e-1ee376b5185b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:25.100182 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 929/1847] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:12:24 2022] DELETE /identity/v3/projects/53be6eab48a34c05a44fa3fdaa67cf85 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:25.104834 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ff290-774d-487f-9305-e1380f6a8c2d None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:25.105118 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ff290-774d-487f-9305-e1380f6a8c2d None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:25.105994 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ff290-774d-487f-9305-e1380f6a8c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:25.130364 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-540ff290-774d-487f-9305-e1380f6a8c2d None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:25.131851 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-540ff290-774d-487f-9305-e1380f6a8c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:25.135727 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470eed32-7062-4405-a1b7-c15d0e83a503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:25.136616 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470eed32-7062-4405-a1b7-c15d0e83a503 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:25.136935 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470eed32-7062-4405-a1b7-c15d0e83a503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:25.137227 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470eed32-7062-4405-a1b7-c15d0e83a503 admin admin] PATH_INFO: `/v3/users/6c93bba080ac4514bd3b69323baf5acd` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:25.138503 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470eed32-7062-4405-a1b7-c15d0e83a503 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c93bba080ac4514bd3b69323baf5acd)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:25.140794 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470eed32-7062-4405-a1b7-c15d0e83a503 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:25.140928 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 930/1848] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:12:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:12:25.149757 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e6463-3c36-481b-8f9c-ad51cdb56a6b None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:25.150045 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e6463-3c36-481b-8f9c-ad51cdb56a6b None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:25.150318 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e6463-3c36-481b-8f9c-ad51cdb56a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:25.176046 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-be8e6463-3c36-481b-8f9c-ad51cdb56a6b None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:25.177449 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-be8e6463-3c36-481b-8f9c-ad51cdb56a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:25.187177 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 931/1849] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:12:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:12:25.191582 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e6463-3c36-481b-8f9c-ad51cdb56a6b None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:25.201366 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e6463-3c36-481b-8f9c-ad51cdb56a6b None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:25.206125 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-470eed32-7062-4405-a1b7-c15d0e83a503 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c93bba080ac4514bd3b69323baf5acd'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:25.209865 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff842a0-b410-4824-b04d-67e9af2bb151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:25.210539 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff842a0-b410-4824-b04d-67e9af2bb151 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:25.210829 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff842a0-b410-4824-b04d-67e9af2bb151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:25.211858 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff842a0-b410-4824-b04d-67e9af2bb151 admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:25.212810 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff842a0-b410-4824-b04d-67e9af2bb151 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:12:25.213103 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff842a0-b410-4824-b04d-67e9af2bb151 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:25.214849 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff842a0-b410-4824-b04d-67e9af2bb151 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:25.216838 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-470eed32-7062-4405-a1b7-c15d0e83a503 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c93bba080ac4514bd3b69323baf5acd'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:25.218092 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-470eed32-7062-4405-a1b7-c15d0e83a503 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c93bba080ac4514bd3b69323baf5acd'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:25.218699 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-470eed32-7062-4405-a1b7-c15d0e83a503 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c93bba080ac4514bd3b69323baf5acd'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:25.231068 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:25.233839 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 932/1850] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:12:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:12:25.234928 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff842a0-b410-4824-b04d-67e9af2bb151 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:25.237488 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-fff842a0-b410-4824-b04d-67e9af2bb151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:25.251359 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff842a0-b410-4824-b04d-67e9af2bb151 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:25.255629 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-470eed32-7062-4405-a1b7-c15d0e83a503 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c93bba080ac4514bd3b69323baf5acd'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:25.257829 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c5c698-e65d-4ee2-8342-f702a1436f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:25.258356 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5c698-e65d-4ee2-8342-f702a1436f22 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:25.258649 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5c698-e65d-4ee2-8342-f702a1436f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:25.259046 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5c698-e65d-4ee2-8342-f702a1436f22 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:25.259762 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c5c698-e65d-4ee2-8342-f702a1436f22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:25.261794 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c5c698-e65d-4ee2-8342-f702a1436f22 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:25.300671 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 933/1851] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:12:25 2022] POST /identity/v3/projects => generated 385 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:12:25.305038 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c5c698-e65d-4ee2-8342-f702a1436f22 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:25.331785 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 919/1852] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:12:24 2022] DELETE /identity/v3/users/6c93bba080ac4514bd3b69323baf5acd => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:25.468109 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c5c698-e65d-4ee2-8342-f702a1436f22 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:25.563715 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed9fbb-83e7-46e9-af95-6126f7621c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:25.565022 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed9fbb-83e7-46e9-af95-6126f7621c7c admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:25.565311 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed9fbb-83e7-46e9-af95-6126f7621c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:25.565590 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed9fbb-83e7-46e9-af95-6126f7621c7c admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:25.566299 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ed9fbb-83e7-46e9-af95-6126f7621c7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:25.586129 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ed9fbb-83e7-46e9-af95-6126f7621c7c admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:25.608594 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:25.617161 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 934/1853] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:12:25 2022] POST /identity/v3/users => generated 293 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:12:25.620999 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470eed32-7062-4405-a1b7-c15d0e83a503 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:25.633414 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470eed32-7062-4405-a1b7-c15d0e83a503 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:25.638646 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edd991e-ce85-49e3-aa42-1e8e5664de45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:25.639342 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd991e-ce85-49e3-aa42-1e8e5664de45 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:25.639622 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd991e-ce85-49e3-aa42-1e8e5664de45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:25.639897 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd991e-ce85-49e3-aa42-1e8e5664de45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:25.640627 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edd991e-ce85-49e3-aa42-1e8e5664de45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:25.642811 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edd991e-ce85-49e3-aa42-1e8e5664de45 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:25.653659 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 920/1854] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:12:25.657700 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed9fbb-83e7-46e9-af95-6126f7621c7c admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:25.668142 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed9fbb-83e7-46e9-af95-6126f7621c7c admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:25.672639 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b627f6bf-dfd8-4651-877f-7efe4f92897e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:25.673888 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627f6bf-dfd8-4651-877f-7efe4f92897e admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:25.674236 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627f6bf-dfd8-4651-877f-7efe4f92897e admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:25.674591 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627f6bf-dfd8-4651-877f-7efe4f92897e admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:25.675434 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b627f6bf-dfd8-4651-877f-7efe4f92897e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:25.677065 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b627f6bf-dfd8-4651-877f-7efe4f92897e admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:25.687223 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 935/1855] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:12:25.692312 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edd991e-ce85-49e3-aa42-1e8e5664de45 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:25.702683 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edd991e-ce85-49e3-aa42-1e8e5664de45 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:25.707920 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc68b64d-0fab-4d9a-86cd-36b91ee2d915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:25.708977 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc68b64d-0fab-4d9a-86cd-36b91ee2d915 admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:25.709336 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc68b64d-0fab-4d9a-86cd-36b91ee2d915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:25.709743 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc68b64d-0fab-4d9a-86cd-36b91ee2d915 admin admin] PATH_INFO: `/v3/projects/9b5a834051c542c489686440ce130105/users/325a546cfbe745b4b062f0cb20f08a6b/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:25.713124 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b627f6bf-dfd8-4651-877f-7efe4f92897e admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:25.714970 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-b627f6bf-dfd8-4651-877f-7efe4f92897e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:25.727997 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc68b64d-0fab-4d9a-86cd-36b91ee2d915 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b5a834051c542c489686440ce130105, user_id=325a546cfbe745b4b062f0cb20f08a6b, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:25.728385 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b627f6bf-dfd8-4651-877f-7efe4f92897e admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:25.730913 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc68b64d-0fab-4d9a-86cd-36b91ee2d915 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:25.733257 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f808ef6-5e46-4831-9658-9116eb53dfb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:25.734347 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f808ef6-5e46-4831-9658-9116eb53dfb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:25.735330 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f808ef6-5e46-4831-9658-9116eb53dfb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:25.736336 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f808ef6-5e46-4831-9658-9116eb53dfb3 admin admin] PATH_INFO: `/v3/projects/ef88a89e92554568a75d01d1bc95cc59` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:25.738586 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f808ef6-5e46-4831-9658-9116eb53dfb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef88a89e92554568a75d01d1bc95cc59)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:25.741056 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f808ef6-5e46-4831-9658-9116eb53dfb3 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:25.748626 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 921/1856] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:12:25 2022] PUT /identity/v3/projects/9b5a834051c542c489686440ce130105/users/325a546cfbe745b4b062f0cb20f08a6b/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:25.760256 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54548172-403d-417c-9ab6-2788c533e6da None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:25.760561 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54548172-403d-417c-9ab6-2788c533e6da None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:25.760878 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54548172-403d-417c-9ab6-2788c533e6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:25.788556 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-54548172-403d-417c-9ab6-2788c533e6da None None] MFA Rules not processed for user `325a546cfbe745b4b062f0cb20f08a6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:25.789855 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-54548172-403d-417c-9ab6-2788c533e6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:25.792214 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-3f808ef6-5e46-4831-9658-9116eb53dfb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef88a89e92554568a75d01d1bc95cc59', 'request_id': 'req-3f808ef6-5e46-4831-9658-9116eb53dfb3'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:25.797765 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-3f808ef6-5e46-4831-9658-9116eb53dfb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef88a89e92554568a75d01d1bc95cc59', 'request_id': 'req-3f808ef6-5e46-4831-9658-9116eb53dfb3'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:25.806010 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-3f808ef6-5e46-4831-9658-9116eb53dfb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef88a89e92554568a75d01d1bc95cc59', 'request_id': 'req-3f808ef6-5e46-4831-9658-9116eb53dfb3'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:25.818326 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-3f808ef6-5e46-4831-9658-9116eb53dfb3 admin admin] The token cache is being invalidate because project ef88a89e92554568a75d01d1bc95cc59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:12:25.818643 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-3f808ef6-5e46-4831-9658-9116eb53dfb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:25.819304 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-3f808ef6-5e46-4831-9658-9116eb53dfb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:25.820909 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 936/1857] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:12:25 2022] DELETE /identity/v3/projects/ef88a89e92554568a75d01d1bc95cc59 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:12:25.825785 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd1c3c-e9f6-4cf2-8e85-7a36369aba7f None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:25.826074 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd1c3c-e9f6-4cf2-8e85-7a36369aba7f None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:25.826353 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd1c3c-e9f6-4cf2-8e85-7a36369aba7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:25.844566 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-ddcd1c3c-e9f6-4cf2-8e85-7a36369aba7f None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:25.847387 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-ddcd1c3c-e9f6-4cf2-8e85-7a36369aba7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:25.860116 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 922/1858] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:12:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:12:25.865747 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54548172-403d-417c-9ab6-2788c533e6da None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:25.867074 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-54548172-403d-417c-9ab6-2788c533e6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:25.930829 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 937/1859] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:12:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:12:25.939880 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8827554-78c6-4471-b0aa-4bf85af54c8a None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:25.940315 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8827554-78c6-4471-b0aa-4bf85af54c8a None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:25.940601 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8827554-78c6-4471-b0aa-4bf85af54c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:25.942841 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54548172-403d-417c-9ab6-2788c533e6da None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:25.947788 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98222bf2-ad91-4ee1-8829-32f55722761a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:25.948463 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98222bf2-ad91-4ee1-8829-32f55722761a admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:25.948792 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98222bf2-ad91-4ee1-8829-32f55722761a admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:25.949082 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98222bf2-ad91-4ee1-8829-32f55722761a admin admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:25.949783 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98222bf2-ad91-4ee1-8829-32f55722761a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:25.951701 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98222bf2-ad91-4ee1-8829-32f55722761a admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:25.960059 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-a8827554-78c6-4471-b0aa-4bf85af54c8a None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:25.961710 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-a8827554-78c6-4471-b0aa-4bf85af54c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:25.971533 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 938/1860] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:12:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:25.978137 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8827554-78c6-4471-b0aa-4bf85af54c8a None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:25.984875 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 923/1861] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:12:25 2022] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:12:25.987183 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98222bf2-ad91-4ee1-8829-32f55722761a admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:25.988628 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8827554-78c6-4471-b0aa-4bf85af54c8a None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:26.019439 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:26.059404 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98222bf2-ad91-4ee1-8829-32f55722761a admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:26.064572 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b0646-4911-4b65-b64d-67e22924d6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:26.065278 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b0646-4911-4b65-b64d-67e22924d6ef admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:26.065658 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b0646-4911-4b65-b64d-67e22924d6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:26.066011 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b0646-4911-4b65-b64d-67e22924d6ef admin admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:26.066914 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5b0646-4911-4b65-b64d-67e22924d6ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:26.067750 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce892c8-df20-4940-a988-2a35b8d1cb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:26.068415 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce892c8-df20-4940-a988-2a35b8d1cb0b admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:26.068727 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce892c8-df20-4940-a988-2a35b8d1cb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:26.068996 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce892c8-df20-4940-a988-2a35b8d1cb0b admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:26.069092 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5b0646-4911-4b65-b64d-67e22924d6ef admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:26.069721 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce892c8-df20-4940-a988-2a35b8d1cb0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:12:26.070025 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce892c8-df20-4940-a988-2a35b8d1cb0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:26.071604 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce892c8-df20-4940-a988-2a35b8d1cb0b admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:26.080615 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:26.088751 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 939/1862] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:12:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:12:26.102213 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 924/1863] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:12:25 2022] POST /identity/v3/users => generated 298 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:12:26.102406 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce892c8-df20-4940-a988-2a35b8d1cb0b admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:26.103331 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b0646-4911-4b65-b64d-67e22924d6ef admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:26.112468 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce892c8-df20-4940-a988-2a35b8d1cb0b admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:26.115509 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b0646-4911-4b65-b64d-67e22924d6ef admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:26.117309 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea78fc0b-323a-4740-a909-820f68abec6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:26.117977 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78fc0b-323a-4740-a909-820f68abec6e admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:26.118264 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78fc0b-323a-4740-a909-820f68abec6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:26.118544 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78fc0b-323a-4740-a909-820f68abec6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:26.119272 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea78fc0b-323a-4740-a909-820f68abec6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:26.120524 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1fdc41-61e1-4afa-889e-f99ff2920818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:26.121431 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fdc41-61e1-4afa-889e-f99ff2920818 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:26.121528 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea78fc0b-323a-4740-a909-820f68abec6e admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:26.121791 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fdc41-61e1-4afa-889e-f99ff2920818 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:26.122143 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fdc41-61e1-4afa-889e-f99ff2920818 admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:26.122959 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1fdc41-61e1-4afa-889e-f99ff2920818 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:26.124553 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1fdc41-61e1-4afa-889e-f99ff2920818 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:26.136500 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 925/1864] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:12:26.140645 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1fdc41-61e1-4afa-889e-f99ff2920818 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:26.152806 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 940/1865] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:12:26 2022] POST /identity/v3/projects => generated 389 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:12:26.152997 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1fdc41-61e1-4afa-889e-f99ff2920818 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:26.155817 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea78fc0b-323a-4740-a909-820f68abec6e admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:26.218014 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b728ae-37aa-4cab-9959-83fbdc8a0c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:26.218965 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b728ae-37aa-4cab-9959-83fbdc8a0c3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:26.219267 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b728ae-37aa-4cab-9959-83fbdc8a0c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:26.219539 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b728ae-37aa-4cab-9959-83fbdc8a0c3a admin admin] PATH_INFO: `/v3/projects/8b26a8575f854d7b951937f1af969434/users/2012e0d4c4444fedac7aa9a7dd2c2c45/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:26.225488 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea78fc0b-323a-4740-a909-820f68abec6e admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:26.231194 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fe1ae-50b9-4bb2-96a0-b7d09566bef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:26.231852 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fe1ae-50b9-4bb2-96a0-b7d09566bef5 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:26.232134 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fe1ae-50b9-4bb2-96a0-b7d09566bef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:26.232405 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fe1ae-50b9-4bb2-96a0-b7d09566bef5 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:26.233130 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8fe1ae-50b9-4bb2-96a0-b7d09566bef5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:26.235036 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8fe1ae-50b9-4bb2-96a0-b7d09566bef5 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:26.237036 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b728ae-37aa-4cab-9959-83fbdc8a0c3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b26a8575f854d7b951937f1af969434, user_id=2012e0d4c4444fedac7aa9a7dd2c2c45, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:26.239713 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b728ae-37aa-4cab-9959-83fbdc8a0c3a admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:26.256648 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 926/1866] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:12:26 2022] PUT /identity/v3/projects/8b26a8575f854d7b951937f1af969434/users/2012e0d4c4444fedac7aa9a7dd2c2c45/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:12:26.260840 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 941/1867] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:12:26 2022] POST /identity/v3/users => generated 295 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:12:26.260995 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b728ae-37aa-4cab-9959-83fbdc8a0c3a admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:26.263102 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fe1ae-50b9-4bb2-96a0-b7d09566bef5 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:26.281606 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fe1ae-50b9-4bb2-96a0-b7d09566bef5 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:26.336473 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b728ae-37aa-4cab-9959-83fbdc8a0c3a admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:26.341077 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3cf6ed-455b-488f-90ce-5639cc2eb548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:26.341788 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cf6ed-455b-488f-90ce-5639cc2eb548 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:26.342022 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cf6ed-455b-488f-90ce-5639cc2eb548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:26.342297 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cf6ed-455b-488f-90ce-5639cc2eb548 admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:26.343018 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3cf6ed-455b-488f-90ce-5639cc2eb548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:26.344597 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3cf6ed-455b-488f-90ce-5639cc2eb548 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:26.345757 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d76879-27d4-494e-98b2-21bb00c4dbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:26.346435 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d76879-27d4-494e-98b2-21bb00c4dbde admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:26.346722 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d76879-27d4-494e-98b2-21bb00c4dbde admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:26.347002 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d76879-27d4-494e-98b2-21bb00c4dbde admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:26.347738 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d76879-27d4-494e-98b2-21bb00c4dbde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:26.349368 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d76879-27d4-494e-98b2-21bb00c4dbde admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:26.355761 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 927/1868] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:12:26.359607 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3cf6ed-455b-488f-90ce-5639cc2eb548 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:26.360185 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 942/1869] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:12:26.364316 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d76879-27d4-494e-98b2-21bb00c4dbde admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:26.371570 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3cf6ed-455b-488f-90ce-5639cc2eb548 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:26.374706 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d76879-27d4-494e-98b2-21bb00c4dbde admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:26.376287 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a60b8c-dce8-4695-93ad-4937376fab13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:26.377873 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a60b8c-dce8-4695-93ad-4937376fab13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:26.378160 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a60b8c-dce8-4695-93ad-4937376fab13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:26.378431 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a60b8c-dce8-4695-93ad-4937376fab13 admin admin] PATH_INFO: `/v3/projects/8b26a8575f854d7b951937f1af969434/users/2012e0d4c4444fedac7aa9a7dd2c2c45/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:26.380119 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68698e4-3644-4c81-b99f-6162de1dd1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:26.380373 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a60b8c-dce8-4695-93ad-4937376fab13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b26a8575f854d7b951937f1af969434, user_id=2012e0d4c4444fedac7aa9a7dd2c2c45, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:26.380804 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68698e4-3644-4c81-b99f-6162de1dd1e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:26.381095 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68698e4-3644-4c81-b99f-6162de1dd1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:26.381374 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68698e4-3644-4c81-b99f-6162de1dd1e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:26.382096 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68698e4-3644-4c81-b99f-6162de1dd1e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:26.383053 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a60b8c-dce8-4695-93ad-4937376fab13 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:26.383734 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68698e4-3644-4c81-b99f-6162de1dd1e2 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:26.398153 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 943/1870] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:12:26.399993 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 928/1871] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:12:26 2022] PUT /identity/v3/projects/8b26a8575f854d7b951937f1af969434/users/2012e0d4c4444fedac7aa9a7dd2c2c45/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:12:26.402498 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68698e4-3644-4c81-b99f-6162de1dd1e2 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:26.411699 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257280d-33bd-4586-a912-27bbebfa0a00 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:26.411891 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257280d-33bd-4586-a912-27bbebfa0a00 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:26.412171 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257280d-33bd-4586-a912-27bbebfa0a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:26.415077 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68698e4-3644-4c81-b99f-6162de1dd1e2 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:26.428454 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:26.450131 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-4257280d-33bd-4586-a912-27bbebfa0a00 None None] MFA Rules not processed for user `2012e0d4c4444fedac7aa9a7dd2c2c45`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:26.455957 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-4257280d-33bd-4586-a912-27bbebfa0a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:26.480784 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:26.493617 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c7b04-bff6-4bb4-a4a1-5a0a97e41030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:26.494477 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c7b04-bff6-4bb4-a4a1-5a0a97e41030 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:26.494876 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c7b04-bff6-4bb4-a4a1-5a0a97e41030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:26.495169 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c7b04-bff6-4bb4-a4a1-5a0a97e41030 admin admin] PATH_INFO: `/v3/projects/7fd9c09eee2f423eafd6f3feb367fe91/users/652348c5e6834a60989dc87988f668f0/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:26.548145 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189c7b04-bff6-4bb4-a4a1-5a0a97e41030 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fd9c09eee2f423eafd6f3feb367fe91, user_id=652348c5e6834a60989dc87988f668f0, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:26.552428 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 929/1872] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:12:26 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:12:26.553593 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189c7b04-bff6-4bb4-a4a1-5a0a97e41030 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:26.568846 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257280d-33bd-4586-a912-27bbebfa0a00 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:26.570634 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-4257280d-33bd-4586-a912-27bbebfa0a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:26.582031 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 944/1873] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:12:26 2022] PUT /identity/v3/projects/7fd9c09eee2f423eafd6f3feb367fe91/users/652348c5e6834a60989dc87988f668f0/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:12:26.593032 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b7e02-3e5b-42f9-8c3f-e0fb70208333 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:26.595928 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b7e02-3e5b-42f9-8c3f-e0fb70208333 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:26.596519 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b7e02-3e5b-42f9-8c3f-e0fb70208333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:26.640774 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-c79b7e02-3e5b-42f9-8c3f-e0fb70208333 None None] MFA Rules not processed for user `652348c5e6834a60989dc87988f668f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:26.642121 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-c79b7e02-3e5b-42f9-8c3f-e0fb70208333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:26.666088 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257280d-33bd-4586-a912-27bbebfa0a00 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:26.729238 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4512c6e-24c1-47bc-8c0c-22b3a2468e06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:26.729901 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4512c6e-24c1-47bc-8c0c-22b3a2468e06 service cinder] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:26.730242 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4512c6e-24c1-47bc-8c0c-22b3a2468e06 service cinder] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:26.730520 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4512c6e-24c1-47bc-8c0c-22b3a2468e06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:26.731472 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 945/1874] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:12:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:26.738142 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b7e02-3e5b-42f9-8c3f-e0fb70208333 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:26.799927 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4512c6e-24c1-47bc-8c0c-22b3a2468e06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:26.801599 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4512c6e-24c1-47bc-8c0c-22b3a2468e06 service cinder] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:26.812798 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 930/1875] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:12:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:12:26.840136 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b7e02-3e5b-42f9-8c3f-e0fb70208333 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:26.851708 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb17ca8-b189-45d1-b538-70e58c5107e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:26.852364 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb17ca8-b189-45d1-b538-70e58c5107e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:26.852595 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb17ca8-b189-45d1-b538-70e58c5107e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:26.858052 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb17ca8-b189-45d1-b538-70e58c5107e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:26.858887 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb17ca8-b189-45d1-b538-70e58c5107e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:26.862137 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb17ca8-b189-45d1-b538-70e58c5107e3 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:26.908912 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 946/1876] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:12:26 2022] POST /identity/v3/projects => generated 389 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:12:26.910162 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4512c6e-24c1-47bc-8c0c-22b3a2468e06 service cinder] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:26.919188 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:26.941802 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4512c6e-24c1-47bc-8c0c-22b3a2468e06 service cinder] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:27.044359 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de244b84-b7b7-4e4d-a31b-130a2aba0e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:27.045460 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de244b84-b7b7-4e4d-a31b-130a2aba0e92 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:27.046167 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de244b84-b7b7-4e4d-a31b-130a2aba0e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:27.046592 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de244b84-b7b7-4e4d-a31b-130a2aba0e92 admin admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:27.049351 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de244b84-b7b7-4e4d-a31b-130a2aba0e92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:27.052004 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de244b84-b7b7-4e4d-a31b-130a2aba0e92 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:27.078666 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 931/1877] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:12:26 2022] POST /identity/v3/users => generated 301 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:12:27.083472 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb17ca8-b189-45d1-b538-70e58c5107e3 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:27.096510 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb17ca8-b189-45d1-b538-70e58c5107e3 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:27.101545 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91228d6c-59e0-4e4c-8ee0-6f7d54ecdc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:27.102289 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91228d6c-59e0-4e4c-8ee0-6f7d54ecdc65 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:27.102510 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91228d6c-59e0-4e4c-8ee0-6f7d54ecdc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:27.102927 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91228d6c-59e0-4e4c-8ee0-6f7d54ecdc65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:27.103675 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91228d6c-59e0-4e4c-8ee0-6f7d54ecdc65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:27.105332 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91228d6c-59e0-4e4c-8ee0-6f7d54ecdc65 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:27.118352 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 947/1878] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:12:27.123116 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de244b84-b7b7-4e4d-a31b-130a2aba0e92 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:27.136567 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de244b84-b7b7-4e4d-a31b-130a2aba0e92 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:27.144288 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70bcedc-b442-4452-ac56-b7a64986ab0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:27.145562 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70bcedc-b442-4452-ac56-b7a64986ab0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:27.145692 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70bcedc-b442-4452-ac56-b7a64986ab0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:27.145881 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70bcedc-b442-4452-ac56-b7a64986ab0e admin admin] PATH_INFO: `/v3/projects/a7ef24fa1def49cd9d0769417bb1831d/users/d2ed63cc4c464d709542ec73b78e3008/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:27.181787 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70bcedc-b442-4452-ac56-b7a64986ab0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7ef24fa1def49cd9d0769417bb1831d, user_id=d2ed63cc4c464d709542ec73b78e3008, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:27.185258 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70bcedc-b442-4452-ac56-b7a64986ab0e admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:27.203351 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 932/1879] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:12:27 2022] PUT /identity/v3/projects/a7ef24fa1def49cd9d0769417bb1831d/users/d2ed63cc4c464d709542ec73b78e3008/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:27.207474 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91228d6c-59e0-4e4c-8ee0-6f7d54ecdc65 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:27.218859 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91228d6c-59e0-4e4c-8ee0-6f7d54ecdc65 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:27.283453 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:27.324545 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1abd0bb-ba98-48a9-aa8c-f82e2f2eb3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:27.326007 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1abd0bb-ba98-48a9-aa8c-f82e2f2eb3a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:27.326381 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1abd0bb-ba98-48a9-aa8c-f82e2f2eb3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:27.326735 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1abd0bb-ba98-48a9-aa8c-f82e2f2eb3a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:27.327614 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1abd0bb-ba98-48a9-aa8c-f82e2f2eb3a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:27.329821 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1abd0bb-ba98-48a9-aa8c-f82e2f2eb3a5 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:27.395760 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 948/1880] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:12:27.400322 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70bcedc-b442-4452-ac56-b7a64986ab0e admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:27.415048 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70bcedc-b442-4452-ac56-b7a64986ab0e admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:27.429430 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3556aad5-36e8-4066-91cb-043a01104f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:27.430938 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556aad5-36e8-4066-91cb-043a01104f7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:27.432148 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556aad5-36e8-4066-91cb-043a01104f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:27.432630 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556aad5-36e8-4066-91cb-043a01104f7a admin admin] PATH_INFO: `/v3/projects/a7ef24fa1def49cd9d0769417bb1831d/users/d2ed63cc4c464d709542ec73b78e3008/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:27.437986 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3556aad5-36e8-4066-91cb-043a01104f7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7ef24fa1def49cd9d0769417bb1831d, user_id=d2ed63cc4c464d709542ec73b78e3008, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:27.457988 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3556aad5-36e8-4066-91cb-043a01104f7a admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:27.519772 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 933/1881] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:12:27 2022] PUT /identity/v3/projects/a7ef24fa1def49cd9d0769417bb1831d/users/d2ed63cc4c464d709542ec73b78e3008/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:27.520671 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ffdfc-91bd-48af-9d93-365ed1296543 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:27.521214 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ffdfc-91bd-48af-9d93-365ed1296543 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:27.521693 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ffdfc-91bd-48af-9d93-365ed1296543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:27.571296 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-057ffdfc-91bd-48af-9d93-365ed1296543 None None] MFA Rules not processed for user `d2ed63cc4c464d709542ec73b78e3008`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:27.572455 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-057ffdfc-91bd-48af-9d93-365ed1296543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:27.670176 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 949/1882] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:12:27 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:12:27.678550 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3556aad5-36e8-4066-91cb-043a01104f7a admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:27.681034 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-3556aad5-36e8-4066-91cb-043a01104f7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:27.779788 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3556aad5-36e8-4066-91cb-043a01104f7a admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:27.785080 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf9b61-2d87-46b8-88d3-d6ec4435b799 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:27.785825 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf9b61-2d87-46b8-88d3-d6ec4435b799 service cinder] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:27.786203 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf9b61-2d87-46b8-88d3-d6ec4435b799 service cinder] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:27.786710 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf9b61-2d87-46b8-88d3-d6ec4435b799 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:27.799822 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbf9b61-2d87-46b8-88d3-d6ec4435b799 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:27.801494 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbf9b61-2d87-46b8-88d3-d6ec4435b799 service cinder] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:27.828956 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 934/1883] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:12:27 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:12:27.956848 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ffdfc-91bd-48af-9d93-365ed1296543 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:28.027206 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ffdfc-91bd-48af-9d93-365ed1296543 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:28.031938 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d935de0-05ca-4225-8595-be8406655a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:28.034436 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d935de0-05ca-4225-8595-be8406655a14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:28.034436 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d935de0-05ca-4225-8595-be8406655a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:28.034436 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d935de0-05ca-4225-8595-be8406655a14 admin admin] PATH_INFO: `/v3/users/652348c5e6834a60989dc87988f668f0` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:28.034881 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d935de0-05ca-4225-8595-be8406655a14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=652348c5e6834a60989dc87988f668f0)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:28.036845 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d935de0-05ca-4225-8595-be8406655a14 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:28.085304 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-8d935de0-05ca-4225-8595-be8406655a14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '652348c5e6834a60989dc87988f668f0'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:28.092762 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-8d935de0-05ca-4225-8595-be8406655a14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '652348c5e6834a60989dc87988f668f0'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:28.100632 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-8d935de0-05ca-4225-8595-be8406655a14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '652348c5e6834a60989dc87988f668f0'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:28.101831 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:28.116790 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-8d935de0-05ca-4225-8595-be8406655a14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '652348c5e6834a60989dc87988f668f0'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:28.117506 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-8d935de0-05ca-4225-8595-be8406655a14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '652348c5e6834a60989dc87988f668f0'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:28.123409 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 950/1884] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:12:27 2022] DELETE /identity/v3/users/652348c5e6834a60989dc87988f668f0 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:28.128681 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579043d-9c58-42ec-9c94-79a6b4846a23 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:28.129005 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579043d-9c58-42ec-9c94-79a6b4846a23 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:28.129284 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579043d-9c58-42ec-9c94-79a6b4846a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:28.146551 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-a579043d-9c58-42ec-9c94-79a6b4846a23 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:28.147752 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-a579043d-9c58-42ec-9c94-79a6b4846a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:28.202691 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:28.218288 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 935/1885] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:12:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:28.228288 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d935de0-05ca-4225-8595-be8406655a14 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:28.229718 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-8d935de0-05ca-4225-8595-be8406655a14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:28.296008 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d935de0-05ca-4225-8595-be8406655a14 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:28.300569 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3c1c5-503b-4f02-b080-70fd784d725b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:28.301288 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3c1c5-503b-4f02-b080-70fd784d725b service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:28.301573 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3c1c5-503b-4f02-b080-70fd784d725b service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:28.301846 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3c1c5-503b-4f02-b080-70fd784d725b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:28.310892 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b3c1c5-503b-4f02-b080-70fd784d725b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:28.312322 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b3c1c5-503b-4f02-b080-70fd784d725b service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:28.322442 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 951/1886] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:12:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:12:28.645102 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a579043d-9c58-42ec-9c94-79a6b4846a23 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:28.651251 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-a579043d-9c58-42ec-9c94-79a6b4846a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:28.670329 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a579043d-9c58-42ec-9c94-79a6b4846a23 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:28.676292 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c031f145-dd35-454e-b5de-b6cebcf524a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:28.677257 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031f145-dd35-454e-b5de-b6cebcf524a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:28.677540 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031f145-dd35-454e-b5de-b6cebcf524a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:28.677816 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031f145-dd35-454e-b5de-b6cebcf524a3 admin admin] PATH_INFO: `/v3/projects/7fd9c09eee2f423eafd6f3feb367fe91` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:28.679093 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c031f145-dd35-454e-b5de-b6cebcf524a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fd9c09eee2f423eafd6f3feb367fe91)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:28.681135 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c031f145-dd35-454e-b5de-b6cebcf524a3 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:28.768215 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-c031f145-dd35-454e-b5de-b6cebcf524a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fd9c09eee2f423eafd6f3feb367fe91', 'request_id': 'req-c031f145-dd35-454e-b5de-b6cebcf524a3'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:28.784951 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-c031f145-dd35-454e-b5de-b6cebcf524a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fd9c09eee2f423eafd6f3feb367fe91', 'request_id': 'req-c031f145-dd35-454e-b5de-b6cebcf524a3'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:28.794537 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-c031f145-dd35-454e-b5de-b6cebcf524a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fd9c09eee2f423eafd6f3feb367fe91', 'request_id': 'req-c031f145-dd35-454e-b5de-b6cebcf524a3'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:28.833207 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-c031f145-dd35-454e-b5de-b6cebcf524a3 admin admin] The token cache is being invalidate because project 7fd9c09eee2f423eafd6f3feb367fe91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:12:28.833207 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-c031f145-dd35-454e-b5de-b6cebcf524a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:28.855514 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-c031f145-dd35-454e-b5de-b6cebcf524a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:28.873591 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 936/1887] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:12:28 2022] DELETE /identity/v3/projects/7fd9c09eee2f423eafd6f3feb367fe91 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:28.878088 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3c1c5-503b-4f02-b080-70fd784d725b service neutron] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:28.897025 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3c1c5-503b-4f02-b080-70fd784d725b service neutron] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:29.115498 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cce5658-fa1f-4b0c-85e5-25183da72ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:29.116455 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce5658-fa1f-4b0c-85e5-25183da72ccd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:29.116778 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce5658-fa1f-4b0c-85e5-25183da72ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:29.117142 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce5658-fa1f-4b0c-85e5-25183da72ccd admin admin] PATH_INFO: `/v3/users/d2ed63cc4c464d709542ec73b78e3008` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:29.119992 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cce5658-fa1f-4b0c-85e5-25183da72ccd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2ed63cc4c464d709542ec73b78e3008)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:29.122239 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cce5658-fa1f-4b0c-85e5-25183da72ccd admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:29.230608 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-4cce5658-fa1f-4b0c-85e5-25183da72ccd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2ed63cc4c464d709542ec73b78e3008'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:29.245047 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-4cce5658-fa1f-4b0c-85e5-25183da72ccd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2ed63cc4c464d709542ec73b78e3008'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:29.254848 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-4cce5658-fa1f-4b0c-85e5-25183da72ccd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2ed63cc4c464d709542ec73b78e3008'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:29.274714 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-4cce5658-fa1f-4b0c-85e5-25183da72ccd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2ed63cc4c464d709542ec73b78e3008'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:29.275850 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-4cce5658-fa1f-4b0c-85e5-25183da72ccd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2ed63cc4c464d709542ec73b78e3008'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:29.290172 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 952/1888] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:12:28 2022] DELETE /identity/v3/users/d2ed63cc4c464d709542ec73b78e3008 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:29.672486 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c031f145-dd35-454e-b5de-b6cebcf524a3 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:29.674972 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-c031f145-dd35-454e-b5de-b6cebcf524a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:29.692550 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c031f145-dd35-454e-b5de-b6cebcf524a3 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:29.757115 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91f8852-ba66-4dfe-8a0e-e5d2ed761c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:29.758455 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f8852-ba66-4dfe-8a0e-e5d2ed761c31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:29.758754 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f8852-ba66-4dfe-8a0e-e5d2ed761c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:29.759036 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f8852-ba66-4dfe-8a0e-e5d2ed761c31 admin admin] PATH_INFO: `/v3/projects/a7ef24fa1def49cd9d0769417bb1831d` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:29.760325 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91f8852-ba66-4dfe-8a0e-e5d2ed761c31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7ef24fa1def49cd9d0769417bb1831d)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:29.762518 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91f8852-ba66-4dfe-8a0e-e5d2ed761c31 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:29.813078 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-e91f8852-ba66-4dfe-8a0e-e5d2ed761c31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7ef24fa1def49cd9d0769417bb1831d', 'request_id': 'req-e91f8852-ba66-4dfe-8a0e-e5d2ed761c31'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:29.821767 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-e91f8852-ba66-4dfe-8a0e-e5d2ed761c31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7ef24fa1def49cd9d0769417bb1831d', 'request_id': 'req-e91f8852-ba66-4dfe-8a0e-e5d2ed761c31'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:29.827423 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-e91f8852-ba66-4dfe-8a0e-e5d2ed761c31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7ef24fa1def49cd9d0769417bb1831d', 'request_id': 'req-e91f8852-ba66-4dfe-8a0e-e5d2ed761c31'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:29.838431 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-e91f8852-ba66-4dfe-8a0e-e5d2ed761c31 admin admin] The token cache is being invalidate because project a7ef24fa1def49cd9d0769417bb1831d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:12:29.838714 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-e91f8852-ba66-4dfe-8a0e-e5d2ed761c31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:29.839366 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-e91f8852-ba66-4dfe-8a0e-e5d2ed761c31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:29.840932 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 937/1889] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:12:29 2022] DELETE /identity/v3/projects/a7ef24fa1def49cd9d0769417bb1831d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:12:29.846424 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572aba1-a449-4cc3-9569-7f20c47b8f1d None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:29.846709 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572aba1-a449-4cc3-9569-7f20c47b8f1d None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:29.846985 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572aba1-a449-4cc3-9569-7f20c47b8f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:29.853206 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:29.869902 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-0572aba1-a449-4cc3-9569-7f20c47b8f1d None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:29.871859 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-0572aba1-a449-4cc3-9569-7f20c47b8f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:29.933777 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 953/1890] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:12:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:29.942183 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b47e0-55d2-4289-86ce-a622522830a8 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:29.942496 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b47e0-55d2-4289-86ce-a622522830a8 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:29.942777 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b47e0-55d2-4289-86ce-a622522830a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:29.961382 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-fa9b47e0-55d2-4289-86ce-a622522830a8 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:29.962581 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-fa9b47e0-55d2-4289-86ce-a622522830a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:29.971478 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 938/1891] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:12:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:29.976223 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0572aba1-a449-4cc3-9569-7f20c47b8f1d None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:29.987459 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0572aba1-a449-4cc3-9569-7f20c47b8f1d None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:29.992723 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b9a63d-a38d-4e52-a4a3-4215ed3e02b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:29.993464 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9a63d-a38d-4e52-a4a3-4215ed3e02b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:29.993719 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9a63d-a38d-4e52-a4a3-4215ed3e02b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:29.994025 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9a63d-a38d-4e52-a4a3-4215ed3e02b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:29.994857 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b9a63d-a38d-4e52-a4a3-4215ed3e02b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:12:29.995163 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b9a63d-a38d-4e52-a4a3-4215ed3e02b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:29.996779 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b9a63d-a38d-4e52-a4a3-4215ed3e02b2 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:30.012772 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 954/1892] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:12:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:12:30.014457 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b47e0-55d2-4289-86ce-a622522830a8 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:30.020281 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:30.024316 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b47e0-55d2-4289-86ce-a622522830a8 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:30.030272 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640cb1f4-359b-4671-93b3-5fb3c68190b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:30.031018 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640cb1f4-359b-4671-93b3-5fb3c68190b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:30.031477 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640cb1f4-359b-4671-93b3-5fb3c68190b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:30.031959 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640cb1f4-359b-4671-93b3-5fb3c68190b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:30.033514 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640cb1f4-359b-4671-93b3-5fb3c68190b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:30.036150 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640cb1f4-359b-4671-93b3-5fb3c68190b1 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:30.061511 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 939/1893] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:12:30 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:12:30.065860 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b9a63d-a38d-4e52-a4a3-4215ed3e02b2 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:30.075729 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b9a63d-a38d-4e52-a4a3-4215ed3e02b2 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:30.142464 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2e9e8a-b2f1-43f1-a97a-04adf0fddc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:30.144240 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e9e8a-b2f1-43f1-a97a-04adf0fddc12 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:30.145057 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e9e8a-b2f1-43f1-a97a-04adf0fddc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:30.145814 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e9e8a-b2f1-43f1-a97a-04adf0fddc12 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:30.147648 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2e9e8a-b2f1-43f1-a97a-04adf0fddc12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:30.151182 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2e9e8a-b2f1-43f1-a97a-04adf0fddc12 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:30.183946 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 955/1894] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:12:30 2022] POST /identity/v3/users => generated 289 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:12:30.184787 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640cb1f4-359b-4671-93b3-5fb3c68190b1 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:30.203109 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640cb1f4-359b-4671-93b3-5fb3c68190b1 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:30.211471 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e96826-4587-4df0-abd2-db7d1d605874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:30.212228 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e96826-4587-4df0-abd2-db7d1d605874 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:30.212588 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e96826-4587-4df0-abd2-db7d1d605874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:30.213049 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e96826-4587-4df0-abd2-db7d1d605874 admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:30.213789 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e96826-4587-4df0-abd2-db7d1d605874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:30.216072 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e96826-4587-4df0-abd2-db7d1d605874 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:30.228115 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 940/1895] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:12:30.232120 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2e9e8a-b2f1-43f1-a97a-04adf0fddc12 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:30.244159 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2e9e8a-b2f1-43f1-a97a-04adf0fddc12 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:30.249512 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247436a-2947-4949-8cba-387669f838ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:30.250180 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247436a-2947-4949-8cba-387669f838ce admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:30.250458 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247436a-2947-4949-8cba-387669f838ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:30.250734 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247436a-2947-4949-8cba-387669f838ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:30.252099 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9247436a-2947-4949-8cba-387669f838ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:30.253721 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9247436a-2947-4949-8cba-387669f838ce admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:30.265520 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 956/1896] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:12:30.269941 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e96826-4587-4df0-abd2-db7d1d605874 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:30.280088 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e96826-4587-4df0-abd2-db7d1d605874 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:30.288953 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1f8052-c948-4f84-af8e-d4321bf42885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:30.290005 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f8052-c948-4f84-af8e-d4321bf42885 admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:30.290470 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f8052-c948-4f84-af8e-d4321bf42885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:30.290813 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f8052-c948-4f84-af8e-d4321bf42885 admin admin] PATH_INFO: `/v3/projects/0b6403e33fd841ff932a8bf1b2aad874/users/60f2041a29024af4b33c32cae300f95b/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:30.307252 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1f8052-c948-4f84-af8e-d4321bf42885 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b6403e33fd841ff932a8bf1b2aad874, user_id=60f2041a29024af4b33c32cae300f95b, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:30.310101 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1f8052-c948-4f84-af8e-d4321bf42885 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:30.327194 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 941/1897] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:12:30 2022] PUT /identity/v3/projects/0b6403e33fd841ff932a8bf1b2aad874/users/60f2041a29024af4b33c32cae300f95b/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:30.342914 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01e5ed-094e-4a3a-8a9d-9f246e685637 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:30.343202 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01e5ed-094e-4a3a-8a9d-9f246e685637 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:30.343680 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01e5ed-094e-4a3a-8a9d-9f246e685637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:30.379040 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-7a01e5ed-094e-4a3a-8a9d-9f246e685637 None None] MFA Rules not processed for user `60f2041a29024af4b33c32cae300f95b`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:30.380601 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-7a01e5ed-094e-4a3a-8a9d-9f246e685637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:30.461182 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:30.470609 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 957/1898] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:12:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:12:30.483720 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1f8052-c948-4f84-af8e-d4321bf42885 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:30.486350 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-2a1f8052-c948-4f84-af8e-d4321bf42885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:30.599239 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1f8052-c948-4f84-af8e-d4321bf42885 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:30.603163 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad12917-4dfb-4b37-ab19-aba1a2611ed8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cb22811a754357ab9d839b70d44261', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:30.603826 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad12917-4dfb-4b37-ab19-aba1a2611ed8 service glance] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:30.604112 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad12917-4dfb-4b37-ab19-aba1a2611ed8 service glance] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:30.604432 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad12917-4dfb-4b37-ab19-aba1a2611ed8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:30.617331 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad12917-4dfb-4b37-ab19-aba1a2611ed8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:30.619708 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad12917-4dfb-4b37-ab19-aba1a2611ed8 service glance] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:30.631441 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 942/1899] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:12:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:12:31.661787 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a01e5ed-094e-4a3a-8a9d-9f246e685637 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:31.663372 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-7a01e5ed-094e-4a3a-8a9d-9f246e685637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:31.728944 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a01e5ed-094e-4a3a-8a9d-9f246e685637 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:31.733294 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c780d2-b83f-477d-8c7a-f1c7cb43ac4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:31.734344 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c780d2-b83f-477d-8c7a-f1c7cb43ac4b service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:31.734696 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c780d2-b83f-477d-8c7a-f1c7cb43ac4b service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:31.735039 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c780d2-b83f-477d-8c7a-f1c7cb43ac4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:31.737556 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-d3c780d2-b83f-477d-8c7a-f1c7cb43ac4b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:31.817002 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c780d2-b83f-477d-8c7a-f1c7cb43ac4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:31.820546 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c780d2-b83f-477d-8c7a-f1c7cb43ac4b service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:31.834155 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 958/1900] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:12:31 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:12:36.836404 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad12917-4dfb-4b37-ab19-aba1a2611ed8 service glance] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:36.838028 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-8ad12917-4dfb-4b37-ab19-aba1a2611ed8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:36.905105 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad12917-4dfb-4b37-ab19-aba1a2611ed8 service glance] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:36.910289 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2380971-6efd-42bd-927f-c27906030ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:36.911169 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2380971-6efd-42bd-927f-c27906030ef6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:36.911449 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2380971-6efd-42bd-927f-c27906030ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:36.911733 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2380971-6efd-42bd-927f-c27906030ef6 admin admin] PATH_INFO: `/v3/users/325a546cfbe745b4b062f0cb20f08a6b` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:36.913077 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2380971-6efd-42bd-927f-c27906030ef6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=325a546cfbe745b4b062f0cb20f08a6b)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:36.915062 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2380971-6efd-42bd-927f-c27906030ef6 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:36.963010 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-c2380971-6efd-42bd-927f-c27906030ef6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '325a546cfbe745b4b062f0cb20f08a6b'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:36.967818 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:36.973554 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-c2380971-6efd-42bd-927f-c27906030ef6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '325a546cfbe745b4b062f0cb20f08a6b'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:36.974443 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-c2380971-6efd-42bd-927f-c27906030ef6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '325a546cfbe745b4b062f0cb20f08a6b'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:36.975488 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-c2380971-6efd-42bd-927f-c27906030ef6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '325a546cfbe745b4b062f0cb20f08a6b'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:36.989238 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-c2380971-6efd-42bd-927f-c27906030ef6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '325a546cfbe745b4b062f0cb20f08a6b'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:37.001908 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 943/1901] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:12:36 2022] DELETE /identity/v3/users/325a546cfbe745b4b062f0cb20f08a6b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:37.006502 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966da7b5-9212-4e54-8908-f520cf45cf79 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:37.007033 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966da7b5-9212-4e54-8908-f520cf45cf79 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:37.007121 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966da7b5-9212-4e54-8908-f520cf45cf79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:37.024017 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-966da7b5-9212-4e54-8908-f520cf45cf79 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:37.025269 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-966da7b5-9212-4e54-8908-f520cf45cf79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:37.084713 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 959/1902] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:12:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:37.095331 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2380971-6efd-42bd-927f-c27906030ef6 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:37.097011 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-c2380971-6efd-42bd-927f-c27906030ef6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:37.153652 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2380971-6efd-42bd-927f-c27906030ef6 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:37.157602 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25353c2f-b46c-4d9e-a6f2-2c60e701e662 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:37.158300 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25353c2f-b46c-4d9e-a6f2-2c60e701e662 service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:37.158588 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25353c2f-b46c-4d9e-a6f2-2c60e701e662 service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:37.158876 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25353c2f-b46c-4d9e-a6f2-2c60e701e662 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:37.169875 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25353c2f-b46c-4d9e-a6f2-2c60e701e662 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:37.171327 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25353c2f-b46c-4d9e-a6f2-2c60e701e662 service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:37.185619 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 944/1903] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:12:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:12:37.603965 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966da7b5-9212-4e54-8908-f520cf45cf79 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:37.605725 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-966da7b5-9212-4e54-8908-f520cf45cf79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:37.623239 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966da7b5-9212-4e54-8908-f520cf45cf79 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:37.629920 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38556f57-4ce6-4dec-8b6b-7e78b92cccdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:37.632200 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38556f57-4ce6-4dec-8b6b-7e78b92cccdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:37.632200 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38556f57-4ce6-4dec-8b6b-7e78b92cccdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:37.632200 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38556f57-4ce6-4dec-8b6b-7e78b92cccdf admin admin] PATH_INFO: `/v3/projects/9b5a834051c542c489686440ce130105` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:37.653549 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38556f57-4ce6-4dec-8b6b-7e78b92cccdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b5a834051c542c489686440ce130105)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:37.655958 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38556f57-4ce6-4dec-8b6b-7e78b92cccdf admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:37.737651 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:37.748876 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-38556f57-4ce6-4dec-8b6b-7e78b92cccdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b5a834051c542c489686440ce130105', 'request_id': 'req-38556f57-4ce6-4dec-8b6b-7e78b92cccdf'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:37.756467 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-38556f57-4ce6-4dec-8b6b-7e78b92cccdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b5a834051c542c489686440ce130105', 'request_id': 'req-38556f57-4ce6-4dec-8b6b-7e78b92cccdf'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:37.764669 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-38556f57-4ce6-4dec-8b6b-7e78b92cccdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b5a834051c542c489686440ce130105', 'request_id': 'req-38556f57-4ce6-4dec-8b6b-7e78b92cccdf'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:37.778573 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-38556f57-4ce6-4dec-8b6b-7e78b92cccdf admin admin] The token cache is being invalidate because project 9b5a834051c542c489686440ce130105 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:12:37.778573 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-38556f57-4ce6-4dec-8b6b-7e78b92cccdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:37.778573 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-38556f57-4ce6-4dec-8b6b-7e78b92cccdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:37.780054 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 960/1904] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:12:37 2022] DELETE /identity/v3/projects/9b5a834051c542c489686440ce130105 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:37.786176 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25353c2f-b46c-4d9e-a6f2-2c60e701e662 service neutron] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:37.796652 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25353c2f-b46c-4d9e-a6f2-2c60e701e662 service neutron] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:37.859376 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc5e68-9364-4172-8c1a-2829cb4e6260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:37.860068 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc5e68-9364-4172-8c1a-2829cb4e6260 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:37.864929 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc5e68-9364-4172-8c1a-2829cb4e6260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:37.865808 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc5e68-9364-4172-8c1a-2829cb4e6260 admin admin] PATH_INFO: `/v3/users/2012e0d4c4444fedac7aa9a7dd2c2c45` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:37.867626 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cc5e68-9364-4172-8c1a-2829cb4e6260 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2012e0d4c4444fedac7aa9a7dd2c2c45)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:37.870476 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cc5e68-9364-4172-8c1a-2829cb4e6260 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:37.961360 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-f3cc5e68-9364-4172-8c1a-2829cb4e6260 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2012e0d4c4444fedac7aa9a7dd2c2c45'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:37.976187 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-f3cc5e68-9364-4172-8c1a-2829cb4e6260 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2012e0d4c4444fedac7aa9a7dd2c2c45'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:37.976884 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-f3cc5e68-9364-4172-8c1a-2829cb4e6260 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2012e0d4c4444fedac7aa9a7dd2c2c45'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:37.977493 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-f3cc5e68-9364-4172-8c1a-2829cb4e6260 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2012e0d4c4444fedac7aa9a7dd2c2c45'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:37.991749 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-f3cc5e68-9364-4172-8c1a-2829cb4e6260 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2012e0d4c4444fedac7aa9a7dd2c2c45'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:37.993850 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:38.008743 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 945/1905] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:12:37 2022] DELETE /identity/v3/users/2012e0d4c4444fedac7aa9a7dd2c2c45 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:38.348686 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38556f57-4ce6-4dec-8b6b-7e78b92cccdf admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:38.350394 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-38556f57-4ce6-4dec-8b6b-7e78b92cccdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:38.384544 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38556f57-4ce6-4dec-8b6b-7e78b92cccdf admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:38.453311 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1adfc30-6466-4ff2-8d92-e54b847e3049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:38.454747 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1adfc30-6466-4ff2-8d92-e54b847e3049 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:38.454747 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1adfc30-6466-4ff2-8d92-e54b847e3049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:38.454955 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1adfc30-6466-4ff2-8d92-e54b847e3049 admin admin] PATH_INFO: `/v3/projects/8b26a8575f854d7b951937f1af969434` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:38.456158 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1adfc30-6466-4ff2-8d92-e54b847e3049 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b26a8575f854d7b951937f1af969434)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:38.458143 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1adfc30-6466-4ff2-8d92-e54b847e3049 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:38.517099 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e1adfc30-6466-4ff2-8d92-e54b847e3049 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b26a8575f854d7b951937f1af969434', 'request_id': 'req-e1adfc30-6466-4ff2-8d92-e54b847e3049'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:38.523261 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e1adfc30-6466-4ff2-8d92-e54b847e3049 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b26a8575f854d7b951937f1af969434', 'request_id': 'req-e1adfc30-6466-4ff2-8d92-e54b847e3049'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:38.533725 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e1adfc30-6466-4ff2-8d92-e54b847e3049 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b26a8575f854d7b951937f1af969434', 'request_id': 'req-e1adfc30-6466-4ff2-8d92-e54b847e3049'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:38.545507 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e1adfc30-6466-4ff2-8d92-e54b847e3049 admin admin] The token cache is being invalidate because project 8b26a8575f854d7b951937f1af969434 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:12:38.545788 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e1adfc30-6466-4ff2-8d92-e54b847e3049 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:38.546453 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e1adfc30-6466-4ff2-8d92-e54b847e3049 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:38.548784 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 961/1906] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:12:38 2022] DELETE /identity/v3/projects/8b26a8575f854d7b951937f1af969434 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:38.554992 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d6958-6bce-4d8a-ba1c-55e86a2d95aa None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:38.555285 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d6958-6bce-4d8a-ba1c-55e86a2d95aa None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:38.555570 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d6958-6bce-4d8a-ba1c-55e86a2d95aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:38.576796 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-1f4d6958-6bce-4d8a-ba1c-55e86a2d95aa None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:38.578093 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-1f4d6958-6bce-4d8a-ba1c-55e86a2d95aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:38.663985 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9fdcd-77fe-4454-938a-84b692632a1a None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:38.664489 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9fdcd-77fe-4454-938a-84b692632a1a None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:38.664896 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9fdcd-77fe-4454-938a-84b692632a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:38.666153 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 946/1907] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:12:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:12:38.692987 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-d9b9fdcd-77fe-4454-938a-84b692632a1a None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:38.694841 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-d9b9fdcd-77fe-4454-938a-84b692632a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:38.706195 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 962/1908] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:12:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:38.711842 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d6958-6bce-4d8a-ba1c-55e86a2d95aa None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:38.722062 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d6958-6bce-4d8a-ba1c-55e86a2d95aa None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:38.729611 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce52795-5d76-4fe7-8374-8b82a8980fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:38.730618 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce52795-5d76-4fe7-8374-8b82a8980fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:38.731224 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce52795-5d76-4fe7-8374-8b82a8980fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:38.731803 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce52795-5d76-4fe7-8374-8b82a8980fa2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:38.732746 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce52795-5d76-4fe7-8374-8b82a8980fa2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:12:38.733223 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce52795-5d76-4fe7-8374-8b82a8980fa2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:38.735824 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce52795-5d76-4fe7-8374-8b82a8980fa2 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:38.754056 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 947/1909] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:12:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:12:38.755391 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b9fdcd-77fe-4454-938a-84b692632a1a None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:38.766051 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b9fdcd-77fe-4454-938a-84b692632a1a None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:38.771835 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897beb4e-152f-4689-abc1-1144bf40d0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:38.772784 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897beb4e-152f-4689-abc1-1144bf40d0e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:38.773276 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897beb4e-152f-4689-abc1-1144bf40d0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:38.773993 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897beb4e-152f-4689-abc1-1144bf40d0e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:38.774712 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897beb4e-152f-4689-abc1-1144bf40d0e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:38.777010 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897beb4e-152f-4689-abc1-1144bf40d0e5 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:38.820991 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 963/1910] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:12:38 2022] POST /identity/v3/projects => generated 383 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:12:38.827188 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce52795-5d76-4fe7-8374-8b82a8980fa2 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:38.843064 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce52795-5d76-4fe7-8374-8b82a8980fa2 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:38.912299 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236bab27-3f0d-4b83-9fa7-a3b5fe5d0033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:38.913773 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236bab27-3f0d-4b83-9fa7-a3b5fe5d0033 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:38.914060 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236bab27-3f0d-4b83-9fa7-a3b5fe5d0033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:38.914338 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236bab27-3f0d-4b83-9fa7-a3b5fe5d0033 admin admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:38.915053 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236bab27-3f0d-4b83-9fa7-a3b5fe5d0033 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:38.917043 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236bab27-3f0d-4b83-9fa7-a3b5fe5d0033 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:38.955510 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 948/1911] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:12:38 2022] POST /identity/v3/users => generated 292 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:12:38.960072 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897beb4e-152f-4689-abc1-1144bf40d0e5 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:38.972333 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897beb4e-152f-4689-abc1-1144bf40d0e5 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:38.977881 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1868ec5-5448-4ab8-b9bc-da1f674a9f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:38.978708 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1868ec5-5448-4ab8-b9bc-da1f674a9f4b admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:38.979059 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1868ec5-5448-4ab8-b9bc-da1f674a9f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:38.979683 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1868ec5-5448-4ab8-b9bc-da1f674a9f4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:38.980673 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1868ec5-5448-4ab8-b9bc-da1f674a9f4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:38.983120 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1868ec5-5448-4ab8-b9bc-da1f674a9f4b admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:38.997845 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 964/1912] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:12:39.001877 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236bab27-3f0d-4b83-9fa7-a3b5fe5d0033 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:39.013338 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236bab27-3f0d-4b83-9fa7-a3b5fe5d0033 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:39.018569 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4153f611-8c7c-4466-a9eb-cfa0915bd71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:39.019312 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153f611-8c7c-4466-a9eb-cfa0915bd71e admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:39.019544 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153f611-8c7c-4466-a9eb-cfa0915bd71e admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:39.019819 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153f611-8c7c-4466-a9eb-cfa0915bd71e admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:39.021764 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4153f611-8c7c-4466-a9eb-cfa0915bd71e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:39.023129 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4153f611-8c7c-4466-a9eb-cfa0915bd71e admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:39.039876 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 949/1913] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:12:39.044273 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1868ec5-5448-4ab8-b9bc-da1f674a9f4b admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:39.056487 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1868ec5-5448-4ab8-b9bc-da1f674a9f4b admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:39.064009 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5e1ae-528b-4ea2-a008-6cb202e3a5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:39.064009 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5e1ae-528b-4ea2-a008-6cb202e3a5b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:39.064009 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5e1ae-528b-4ea2-a008-6cb202e3a5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:39.064009 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5e1ae-528b-4ea2-a008-6cb202e3a5b9 admin admin] PATH_INFO: `/v3/projects/4f4d7689031b4d1dab0faa24ce0c2821/users/5792afc72c7449e0bc79ee603011dc9b/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:39.081375 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa5e1ae-528b-4ea2-a008-6cb202e3a5b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f4d7689031b4d1dab0faa24ce0c2821, user_id=5792afc72c7449e0bc79ee603011dc9b, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:39.084430 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa5e1ae-528b-4ea2-a008-6cb202e3a5b9 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:39.094275 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:39.104756 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 965/1914] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:12:39 2022] PUT /identity/v3/projects/4f4d7689031b4d1dab0faa24ce0c2821/users/5792afc72c7449e0bc79ee603011dc9b/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:39.116170 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617afbed-2708-4f85-a15a-249cff397052 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:39.116464 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617afbed-2708-4f85-a15a-249cff397052 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:39.116748 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617afbed-2708-4f85-a15a-249cff397052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:39.147333 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-617afbed-2708-4f85-a15a-249cff397052 None None] MFA Rules not processed for user `5792afc72c7449e0bc79ee603011dc9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:39.149050 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-617afbed-2708-4f85-a15a-249cff397052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:39.212067 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:39.239567 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 950/1915] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:12:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:39.252759 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5e1ae-528b-4ea2-a008-6cb202e3a5b9 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:39.254874 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-bfa5e1ae-528b-4ea2-a008-6cb202e3a5b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:39.320161 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5e1ae-528b-4ea2-a008-6cb202e3a5b9 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:39.323999 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d328cc2-5998-44a4-8218-739f3ae097e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:39.324654 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d328cc2-5998-44a4-8218-739f3ae097e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:39.324958 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d328cc2-5998-44a4-8218-739f3ae097e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:39.325240 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d328cc2-5998-44a4-8218-739f3ae097e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:39.334483 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d328cc2-5998-44a4-8218-739f3ae097e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:39.335948 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d328cc2-5998-44a4-8218-739f3ae097e6 service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:39.345348 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 966/1916] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:12:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:12:49.236474 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=6 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:49.340632 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=27 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:57.169756 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617afbed-2708-4f85-a15a-249cff397052 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:57.234287 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617afbed-2708-4f85-a15a-249cff397052 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:57.239857 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88e0eb-0b07-4d49-973d-6e65d1f0f679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:57.241366 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88e0eb-0b07-4d49-973d-6e65d1f0f679 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:57.241366 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88e0eb-0b07-4d49-973d-6e65d1f0f679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:57.241366 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88e0eb-0b07-4d49-973d-6e65d1f0f679 admin admin] PATH_INFO: `/v3/users/5792afc72c7449e0bc79ee603011dc9b` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:57.242465 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88e0eb-0b07-4d49-973d-6e65d1f0f679 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5792afc72c7449e0bc79ee603011dc9b)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:57.244389 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88e0eb-0b07-4d49-973d-6e65d1f0f679 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:57.299441 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-fe88e0eb-0b07-4d49-973d-6e65d1f0f679 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5792afc72c7449e0bc79ee603011dc9b'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:57.308172 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-fe88e0eb-0b07-4d49-973d-6e65d1f0f679 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5792afc72c7449e0bc79ee603011dc9b'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:57.308993 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-fe88e0eb-0b07-4d49-973d-6e65d1f0f679 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5792afc72c7449e0bc79ee603011dc9b'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:57.309603 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-fe88e0eb-0b07-4d49-973d-6e65d1f0f679 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5792afc72c7449e0bc79ee603011dc9b'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:57.324467 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-fe88e0eb-0b07-4d49-973d-6e65d1f0f679 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5792afc72c7449e0bc79ee603011dc9b'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:57.337443 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 951/1917] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:12:57 2022] DELETE /identity/v3/users/5792afc72c7449e0bc79ee603011dc9b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:57.341840 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a358f-d36d-41e3-b5bd-028cb6544e16 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:57.342349 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a358f-d36d-41e3-b5bd-028cb6544e16 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:57.342426 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a358f-d36d-41e3-b5bd-028cb6544e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:57.359103 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-437a358f-d36d-41e3-b5bd-028cb6544e16 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:57.360870 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-437a358f-d36d-41e3-b5bd-028cb6544e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:57.423650 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 967/1918] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:12:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:57.433075 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88e0eb-0b07-4d49-973d-6e65d1f0f679 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:57.434480 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-fe88e0eb-0b07-4d49-973d-6e65d1f0f679 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:57.496848 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88e0eb-0b07-4d49-973d-6e65d1f0f679 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:57.501199 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97be0db-8cf9-45e1-9d4f-0cb152551984 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:57.501852 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97be0db-8cf9-45e1-9d4f-0cb152551984 service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:57.502134 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97be0db-8cf9-45e1-9d4f-0cb152551984 service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:57.502410 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97be0db-8cf9-45e1-9d4f-0cb152551984 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:57.511359 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97be0db-8cf9-45e1-9d4f-0cb152551984 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:57.512821 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97be0db-8cf9-45e1-9d4f-0cb152551984 service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:57.522410 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 952/1919] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:12:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:12:57.796073 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a358f-d36d-41e3-b5bd-028cb6544e16 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:57.798896 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-437a358f-d36d-41e3-b5bd-028cb6544e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:57.814391 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a358f-d36d-41e3-b5bd-028cb6544e16 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:57.819877 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e51fc1-722a-462c-800b-7009abaf9bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:57.820777 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e51fc1-722a-462c-800b-7009abaf9bc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:57.821062 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e51fc1-722a-462c-800b-7009abaf9bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:57.821401 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e51fc1-722a-462c-800b-7009abaf9bc5 admin admin] PATH_INFO: `/v3/projects/4f4d7689031b4d1dab0faa24ce0c2821` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:57.823409 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e51fc1-722a-462c-800b-7009abaf9bc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f4d7689031b4d1dab0faa24ce0c2821)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:57.824970 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e51fc1-722a-462c-800b-7009abaf9bc5 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:57.872371 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-51e51fc1-722a-462c-800b-7009abaf9bc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f4d7689031b4d1dab0faa24ce0c2821', 'request_id': 'req-51e51fc1-722a-462c-800b-7009abaf9bc5'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:57.878119 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-51e51fc1-722a-462c-800b-7009abaf9bc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f4d7689031b4d1dab0faa24ce0c2821', 'request_id': 'req-51e51fc1-722a-462c-800b-7009abaf9bc5'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:57.885230 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-51e51fc1-722a-462c-800b-7009abaf9bc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f4d7689031b4d1dab0faa24ce0c2821', 'request_id': 'req-51e51fc1-722a-462c-800b-7009abaf9bc5'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:57.895958 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-51e51fc1-722a-462c-800b-7009abaf9bc5 admin admin] The token cache is being invalidate because project 4f4d7689031b4d1dab0faa24ce0c2821 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:12:57.896243 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-51e51fc1-722a-462c-800b-7009abaf9bc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:57.896894 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-51e51fc1-722a-462c-800b-7009abaf9bc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:57.898413 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 968/1920] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:12:57 2022] DELETE /identity/v3/projects/4f4d7689031b4d1dab0faa24ce0c2821 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:57.903234 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebe981-4366-480e-bd3d-7ef84ff2d91a None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:57.903526 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebe981-4366-480e-bd3d-7ef84ff2d91a None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:57.903827 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebe981-4366-480e-bd3d-7ef84ff2d91a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:57.923551 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-abebe981-4366-480e-bd3d-7ef84ff2d91a None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:57.924793 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-abebe981-4366-480e-bd3d-7ef84ff2d91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:57.942521 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:57.986348 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 953/1921] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:12:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:57.994043 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc69d52-6e38-418b-878a-5671dfb84ded None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:57.994331 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc69d52-6e38-418b-878a-5671dfb84ded None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:57.994626 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc69d52-6e38-418b-878a-5671dfb84ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:58.012685 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-8bc69d52-6e38-418b-878a-5671dfb84ded None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:58.013922 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-8bc69d52-6e38-418b-878a-5671dfb84ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:58.024286 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 969/1922] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:12:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:58.028986 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abebe981-4366-480e-bd3d-7ef84ff2d91a None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:58.040272 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abebe981-4366-480e-bd3d-7ef84ff2d91a None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:58.044911 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bab6a0-2f3b-4cc6-8404-92e12b1ebf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:58.045572 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bab6a0-2f3b-4cc6-8404-92e12b1ebf3f admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:58.045861 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bab6a0-2f3b-4cc6-8404-92e12b1ebf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:58.046145 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bab6a0-2f3b-4cc6-8404-92e12b1ebf3f admin admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:58.046874 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bab6a0-2f3b-4cc6-8404-92e12b1ebf3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:12:58.047294 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bab6a0-2f3b-4cc6-8404-92e12b1ebf3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:58.049343 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bab6a0-2f3b-4cc6-8404-92e12b1ebf3f admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:58.060754 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 954/1923] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:12:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:12:58.064985 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc69d52-6e38-418b-878a-5671dfb84ded None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:58.074300 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc69d52-6e38-418b-878a-5671dfb84ded None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:58.079395 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382cecb-51fd-46dc-bd19-e729bbfd40e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:58.080031 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382cecb-51fd-46dc-bd19-e729bbfd40e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:58.080307 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382cecb-51fd-46dc-bd19-e729bbfd40e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:58.080577 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382cecb-51fd-46dc-bd19-e729bbfd40e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:58.081298 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9382cecb-51fd-46dc-bd19-e729bbfd40e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:58.083170 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9382cecb-51fd-46dc-bd19-e729bbfd40e9 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:58.107603 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 970/1924] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:12:58 2022] POST /identity/v3/projects => generated 383 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:12:58.113426 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bab6a0-2f3b-4cc6-8404-92e12b1ebf3f admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:58.123351 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bab6a0-2f3b-4cc6-8404-92e12b1ebf3f admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:58.178429 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee93a383-eb3e-4b2d-ac62-dd568c09e16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:58.179094 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93a383-eb3e-4b2d-ac62-dd568c09e16e admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:58.179384 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93a383-eb3e-4b2d-ac62-dd568c09e16e admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:58.179663 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93a383-eb3e-4b2d-ac62-dd568c09e16e admin admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:58.180361 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee93a383-eb3e-4b2d-ac62-dd568c09e16e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:58.182356 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee93a383-eb3e-4b2d-ac62-dd568c09e16e admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:58.202185 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 955/1925] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:12:58 2022] POST /identity/v3/users => generated 292 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:12:58.206325 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382cecb-51fd-46dc-bd19-e729bbfd40e9 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:58.216894 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382cecb-51fd-46dc-bd19-e729bbfd40e9 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:58.221548 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d45b76c-e436-444d-b407-676e2b7000c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:58.222307 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45b76c-e436-444d-b407-676e2b7000c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:58.222591 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45b76c-e436-444d-b407-676e2b7000c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:58.222865 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45b76c-e436-444d-b407-676e2b7000c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:58.223595 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d45b76c-e436-444d-b407-676e2b7000c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:58.225208 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d45b76c-e436-444d-b407-676e2b7000c3 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:58.237058 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 971/1926] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:12:58.241010 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee93a383-eb3e-4b2d-ac62-dd568c09e16e admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:58.252623 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee93a383-eb3e-4b2d-ac62-dd568c09e16e admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:58.257656 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df061b51-410d-4415-8e21-36db664e3c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:58.258362 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df061b51-410d-4415-8e21-36db664e3c23 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:58.258646 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df061b51-410d-4415-8e21-36db664e3c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:58.258921 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df061b51-410d-4415-8e21-36db664e3c23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:58.259663 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df061b51-410d-4415-8e21-36db664e3c23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:58.261469 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df061b51-410d-4415-8e21-36db664e3c23 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:58.272008 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 956/1927] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:12:58.276134 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d45b76c-e436-444d-b407-676e2b7000c3 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:58.287327 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d45b76c-e436-444d-b407-676e2b7000c3 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:58.292133 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde637ab-9bd0-4313-9efb-52d09a660421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:58.293053 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde637ab-9bd0-4313-9efb-52d09a660421 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:58.293332 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde637ab-9bd0-4313-9efb-52d09a660421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:58.293602 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde637ab-9bd0-4313-9efb-52d09a660421 admin admin] PATH_INFO: `/v3/projects/fda832c44b6640b591119f4bffcfe82e/users/2c8ac0fc751d4bc0a966332ba562cef1/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:58.308393 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde637ab-9bd0-4313-9efb-52d09a660421 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fda832c44b6640b591119f4bffcfe82e, user_id=2c8ac0fc751d4bc0a966332ba562cef1, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:58.311061 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde637ab-9bd0-4313-9efb-52d09a660421 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:58.324521 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 972/1928] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:12:58 2022] PUT /identity/v3/projects/fda832c44b6640b591119f4bffcfe82e/users/2c8ac0fc751d4bc0a966332ba562cef1/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:58.335879 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7154f-3a2a-469e-bf42-505896ce281f None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:58.336241 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7154f-3a2a-469e-bf42-505896ce281f None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:58.336621 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7154f-3a2a-469e-bf42-505896ce281f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:58.365841 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-49b7154f-3a2a-469e-bf42-505896ce281f None None] MFA Rules not processed for user `2c8ac0fc751d4bc0a966332ba562cef1`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:58.367175 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-49b7154f-3a2a-469e-bf42-505896ce281f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:58.433844 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 957/1929] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:12:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:12:58.438489 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde637ab-9bd0-4313-9efb-52d09a660421 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:58.466216 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:58.513031 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde637ab-9bd0-4313-9efb-52d09a660421 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:58.518080 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6aeb45-f8e3-4565-a5c1-9cfd1a5aa07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:58.518737 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6aeb45-f8e3-4565-a5c1-9cfd1a5aa07a admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:58.519027 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6aeb45-f8e3-4565-a5c1-9cfd1a5aa07a admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:58.519300 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6aeb45-f8e3-4565-a5c1-9cfd1a5aa07a admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:58.520011 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6aeb45-f8e3-4565-a5c1-9cfd1a5aa07a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:58.521941 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6aeb45-f8e3-4565-a5c1-9cfd1a5aa07a admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:58.552900 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 973/1930] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:12:58 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:12:58.554007 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b7154f-3a2a-469e-bf42-505896ce281f None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:58.564825 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b7154f-3a2a-469e-bf42-505896ce281f None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:58.577251 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:58.629259 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1786a638-f1f0-44b6-a080-12edfb92f844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:58.630017 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1786a638-f1f0-44b6-a080-12edfb92f844 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:58.630364 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1786a638-f1f0-44b6-a080-12edfb92f844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:58.630700 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1786a638-f1f0-44b6-a080-12edfb92f844 admin admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:58.631478 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1786a638-f1f0-44b6-a080-12edfb92f844 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:58.633639 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1786a638-f1f0-44b6-a080-12edfb92f844 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:58.657004 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 958/1931] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:12:58 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:12:58.661607 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6aeb45-f8e3-4565-a5c1-9cfd1a5aa07a admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:58.672692 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6aeb45-f8e3-4565-a5c1-9cfd1a5aa07a admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:58.677335 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be87473d-fdd7-4842-a98c-ab0c0f695858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:58.677993 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87473d-fdd7-4842-a98c-ab0c0f695858 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:58.678275 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87473d-fdd7-4842-a98c-ab0c0f695858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:58.678550 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87473d-fdd7-4842-a98c-ab0c0f695858 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:58.679275 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be87473d-fdd7-4842-a98c-ab0c0f695858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:58.680905 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be87473d-fdd7-4842-a98c-ab0c0f695858 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:58.691506 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 974/1932] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:12:58.695349 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1786a638-f1f0-44b6-a080-12edfb92f844 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:58.705812 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1786a638-f1f0-44b6-a080-12edfb92f844 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:58.710485 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae8779-543c-42fd-bc62-0c8c4217e3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:58.711081 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae8779-543c-42fd-bc62-0c8c4217e3f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:58.711363 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae8779-543c-42fd-bc62-0c8c4217e3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:58.711637 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae8779-543c-42fd-bc62-0c8c4217e3f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:58.712392 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ae8779-543c-42fd-bc62-0c8c4217e3f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:58.714018 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ae8779-543c-42fd-bc62-0c8c4217e3f1 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:58.724550 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 959/1933] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:12:58.728980 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be87473d-fdd7-4842-a98c-ab0c0f695858 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:58.739870 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be87473d-fdd7-4842-a98c-ab0c0f695858 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:58.744365 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c9770-6cc6-4957-b634-072529424c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:58.745426 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c9770-6cc6-4957-b634-072529424c5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:58.745879 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c9770-6cc6-4957-b634-072529424c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:58.746356 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c9770-6cc6-4957-b634-072529424c5e admin admin] PATH_INFO: `/v3/projects/c5eeb5ec24ca466a869c7a070d509af4/users/fa2905b5bc3e43179a46c37461b7eb4c/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:58.764275 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c9770-6cc6-4957-b634-072529424c5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5eeb5ec24ca466a869c7a070d509af4, user_id=fa2905b5bc3e43179a46c37461b7eb4c, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:58.767808 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c9770-6cc6-4957-b634-072529424c5e admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:58.782955 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 975/1934] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:12:58 2022] PUT /identity/v3/projects/c5eeb5ec24ca466a869c7a070d509af4/users/fa2905b5bc3e43179a46c37461b7eb4c/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:58.793039 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f4a82-9527-424b-ac67-07b81aff25de None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:58.793333 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f4a82-9527-424b-ac67-07b81aff25de None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:58.793610 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f4a82-9527-424b-ac67-07b81aff25de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:58.948388 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-464f4a82-9527-424b-ac67-07b81aff25de None None] MFA Rules not processed for user `fa2905b5bc3e43179a46c37461b7eb4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:58.949650 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-464f4a82-9527-424b-ac67-07b81aff25de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:59.013603 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 960/1935] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:12:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:59.018477 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c9770-6cc6-4957-b634-072529424c5e admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:59.085894 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c9770-6cc6-4957-b634-072529424c5e admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:59.090432 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6764bdcc-4a59-44b2-809f-9ae82d280baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:59.091095 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764bdcc-4a59-44b2-809f-9ae82d280baa admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:59.091370 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764bdcc-4a59-44b2-809f-9ae82d280baa admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:59.091640 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764bdcc-4a59-44b2-809f-9ae82d280baa admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:59.092327 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6764bdcc-4a59-44b2-809f-9ae82d280baa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:59.094449 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6764bdcc-4a59-44b2-809f-9ae82d280baa admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:59.118851 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 976/1936] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:12:59 2022] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:12:59.122951 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464f4a82-9527-424b-ac67-07b81aff25de None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:59.137312 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464f4a82-9527-424b-ac67-07b81aff25de None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:59.195131 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe393f04-1e20-48c8-94dc-9dca4b5e09f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:59.195815 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe393f04-1e20-48c8-94dc-9dca4b5e09f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:59.196062 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe393f04-1e20-48c8-94dc-9dca4b5e09f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:59.196338 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe393f04-1e20-48c8-94dc-9dca4b5e09f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:59.197061 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe393f04-1e20-48c8-94dc-9dca4b5e09f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:59.198959 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe393f04-1e20-48c8-94dc-9dca4b5e09f1 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:59.219662 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 961/1937] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:12:59 2022] POST /identity/v3/users => generated 298 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:12:59.223441 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6764bdcc-4a59-44b2-809f-9ae82d280baa admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:59.233768 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6764bdcc-4a59-44b2-809f-9ae82d280baa admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:59.239026 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de46a4d-9eb5-4394-9947-66ae8288385a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:59.239682 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de46a4d-9eb5-4394-9947-66ae8288385a admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:59.239968 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de46a4d-9eb5-4394-9947-66ae8288385a admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:59.240246 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de46a4d-9eb5-4394-9947-66ae8288385a admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:59.241018 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de46a4d-9eb5-4394-9947-66ae8288385a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:59.242617 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de46a4d-9eb5-4394-9947-66ae8288385a admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:59.253741 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 977/1938] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:12:59.257640 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe393f04-1e20-48c8-94dc-9dca4b5e09f1 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:59.268521 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe393f04-1e20-48c8-94dc-9dca4b5e09f1 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:59.273148 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad59841-5595-4688-b40e-8c258b6c5459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:59.274049 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad59841-5595-4688-b40e-8c258b6c5459 admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:59.274349 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad59841-5595-4688-b40e-8c258b6c5459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:59.274607 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad59841-5595-4688-b40e-8c258b6c5459 admin admin] PATH_INFO: `/v3/projects/dd7f2a111d1d49b98167211981668ff3/users/f534976f766745b6ae387bc7ea73cc28/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:59.286421 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:59.290394 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad59841-5595-4688-b40e-8c258b6c5459 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd7f2a111d1d49b98167211981668ff3, user_id=f534976f766745b6ae387bc7ea73cc28, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:59.293994 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad59841-5595-4688-b40e-8c258b6c5459 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:59.306691 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 962/1939] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:12:59 2022] PUT /identity/v3/projects/dd7f2a111d1d49b98167211981668ff3/users/f534976f766745b6ae387bc7ea73cc28/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:59.310702 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de46a4d-9eb5-4394-9947-66ae8288385a admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:59.321521 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de46a4d-9eb5-4394-9947-66ae8288385a admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:59.362978 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:59.379185 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10782837-14d0-4d84-9c77-ba50272f8ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:59.379858 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10782837-14d0-4d84-9c77-ba50272f8ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:59.380140 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10782837-14d0-4d84-9c77-ba50272f8ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:59.380415 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10782837-14d0-4d84-9c77-ba50272f8ac8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:59.381175 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10782837-14d0-4d84-9c77-ba50272f8ac8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:59.382767 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10782837-14d0-4d84-9c77-ba50272f8ac8 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:59.393165 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 978/1940] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:12:59.397289 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad59841-5595-4688-b40e-8c258b6c5459 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:59.407891 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad59841-5595-4688-b40e-8c258b6c5459 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:59.413705 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cbb462-aa2b-4a3c-8055-18ab566679fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:59.414707 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cbb462-aa2b-4a3c-8055-18ab566679fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:59.415233 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cbb462-aa2b-4a3c-8055-18ab566679fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:59.415745 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cbb462-aa2b-4a3c-8055-18ab566679fb admin admin] PATH_INFO: `/v3/projects/dd7f2a111d1d49b98167211981668ff3/users/f534976f766745b6ae387bc7ea73cc28/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:59.418568 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cbb462-aa2b-4a3c-8055-18ab566679fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd7f2a111d1d49b98167211981668ff3, user_id=f534976f766745b6ae387bc7ea73cc28, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:59.421274 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cbb462-aa2b-4a3c-8055-18ab566679fb admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:59.433076 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 963/1941] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:12:59 2022] PUT /identity/v3/projects/dd7f2a111d1d49b98167211981668ff3/users/f534976f766745b6ae387bc7ea73cc28/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:59.444994 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb7486-1b60-483c-bf57-33cbd2603bae None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:59.445533 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb7486-1b60-483c-bf57-33cbd2603bae None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:59.445636 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb7486-1b60-483c-bf57-33cbd2603bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:59.472842 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-17cb7486-1b60-483c-bf57-33cbd2603bae None None] MFA Rules not processed for user `f534976f766745b6ae387bc7ea73cc28`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:59.474051 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-17cb7486-1b60-483c-bf57-33cbd2603bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:59.555070 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 979/1942] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:12:59 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:59.566737 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cbb462-aa2b-4a3c-8055-18ab566679fb admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:59.568676 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-37cbb462-aa2b-4a3c-8055-18ab566679fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:59.642789 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cbb462-aa2b-4a3c-8055-18ab566679fb admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:59.647393 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed1640-83ce-4afc-87fd-bca164b75ed5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:59.648142 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed1640-83ce-4afc-87fd-bca164b75ed5 service cinder] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:59.648486 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed1640-83ce-4afc-87fd-bca164b75ed5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:59.648862 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed1640-83ce-4afc-87fd-bca164b75ed5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:59.725286 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed1640-83ce-4afc-87fd-bca164b75ed5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:59.726777 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed1640-83ce-4afc-87fd-bca164b75ed5 service cinder] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:59.737674 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 964/1943] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:12:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:02.367053 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb7486-1b60-483c-bf57-33cbd2603bae None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:02.379045 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb7486-1b60-483c-bf57-33cbd2603bae None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:02.382587 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b968cbd3-f61f-49f9-8c35-acaea3d61e57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:02.383236 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b968cbd3-f61f-49f9-8c35-acaea3d61e57 service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:02.383515 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b968cbd3-f61f-49f9-8c35-acaea3d61e57 service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:02.383794 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b968cbd3-f61f-49f9-8c35-acaea3d61e57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:02.443600 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b968cbd3-f61f-49f9-8c35-acaea3d61e57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:02.445078 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b968cbd3-f61f-49f9-8c35-acaea3d61e57 service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:02.455227 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 980/1944] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:13:03.040898 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed1640-83ce-4afc-87fd-bca164b75ed5 service cinder] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:03.042698 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-62ed1640-83ce-4afc-87fd-bca164b75ed5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:03.059222 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed1640-83ce-4afc-87fd-bca164b75ed5 service cinder] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:03.065970 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e681a3f-94c1-4e69-91df-a59c936798ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:03.066769 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e681a3f-94c1-4e69-91df-a59c936798ff service cinder] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:03.067158 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e681a3f-94c1-4e69-91df-a59c936798ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:03.068882 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e681a3f-94c1-4e69-91df-a59c936798ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:03.088620 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e681a3f-94c1-4e69-91df-a59c936798ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:03.090100 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e681a3f-94c1-4e69-91df-a59c936798ff service cinder] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:03.103514 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 965/1945] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:03 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:06.511564 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b968cbd3-f61f-49f9-8c35-acaea3d61e57 service cinder] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:06.513759 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-b968cbd3-f61f-49f9-8c35-acaea3d61e57 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:06.594639 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b968cbd3-f61f-49f9-8c35-acaea3d61e57 service cinder] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:06.601692 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4801f7-bc6a-4340-8155-5c933383284e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:06.604060 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4801f7-bc6a-4340-8155-5c933383284e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:06.604590 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4801f7-bc6a-4340-8155-5c933383284e admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:06.605107 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4801f7-bc6a-4340-8155-5c933383284e admin admin] PATH_INFO: `/v3/users/60f2041a29024af4b33c32cae300f95b` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:06.607259 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4801f7-bc6a-4340-8155-5c933383284e admin admin] RBAC: Authorizing `identity:delete_user(user_id=60f2041a29024af4b33c32cae300f95b)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:06.609474 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4801f7-bc6a-4340-8155-5c933383284e admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:06.615425 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:06.670550 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-cf4801f7-bc6a-4340-8155-5c933383284e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60f2041a29024af4b33c32cae300f95b'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:06.685471 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-cf4801f7-bc6a-4340-8155-5c933383284e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60f2041a29024af4b33c32cae300f95b'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:06.694958 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-cf4801f7-bc6a-4340-8155-5c933383284e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60f2041a29024af4b33c32cae300f95b'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:06.710878 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-cf4801f7-bc6a-4340-8155-5c933383284e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60f2041a29024af4b33c32cae300f95b'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:06.711677 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-cf4801f7-bc6a-4340-8155-5c933383284e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60f2041a29024af4b33c32cae300f95b'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:06.717887 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 981/1946] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:13:06 2022] DELETE /identity/v3/users/60f2041a29024af4b33c32cae300f95b => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:06.722404 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa728ad-92a9-4978-9dcf-565833065310 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:06.722873 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa728ad-92a9-4978-9dcf-565833065310 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:06.723102 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa728ad-92a9-4978-9dcf-565833065310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:06.742446 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-3aa728ad-92a9-4978-9dcf-565833065310 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:06.743800 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-3aa728ad-92a9-4978-9dcf-565833065310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:06.808047 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 966/1947] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:13:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:06.819880 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4801f7-bc6a-4340-8155-5c933383284e admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:06.821439 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-cf4801f7-bc6a-4340-8155-5c933383284e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:06.883792 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4801f7-bc6a-4340-8155-5c933383284e admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:06.887357 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de2f02-0f1f-4b7d-bb63-285ab5c19e95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:06.888001 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de2f02-0f1f-4b7d-bb63-285ab5c19e95 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:06.888282 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de2f02-0f1f-4b7d-bb63-285ab5c19e95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:06.888558 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de2f02-0f1f-4b7d-bb63-285ab5c19e95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:06.898664 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8de2f02-0f1f-4b7d-bb63-285ab5c19e95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:06.900119 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8de2f02-0f1f-4b7d-bb63-285ab5c19e95 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:06.910523 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 982/1948] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:13:07.139449 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa728ad-92a9-4978-9dcf-565833065310 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:07.140944 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-3aa728ad-92a9-4978-9dcf-565833065310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:07.157740 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa728ad-92a9-4978-9dcf-565833065310 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:07.172672 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26c33ee-eb2b-4ae1-9f9a-07e6a1242e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:07.192910 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c33ee-eb2b-4ae1-9f9a-07e6a1242e70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:07.193903 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c33ee-eb2b-4ae1-9f9a-07e6a1242e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:07.194891 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c33ee-eb2b-4ae1-9f9a-07e6a1242e70 admin admin] PATH_INFO: `/v3/users/2c8ac0fc751d4bc0a966332ba562cef1` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:07.202624 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26c33ee-eb2b-4ae1-9f9a-07e6a1242e70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c8ac0fc751d4bc0a966332ba562cef1)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:07.211117 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26c33ee-eb2b-4ae1-9f9a-07e6a1242e70 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:07.231513 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:07.340827 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-b26c33ee-eb2b-4ae1-9f9a-07e6a1242e70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c8ac0fc751d4bc0a966332ba562cef1'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:07.394708 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-b26c33ee-eb2b-4ae1-9f9a-07e6a1242e70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c8ac0fc751d4bc0a966332ba562cef1'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:07.394708 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-b26c33ee-eb2b-4ae1-9f9a-07e6a1242e70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c8ac0fc751d4bc0a966332ba562cef1'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:07.395294 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-b26c33ee-eb2b-4ae1-9f9a-07e6a1242e70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c8ac0fc751d4bc0a966332ba562cef1'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:07.396360 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de2f02-0f1f-4b7d-bb63-285ab5c19e95 service neutron] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:07.397785 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-d8de2f02-0f1f-4b7d-bb63-285ab5c19e95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:07.411161 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-b26c33ee-eb2b-4ae1-9f9a-07e6a1242e70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c8ac0fc751d4bc0a966332ba562cef1'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:07.412036 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de2f02-0f1f-4b7d-bb63-285ab5c19e95 service neutron] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:07.419473 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee2f95-9068-489e-83c2-f14d237a26c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:07.425404 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 967/1949] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:13:07 2022] DELETE /identity/v3/users/2c8ac0fc751d4bc0a966332ba562cef1 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:07.429929 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b12bd-6e9f-4d68-8f45-58ec14875532 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:07.430285 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b12bd-6e9f-4d68-8f45-58ec14875532 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:07.430634 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b12bd-6e9f-4d68-8f45-58ec14875532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:07.433324 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee2f95-9068-489e-83c2-f14d237a26c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:07.433627 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee2f95-9068-489e-83c2-f14d237a26c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:07.434009 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee2f95-9068-489e-83c2-f14d237a26c9 admin admin] PATH_INFO: `/v3/projects/0b6403e33fd841ff932a8bf1b2aad874` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:07.436687 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bee2f95-9068-489e-83c2-f14d237a26c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b6403e33fd841ff932a8bf1b2aad874)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:07.439117 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bee2f95-9068-489e-83c2-f14d237a26c9 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:07.467511 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-6b6b12bd-6e9f-4d68-8f45-58ec14875532 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:07.469790 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-6b6b12bd-6e9f-4d68-8f45-58ec14875532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:07.517980 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-9bee2f95-9068-489e-83c2-f14d237a26c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b6403e33fd841ff932a8bf1b2aad874', 'request_id': 'req-9bee2f95-9068-489e-83c2-f14d237a26c9'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:07.547232 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-9bee2f95-9068-489e-83c2-f14d237a26c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b6403e33fd841ff932a8bf1b2aad874', 'request_id': 'req-9bee2f95-9068-489e-83c2-f14d237a26c9'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:07.556538 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-9bee2f95-9068-489e-83c2-f14d237a26c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b6403e33fd841ff932a8bf1b2aad874', 'request_id': 'req-9bee2f95-9068-489e-83c2-f14d237a26c9'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:07.562969 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 968/1950] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:13:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:13:07.570400 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b12bd-6e9f-4d68-8f45-58ec14875532 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:07.570855 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-9bee2f95-9068-489e-83c2-f14d237a26c9 admin admin] The token cache is being invalidate because project 0b6403e33fd841ff932a8bf1b2aad874 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:13:07.571314 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-9bee2f95-9068-489e-83c2-f14d237a26c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:07.571978 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-6b6b12bd-6e9f-4d68-8f45-58ec14875532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:07.572372 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-9bee2f95-9068-489e-83c2-f14d237a26c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:07.574472 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 983/1951] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:13:07 2022] DELETE /identity/v3/projects/0b6403e33fd841ff932a8bf1b2aad874 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:07.582412 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ed925-f50a-4d84-ae66-34bfac3ea1ed None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:07.582918 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ed925-f50a-4d84-ae66-34bfac3ea1ed None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:07.583424 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ed925-f50a-4d84-ae66-34bfac3ea1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:07.607947 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-6d0ed925-f50a-4d84-ae66-34bfac3ea1ed None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:07.610126 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-6d0ed925-f50a-4d84-ae66-34bfac3ea1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:07.615521 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:07.679893 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b12bd-6e9f-4d68-8f45-58ec14875532 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:07.706043 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 984/1952] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:13:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:13:07.714727 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678337a-2ed4-4d33-a5fb-618b59785b40 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:07.716876 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678337a-2ed4-4d33-a5fb-618b59785b40 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:07.717202 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678337a-2ed4-4d33-a5fb-618b59785b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:07.755037 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-2678337a-2ed4-4d33-a5fb-618b59785b40 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:07.756439 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-2678337a-2ed4-4d33-a5fb-618b59785b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:07.764509 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:07.769673 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 985/1953] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:13:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:07.771362 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2678337a-2ed4-4d33-a5fb-618b59785b40 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:07.774995 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dbd39e-5173-41f0-bedb-bda80f9f0ecb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:07.775927 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbd39e-5173-41f0-bedb-bda80f9f0ecb service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:07.783480 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbd39e-5173-41f0-bedb-bda80f9f0ecb service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:07.785438 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbd39e-5173-41f0-bedb-bda80f9f0ecb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:07.787415 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-22dbd39e-5173-41f0-bedb-bda80f9f0ecb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:07.790396 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2678337a-2ed4-4d33-a5fb-618b59785b40 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:07.798408 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d4045-6ea9-4458-bf22-e6879fdae995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:07.800033 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d4045-6ea9-4458-bf22-e6879fdae995 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:07.801071 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d4045-6ea9-4458-bf22-e6879fdae995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:07.801555 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d4045-6ea9-4458-bf22-e6879fdae995 admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:07.803107 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d4045-6ea9-4458-bf22-e6879fdae995 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:13:07.803720 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d4045-6ea9-4458-bf22-e6879fdae995 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:07.806028 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dbd39e-5173-41f0-bedb-bda80f9f0ecb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:07.806442 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d4045-6ea9-4458-bf22-e6879fdae995 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:07.807931 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dbd39e-5173-41f0-bedb-bda80f9f0ecb service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:07.820019 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 969/1954] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:13:07.821409 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 986/1955] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:13:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:13:07.828370 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dbd39e-5173-41f0-bedb-bda80f9f0ecb service neutron] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:07.839920 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dbd39e-5173-41f0-bedb-bda80f9f0ecb service neutron] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:07.845321 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612e924-2e42-482e-8dce-67740a646557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:07.846113 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612e924-2e42-482e-8dce-67740a646557 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:07.846396 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612e924-2e42-482e-8dce-67740a646557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:07.846668 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612e924-2e42-482e-8dce-67740a646557 admin admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:07.847366 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3612e924-2e42-482e-8dce-67740a646557 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:07.849307 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3612e924-2e42-482e-8dce-67740a646557 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:07.890247 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 970/1956] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:13:07 2022] POST /identity/v3/projects => generated 369 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:13:07.895023 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d4045-6ea9-4458-bf22-e6879fdae995 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:07.912036 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d4045-6ea9-4458-bf22-e6879fdae995 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:07.986291 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd236e7-c145-4f51-a67d-563515ac29ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:07.987308 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd236e7-c145-4f51-a67d-563515ac29ba admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:07.987439 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd236e7-c145-4f51-a67d-563515ac29ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:07.987929 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd236e7-c145-4f51-a67d-563515ac29ba admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:07.988425 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd236e7-c145-4f51-a67d-563515ac29ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:07.990610 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd236e7-c145-4f51-a67d-563515ac29ba admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:08.018537 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612e924-2e42-482e-8dce-67740a646557 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:08.018933 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 987/1957] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:13:07 2022] POST /identity/v3/users => generated 285 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:08.035952 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612e924-2e42-482e-8dce-67740a646557 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:08.042147 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f628a17-16bb-40fe-9913-e9829097a0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:08.042949 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f628a17-16bb-40fe-9913-e9829097a0ad admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:08.043303 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f628a17-16bb-40fe-9913-e9829097a0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:08.043650 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f628a17-16bb-40fe-9913-e9829097a0ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:08.044463 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f628a17-16bb-40fe-9913-e9829097a0ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:08.046523 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f628a17-16bb-40fe-9913-e9829097a0ad admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:08.060130 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 971/1958] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:08 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:13:08.064475 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd236e7-c145-4f51-a67d-563515ac29ba admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:08.076207 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd236e7-c145-4f51-a67d-563515ac29ba admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:08.081647 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aaa131-c6b8-4e00-810d-8bfa67fe3eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:08.082344 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aaa131-c6b8-4e00-810d-8bfa67fe3eeb admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:08.082756 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aaa131-c6b8-4e00-810d-8bfa67fe3eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:08.083271 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aaa131-c6b8-4e00-810d-8bfa67fe3eeb admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:08.083794 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aaa131-c6b8-4e00-810d-8bfa67fe3eeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:08.085446 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aaa131-c6b8-4e00-810d-8bfa67fe3eeb admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:08.103264 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 988/1959] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:08.104455 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f628a17-16bb-40fe-9913-e9829097a0ad admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:08.120568 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f628a17-16bb-40fe-9913-e9829097a0ad admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:08.128423 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdefd86-64f1-42cd-9a64-fe7deb38739e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:08.129888 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdefd86-64f1-42cd-9a64-fe7deb38739e admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:08.130316 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdefd86-64f1-42cd-9a64-fe7deb38739e admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:08.130728 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdefd86-64f1-42cd-9a64-fe7deb38739e admin admin] PATH_INFO: `/v3/projects/d3f1bdea2fac49c289b00445415ac293/users/38af438e8812403d93cb4a41947d7e39/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:08.151488 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdefd86-64f1-42cd-9a64-fe7deb38739e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3f1bdea2fac49c289b00445415ac293, user_id=38af438e8812403d93cb4a41947d7e39, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:08.155367 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdefd86-64f1-42cd-9a64-fe7deb38739e admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:08.180306 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 972/1960] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:13:08 2022] PUT /identity/v3/projects/d3f1bdea2fac49c289b00445415ac293/users/38af438e8812403d93cb4a41947d7e39/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:08.191170 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e696a39-51d2-4beb-a45c-80e84bb1623d None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:08.191462 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e696a39-51d2-4beb-a45c-80e84bb1623d None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:08.191746 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e696a39-51d2-4beb-a45c-80e84bb1623d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:08.221701 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-2e696a39-51d2-4beb-a45c-80e84bb1623d None None] MFA Rules not processed for user `38af438e8812403d93cb4a41947d7e39`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:08.222858 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-2e696a39-51d2-4beb-a45c-80e84bb1623d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:08.311410 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:08.320243 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 989/1961] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:13:08 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:08.332004 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdefd86-64f1-42cd-9a64-fe7deb38739e admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:08.333874 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-8cdefd86-64f1-42cd-9a64-fe7deb38739e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:08.441824 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdefd86-64f1-42cd-9a64-fe7deb38739e admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:08.457921 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e696a39-51d2-4beb-a45c-80e84bb1623d None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:08.459386 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-2e696a39-51d2-4beb-a45c-80e84bb1623d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:08.465560 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628ce26-d966-436c-ab0a-1dee700289ba service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cb22811a754357ab9d839b70d44261', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:08.466485 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628ce26-d966-436c-ab0a-1dee700289ba service glance] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:08.466915 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628ce26-d966-436c-ab0a-1dee700289ba service glance] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:08.467335 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628ce26-d966-436c-ab0a-1dee700289ba service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:08.486977 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628ce26-d966-436c-ab0a-1dee700289ba service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:08.489194 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628ce26-d966-436c-ab0a-1dee700289ba service glance] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:08.505162 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 973/1962] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:08 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:08.550721 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628ce26-d966-436c-ab0a-1dee700289ba service glance] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:08.552205 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e696a39-51d2-4beb-a45c-80e84bb1623d None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:08.552719 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-a628ce26-d966-436c-ab0a-1dee700289ba service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:08.558352 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc0788-5576-47b5-8be0-cb12794d188c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:08.559229 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc0788-5576-47b5-8be0-cb12794d188c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:08.559581 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc0788-5576-47b5-8be0-cb12794d188c admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:08.559861 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc0788-5576-47b5-8be0-cb12794d188c admin admin] PATH_INFO: `/v3/projects/fda832c44b6640b591119f4bffcfe82e` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:08.561149 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bc0788-5576-47b5-8be0-cb12794d188c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fda832c44b6640b591119f4bffcfe82e)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:08.565020 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bc0788-5576-47b5-8be0-cb12794d188c admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:08.578495 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628ce26-d966-436c-ab0a-1dee700289ba service glance] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:08.584357 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214655e-2c84-4d28-a7dd-58c3d3ec80cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:08.585573 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214655e-2c84-4d28-a7dd-58c3d3ec80cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:08.585852 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214655e-2c84-4d28-a7dd-58c3d3ec80cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:08.586125 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214655e-2c84-4d28-a7dd-58c3d3ec80cb admin admin] PATH_INFO: `/v3/users/8f811cc65238425a85c2f8c5828984d7` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:08.587367 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9214655e-2c84-4d28-a7dd-58c3d3ec80cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f811cc65238425a85c2f8c5828984d7)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:08.590013 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9214655e-2c84-4d28-a7dd-58c3d3ec80cb admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:08.643863 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-16bc0788-5576-47b5-8be0-cb12794d188c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fda832c44b6640b591119f4bffcfe82e', 'request_id': 'req-16bc0788-5576-47b5-8be0-cb12794d188c'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:08.650082 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-16bc0788-5576-47b5-8be0-cb12794d188c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fda832c44b6640b591119f4bffcfe82e', 'request_id': 'req-16bc0788-5576-47b5-8be0-cb12794d188c'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:08.659106 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-16bc0788-5576-47b5-8be0-cb12794d188c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fda832c44b6640b591119f4bffcfe82e', 'request_id': 'req-16bc0788-5576-47b5-8be0-cb12794d188c'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:08.672634 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-16bc0788-5576-47b5-8be0-cb12794d188c admin admin] The token cache is being invalidate because project fda832c44b6640b591119f4bffcfe82e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:13:08.673071 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-16bc0788-5576-47b5-8be0-cb12794d188c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:08.673721 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-16bc0788-5576-47b5-8be0-cb12794d188c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:08.675388 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 990/1963] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:13:08 2022] DELETE /identity/v3/projects/fda832c44b6640b591119f4bffcfe82e => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:13:08.679313 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc0788-5576-47b5-8be0-cb12794d188c admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:08.680940 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-16bc0788-5576-47b5-8be0-cb12794d188c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:08.694904 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-9214655e-2c84-4d28-a7dd-58c3d3ec80cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f811cc65238425a85c2f8c5828984d7'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:08.704612 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-9214655e-2c84-4d28-a7dd-58c3d3ec80cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f811cc65238425a85c2f8c5828984d7'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:08.705645 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-9214655e-2c84-4d28-a7dd-58c3d3ec80cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f811cc65238425a85c2f8c5828984d7'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:08.707002 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-9214655e-2c84-4d28-a7dd-58c3d3ec80cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f811cc65238425a85c2f8c5828984d7'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:08.728578 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-9214655e-2c84-4d28-a7dd-58c3d3ec80cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f811cc65238425a85c2f8c5828984d7'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:08.747535 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 974/1964] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:13:08 2022] DELETE /identity/v3/users/8f811cc65238425a85c2f8c5828984d7 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:08.761500 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc0788-5576-47b5-8be0-cb12794d188c admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:08.808091 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:08.850004 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b42d5-5350-4144-add9-2c725f2df7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:08.850939 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b42d5-5350-4144-add9-2c725f2df7fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:08.851163 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b42d5-5350-4144-add9-2c725f2df7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:08.851436 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b42d5-5350-4144-add9-2c725f2df7fa admin admin] PATH_INFO: `/v3/users/fa2905b5bc3e43179a46c37461b7eb4c` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:08.853618 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b42d5-5350-4144-add9-2c725f2df7fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa2905b5bc3e43179a46c37461b7eb4c)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:08.856329 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b42d5-5350-4144-add9-2c725f2df7fa admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:08.938295 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-4f9b42d5-5350-4144-add9-2c725f2df7fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa2905b5bc3e43179a46c37461b7eb4c'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:08.953757 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-4f9b42d5-5350-4144-add9-2c725f2df7fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa2905b5bc3e43179a46c37461b7eb4c'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:08.966277 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-4f9b42d5-5350-4144-add9-2c725f2df7fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa2905b5bc3e43179a46c37461b7eb4c'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:08.973713 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214655e-2c84-4d28-a7dd-58c3d3ec80cb admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:08.975487 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-9214655e-2c84-4d28-a7dd-58c3d3ec80cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:08.992147 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214655e-2c84-4d28-a7dd-58c3d3ec80cb admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:08.994099 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-4f9b42d5-5350-4144-add9-2c725f2df7fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa2905b5bc3e43179a46c37461b7eb4c'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:08.994983 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-4f9b42d5-5350-4144-add9-2c725f2df7fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa2905b5bc3e43179a46c37461b7eb4c'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:08.997945 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a971c-a395-4a07-8fc3-4b8954c46fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:08.998908 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a971c-a395-4a07-8fc3-4b8954c46fea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:08.999108 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a971c-a395-4a07-8fc3-4b8954c46fea admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:08.999364 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a971c-a395-4a07-8fc3-4b8954c46fea admin admin] PATH_INFO: `/v3/projects/a1c5be30cc344f1cacb822eb5b55d461` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:09.001326 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74a971c-a395-4a07-8fc3-4b8954c46fea admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1c5be30cc344f1cacb822eb5b55d461)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:09.005681 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 991/1965] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:13:08 2022] DELETE /identity/v3/users/fa2905b5bc3e43179a46c37461b7eb4c => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:13:09.005913 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74a971c-a395-4a07-8fc3-4b8954c46fea admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:09.006527 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:09.080139 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-d74a971c-a395-4a07-8fc3-4b8954c46fea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1c5be30cc344f1cacb822eb5b55d461', 'request_id': 'req-d74a971c-a395-4a07-8fc3-4b8954c46fea'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:09.093383 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-d74a971c-a395-4a07-8fc3-4b8954c46fea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1c5be30cc344f1cacb822eb5b55d461', 'request_id': 'req-d74a971c-a395-4a07-8fc3-4b8954c46fea'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:09.106926 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-d74a971c-a395-4a07-8fc3-4b8954c46fea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1c5be30cc344f1cacb822eb5b55d461', 'request_id': 'req-d74a971c-a395-4a07-8fc3-4b8954c46fea'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:09.127585 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-d74a971c-a395-4a07-8fc3-4b8954c46fea admin admin] The token cache is being invalidate because project a1c5be30cc344f1cacb822eb5b55d461 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:13:09.127957 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-d74a971c-a395-4a07-8fc3-4b8954c46fea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:09.128865 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-d74a971c-a395-4a07-8fc3-4b8954c46fea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:09.130800 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 975/1966] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:13:08 2022] DELETE /identity/v3/projects/a1c5be30cc344f1cacb822eb5b55d461 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:13:09.135800 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782fe823-73c9-405e-82d6-53629e6cbced None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:09.136338 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782fe823-73c9-405e-82d6-53629e6cbced None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:09.136850 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782fe823-73c9-405e-82d6-53629e6cbced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:09.158635 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-782fe823-73c9-405e-82d6-53629e6cbced None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:09.159924 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-782fe823-73c9-405e-82d6-53629e6cbced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:09.226607 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 992/1967] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:13:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:09.235156 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a464bf-dea7-4c09-8dcd-217391001a70 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:09.235470 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a464bf-dea7-4c09-8dcd-217391001a70 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:09.236000 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a464bf-dea7-4c09-8dcd-217391001a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:09.255041 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-a2a464bf-dea7-4c09-8dcd-217391001a70 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:09.256431 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-a2a464bf-dea7-4c09-8dcd-217391001a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:09.266476 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 976/1968] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:13:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:09.270247 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782fe823-73c9-405e-82d6-53629e6cbced None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:09.280222 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782fe823-73c9-405e-82d6-53629e6cbced None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:09.285032 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17267790-e91b-48dd-9c0d-0dd4e337a123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:09.285692 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17267790-e91b-48dd-9c0d-0dd4e337a123 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:09.286194 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17267790-e91b-48dd-9c0d-0dd4e337a123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:09.286480 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17267790-e91b-48dd-9c0d-0dd4e337a123 admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:09.287220 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17267790-e91b-48dd-9c0d-0dd4e337a123 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:13:09.287526 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17267790-e91b-48dd-9c0d-0dd4e337a123 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:09.289376 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17267790-e91b-48dd-9c0d-0dd4e337a123 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:09.305969 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 993/1969] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:13:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:13:09.307105 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a464bf-dea7-4c09-8dcd-217391001a70 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:09.317733 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a464bf-dea7-4c09-8dcd-217391001a70 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:09.324166 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa082125-2228-48c8-a69f-fb7e97f7f3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:09.324852 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa082125-2228-48c8-a69f-fb7e97f7f3f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:09.325138 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa082125-2228-48c8-a69f-fb7e97f7f3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:09.325412 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa082125-2228-48c8-a69f-fb7e97f7f3f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:09.326195 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa082125-2228-48c8-a69f-fb7e97f7f3f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:09.328656 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa082125-2228-48c8-a69f-fb7e97f7f3f3 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:09.338675 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17267790-e91b-48dd-9c0d-0dd4e337a123 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:09.340862 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-17267790-e91b-48dd-9c0d-0dd4e337a123 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:09.362251 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17267790-e91b-48dd-9c0d-0dd4e337a123 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:09.367336 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad2c7f-fb39-4e34-8b43-f9f93451fddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:09.368011 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 977/1970] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:13:09 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:13:09.368172 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad2c7f-fb39-4e34-8b43-f9f93451fddf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:09.368434 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad2c7f-fb39-4e34-8b43-f9f93451fddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:09.368730 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad2c7f-fb39-4e34-8b43-f9f93451fddf admin admin] PATH_INFO: `/v3/projects/c5eeb5ec24ca466a869c7a070d509af4` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:09.370006 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad2c7f-fb39-4e34-8b43-f9f93451fddf admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5eeb5ec24ca466a869c7a070d509af4)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:09.371921 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad2c7f-fb39-4e34-8b43-f9f93451fddf admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:09.372026 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa082125-2228-48c8-a69f-fb7e97f7f3f3 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:09.426914 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:09.456345 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-2bad2c7f-fb39-4e34-8b43-f9f93451fddf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5eeb5ec24ca466a869c7a070d509af4', 'request_id': 'req-2bad2c7f-fb39-4e34-8b43-f9f93451fddf'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:09.466006 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-2bad2c7f-fb39-4e34-8b43-f9f93451fddf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5eeb5ec24ca466a869c7a070d509af4', 'request_id': 'req-2bad2c7f-fb39-4e34-8b43-f9f93451fddf'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:09.471607 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa082125-2228-48c8-a69f-fb7e97f7f3f3 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:09.478530 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-2bad2c7f-fb39-4e34-8b43-f9f93451fddf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5eeb5ec24ca466a869c7a070d509af4', 'request_id': 'req-2bad2c7f-fb39-4e34-8b43-f9f93451fddf'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:09.494436 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-2bad2c7f-fb39-4e34-8b43-f9f93451fddf admin admin] The token cache is being invalidate because project c5eeb5ec24ca466a869c7a070d509af4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:13:09.494673 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-2bad2c7f-fb39-4e34-8b43-f9f93451fddf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:09.495314 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-2bad2c7f-fb39-4e34-8b43-f9f93451fddf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:09.501967 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 994/1971] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:13:09 2022] DELETE /identity/v3/projects/c5eeb5ec24ca466a869c7a070d509af4 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:13:09.508259 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad2c7f-fb39-4e34-8b43-f9f93451fddf admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:09.509643 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-2bad2c7f-fb39-4e34-8b43-f9f93451fddf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:09.540971 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc97af-6da1-4266-92fd-8852ed6e4975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:09.541667 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc97af-6da1-4266-92fd-8852ed6e4975 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:09.541936 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc97af-6da1-4266-92fd-8852ed6e4975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:09.542210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc97af-6da1-4266-92fd-8852ed6e4975 admin admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:09.542903 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebc97af-6da1-4266-92fd-8852ed6e4975 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:09.544848 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebc97af-6da1-4266-92fd-8852ed6e4975 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:09.563976 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:09.572872 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 978/1972] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:13:09 2022] POST /identity/v3/users => generated 287 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:13:09.575558 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc97af-6da1-4266-92fd-8852ed6e4975 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:09.577785 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-8ebc97af-6da1-4266-92fd-8852ed6e4975 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:09.580922 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad2c7f-fb39-4e34-8b43-f9f93451fddf admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:09.586462 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce472dd-3160-4b9d-9c41-d8ae93896f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:09.587373 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce472dd-3160-4b9d-9c41-d8ae93896f5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:09.587654 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce472dd-3160-4b9d-9c41-d8ae93896f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:09.587927 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce472dd-3160-4b9d-9c41-d8ae93896f5d admin admin] PATH_INFO: `/v3/users/f534976f766745b6ae387bc7ea73cc28` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:09.589206 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce472dd-3160-4b9d-9c41-d8ae93896f5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f534976f766745b6ae387bc7ea73cc28)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:09.591273 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce472dd-3160-4b9d-9c41-d8ae93896f5d admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:09.594248 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc97af-6da1-4266-92fd-8852ed6e4975 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:09.599270 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed7fd8-2074-4663-b70d-ff4d456a112e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:09.600598 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed7fd8-2074-4663-b70d-ff4d456a112e admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:09.601011 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed7fd8-2074-4663-b70d-ff4d456a112e admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:09.601362 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed7fd8-2074-4663-b70d-ff4d456a112e admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:09.602317 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ed7fd8-2074-4663-b70d-ff4d456a112e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:09.604382 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ed7fd8-2074-4663-b70d-ff4d456a112e admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:09.617961 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 979/1973] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:09.622547 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed7fd8-2074-4663-b70d-ff4d456a112e admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:09.634487 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed7fd8-2074-4663-b70d-ff4d456a112e admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:09.640432 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd1163-fb8a-443a-a7c4-728b47b82efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:09.641188 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd1163-fb8a-443a-a7c4-728b47b82efd admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:09.641478 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd1163-fb8a-443a-a7c4-728b47b82efd admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:09.642176 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd1163-fb8a-443a-a7c4-728b47b82efd admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:09.642479 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecd1163-fb8a-443a-a7c4-728b47b82efd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:09.644102 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecd1163-fb8a-443a-a7c4-728b47b82efd admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:09.648072 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-9ce472dd-3160-4b9d-9c41-d8ae93896f5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f534976f766745b6ae387bc7ea73cc28'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:09.656941 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-9ce472dd-3160-4b9d-9c41-d8ae93896f5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f534976f766745b6ae387bc7ea73cc28'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:09.663847 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 980/1974] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:09.668013 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd1163-fb8a-443a-a7c4-728b47b82efd admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:09.670097 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-9ce472dd-3160-4b9d-9c41-d8ae93896f5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f534976f766745b6ae387bc7ea73cc28'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:09.678726 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd1163-fb8a-443a-a7c4-728b47b82efd admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:09.683402 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df16450-0ad1-4ee9-8394-ad4b831baaf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:09.684285 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df16450-0ad1-4ee9-8394-ad4b831baaf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:09.684582 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df16450-0ad1-4ee9-8394-ad4b831baaf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:09.684873 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df16450-0ad1-4ee9-8394-ad4b831baaf2 admin admin] PATH_INFO: `/v3/projects/15af7e20eeb149b6a4b853aaa479f2ab/users/69badb3f3a684656b89b9ade1726a08c/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:09.685006 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-9ce472dd-3160-4b9d-9c41-d8ae93896f5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f534976f766745b6ae387bc7ea73cc28'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:09.685585 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-9ce472dd-3160-4b9d-9c41-d8ae93896f5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f534976f766745b6ae387bc7ea73cc28'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:09.697326 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 995/1975] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:13:09 2022] DELETE /identity/v3/users/f534976f766745b6ae387bc7ea73cc28 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:13:09.705757 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df16450-0ad1-4ee9-8394-ad4b831baaf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15af7e20eeb149b6a4b853aaa479f2ab, user_id=69badb3f3a684656b89b9ade1726a08c, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:09.708884 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df16450-0ad1-4ee9-8394-ad4b831baaf2 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:09.726769 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 981/1976] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:13:09 2022] PUT /identity/v3/projects/15af7e20eeb149b6a4b853aaa479f2ab/users/69badb3f3a684656b89b9ade1726a08c/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:13:09.742603 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5baaf5a-6238-4121-8c5c-bfd8b0b4fdd9 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:09.742603 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5baaf5a-6238-4121-8c5c-bfd8b0b4fdd9 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:09.742603 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5baaf5a-6238-4121-8c5c-bfd8b0b4fdd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:09.770866 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-f5baaf5a-6238-4121-8c5c-bfd8b0b4fdd9 None None] MFA Rules not processed for user `69badb3f3a684656b89b9ade1726a08c`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:09.772082 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-f5baaf5a-6238-4121-8c5c-bfd8b0b4fdd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:09.810004 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:09.847493 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 996/1977] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:13:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:09.858364 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df16450-0ad1-4ee9-8394-ad4b831baaf2 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:09.861836 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-7df16450-0ad1-4ee9-8394-ad4b831baaf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:09.945725 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df16450-0ad1-4ee9-8394-ad4b831baaf2 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:09.953195 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd24af5-cc6f-48ff-94ca-a7361e727b64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cee106502e54829ad802ee41c9165fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:09.955708 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd24af5-cc6f-48ff-94ca-a7361e727b64 service nova] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:09.955999 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd24af5-cc6f-48ff-94ca-a7361e727b64 service nova] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:09.956280 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd24af5-cc6f-48ff-94ca-a7361e727b64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:09.965921 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd24af5-cc6f-48ff-94ca-a7361e727b64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:09.969825 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd24af5-cc6f-48ff-94ca-a7361e727b64 service nova] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:09.979555 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 982/1978] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:10.081575 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5baaf5a-6238-4121-8c5c-bfd8b0b4fdd9 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:10.082978 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-f5baaf5a-6238-4121-8c5c-bfd8b0b4fdd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:10.175714 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5baaf5a-6238-4121-8c5c-bfd8b0b4fdd9 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:10.180423 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e016cfad-0647-400e-93f8-cefbcc27767d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:10.181377 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016cfad-0647-400e-93f8-cefbcc27767d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:10.181721 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016cfad-0647-400e-93f8-cefbcc27767d admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:10.182084 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016cfad-0647-400e-93f8-cefbcc27767d admin admin] PATH_INFO: `/v3/projects/dd7f2a111d1d49b98167211981668ff3` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:10.183346 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e016cfad-0647-400e-93f8-cefbcc27767d admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd7f2a111d1d49b98167211981668ff3)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:10.185605 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e016cfad-0647-400e-93f8-cefbcc27767d admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:10.219407 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd24af5-cc6f-48ff-94ca-a7361e727b64 service nova] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:10.221266 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-0bd24af5-cc6f-48ff-94ca-a7361e727b64 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:10.236026 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd24af5-cc6f-48ff-94ca-a7361e727b64 service nova] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:10.236827 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e016cfad-0647-400e-93f8-cefbcc27767d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd7f2a111d1d49b98167211981668ff3', 'request_id': 'req-e016cfad-0647-400e-93f8-cefbcc27767d'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:10.242594 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e016cfad-0647-400e-93f8-cefbcc27767d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd7f2a111d1d49b98167211981668ff3', 'request_id': 'req-e016cfad-0647-400e-93f8-cefbcc27767d'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:10.250748 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e016cfad-0647-400e-93f8-cefbcc27767d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd7f2a111d1d49b98167211981668ff3', 'request_id': 'req-e016cfad-0647-400e-93f8-cefbcc27767d'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:10.263012 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e016cfad-0647-400e-93f8-cefbcc27767d admin admin] The token cache is being invalidate because project dd7f2a111d1d49b98167211981668ff3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:13:10.263370 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e016cfad-0647-400e-93f8-cefbcc27767d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:10.264048 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e016cfad-0647-400e-93f8-cefbcc27767d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:10.265947 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 997/1979] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:13:10 2022] DELETE /identity/v3/projects/dd7f2a111d1d49b98167211981668ff3 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:10.270541 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4e49a-f6de-448f-aacf-4aff8add82ad None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:10.270853 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4e49a-f6de-448f-aacf-4aff8add82ad None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:10.271132 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4e49a-f6de-448f-aacf-4aff8add82ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:10.290896 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-68c4e49a-f6de-448f-aacf-4aff8add82ad None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:10.292855 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-68c4e49a-f6de-448f-aacf-4aff8add82ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:10.299757 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b96c665-f302-4d2c-b686-c77c3e02f8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:10.300630 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96c665-f302-4d2c-b686-c77c3e02f8f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:10.300986 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96c665-f302-4d2c-b686-c77c3e02f8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:10.301312 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96c665-f302-4d2c-b686-c77c3e02f8f2 admin admin] PATH_INFO: `/v3/users/69badb3f3a684656b89b9ade1726a08c` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:10.302585 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b96c665-f302-4d2c-b686-c77c3e02f8f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69badb3f3a684656b89b9ade1726a08c)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:10.304688 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b96c665-f302-4d2c-b686-c77c3e02f8f2 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:10.356119 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:10.357694 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 998/1980] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:13:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:10.364349 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-2b96c665-f302-4d2c-b686-c77c3e02f8f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69badb3f3a684656b89b9ade1726a08c'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:10.366608 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052a7a3-ab44-4b0a-84ea-1347263af7ca None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:10.366898 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052a7a3-ab44-4b0a-84ea-1347263af7ca None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:10.367180 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052a7a3-ab44-4b0a-84ea-1347263af7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:10.372023 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-2b96c665-f302-4d2c-b686-c77c3e02f8f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69badb3f3a684656b89b9ade1726a08c'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:10.372626 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-2b96c665-f302-4d2c-b686-c77c3e02f8f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69badb3f3a684656b89b9ade1726a08c'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:10.373254 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-2b96c665-f302-4d2c-b686-c77c3e02f8f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69badb3f3a684656b89b9ade1726a08c'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:10.375815 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:10.386175 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-2b96c665-f302-4d2c-b686-c77c3e02f8f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69badb3f3a684656b89b9ade1726a08c'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:10.387289 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-0052a7a3-ab44-4b0a-84ea-1347263af7ca None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:10.389314 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-0052a7a3-ab44-4b0a-84ea-1347263af7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:10.397329 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 999/1981] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:13:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:13:10.399357 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 983/1982] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:13:10 2022] DELETE /identity/v3/users/69badb3f3a684656b89b9ade1726a08c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:13:10.401523 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0052a7a3-ab44-4b0a-84ea-1347263af7ca None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:10.406586 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10e8af-7883-4cbc-85e8-d18d35f3715a None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:10.406845 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10e8af-7883-4cbc-85e8-d18d35f3715a None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:10.407274 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10e8af-7883-4cbc-85e8-d18d35f3715a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:10.412229 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0052a7a3-ab44-4b0a-84ea-1347263af7ca None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:10.426168 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-8b10e8af-7883-4cbc-85e8-d18d35f3715a None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:10.427341 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-8b10e8af-7883-4cbc-85e8-d18d35f3715a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:10.477941 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d68191-06e4-4cbe-8e4f-be200fba2d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:10.478649 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d68191-06e4-4cbe-8e4f-be200fba2d7a admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:10.478937 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d68191-06e4-4cbe-8e4f-be200fba2d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:10.479218 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d68191-06e4-4cbe-8e4f-be200fba2d7a admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:10.479985 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d68191-06e4-4cbe-8e4f-be200fba2d7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:13:10.480300 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d68191-06e4-4cbe-8e4f-be200fba2d7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:10.481945 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d68191-06e4-4cbe-8e4f-be200fba2d7a admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:10.492486 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 984/1983] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:13:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:10.498188 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1000/1984] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:13:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:13:10.499215 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10e8af-7883-4cbc-85e8-d18d35f3715a None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:10.502783 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d68191-06e4-4cbe-8e4f-be200fba2d7a admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:10.504648 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-26d68191-06e4-4cbe-8e4f-be200fba2d7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:10.508792 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10e8af-7883-4cbc-85e8-d18d35f3715a None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:10.513662 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d4be2-c2ac-41a6-8da7-f76236c4b6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:10.514257 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d4be2-c2ac-41a6-8da7-f76236c4b6c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:10.514537 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d4be2-c2ac-41a6-8da7-f76236c4b6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:10.514942 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d4be2-c2ac-41a6-8da7-f76236c4b6c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:10.515840 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6d4be2-c2ac-41a6-8da7-f76236c4b6c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:10.517940 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6d4be2-c2ac-41a6-8da7-f76236c4b6c1 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:10.552911 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 985/1985] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:13:10 2022] POST /identity/v3/projects => generated 399 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:13:10.557223 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d4be2-c2ac-41a6-8da7-f76236c4b6c1 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:10.581344 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d68191-06e4-4cbe-8e4f-be200fba2d7a admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:10.627307 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d4be2-c2ac-41a6-8da7-f76236c4b6c1 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:10.631916 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae3d79-7222-4b5e-9d2e-eb8bcf4ce78e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:10.632091 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd49385-9ee1-454d-9525-624985b00a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:10.632640 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae3d79-7222-4b5e-9d2e-eb8bcf4ce78e service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:10.632780 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd49385-9ee1-454d-9525-624985b00a7e admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:10.632952 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd49385-9ee1-454d-9525-624985b00a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:10.633045 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae3d79-7222-4b5e-9d2e-eb8bcf4ce78e service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:10.633226 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae3d79-7222-4b5e-9d2e-eb8bcf4ce78e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:10.633328 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd49385-9ee1-454d-9525-624985b00a7e admin admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:10.634005 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd49385-9ee1-454d-9525-624985b00a7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:10.636187 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd49385-9ee1-454d-9525-624985b00a7e admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:10.643363 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ae3d79-7222-4b5e-9d2e-eb8bcf4ce78e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:10.644841 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ae3d79-7222-4b5e-9d2e-eb8bcf4ce78e service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:10.655211 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1001/1986] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:13:10.657703 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 986/1987] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:13:10 2022] POST /identity/v3/users => generated 300 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:10.661590 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae3d79-7222-4b5e-9d2e-eb8bcf4ce78e service neutron] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:10.671954 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae3d79-7222-4b5e-9d2e-eb8bcf4ce78e service neutron] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:10.676807 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3142afb7-d88e-467c-8728-78ff4166a494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:10.677472 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142afb7-d88e-467c-8728-78ff4166a494 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:10.677784 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142afb7-d88e-467c-8728-78ff4166a494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:10.678079 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142afb7-d88e-467c-8728-78ff4166a494 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:10.678802 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3142afb7-d88e-467c-8728-78ff4166a494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:10.680412 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3142afb7-d88e-467c-8728-78ff4166a494 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:10.691467 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1002/1988] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:13:10.695988 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd49385-9ee1-454d-9525-624985b00a7e admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:10.708570 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd49385-9ee1-454d-9525-624985b00a7e admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:10.713690 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbae6c8-fccb-4d92-87ef-d71718c3093b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:10.714659 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbae6c8-fccb-4d92-87ef-d71718c3093b admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:10.714955 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbae6c8-fccb-4d92-87ef-d71718c3093b admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:10.715303 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbae6c8-fccb-4d92-87ef-d71718c3093b admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:10.716160 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbae6c8-fccb-4d92-87ef-d71718c3093b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:10.717914 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbae6c8-fccb-4d92-87ef-d71718c3093b admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:10.729543 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 987/1989] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:10.733689 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3142afb7-d88e-467c-8728-78ff4166a494 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:10.744604 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3142afb7-d88e-467c-8728-78ff4166a494 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:10.750193 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a3e229-9429-4607-9a3a-0404c67a3f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:10.751313 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3e229-9429-4607-9a3a-0404c67a3f4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:10.751633 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3e229-9429-4607-9a3a-0404c67a3f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:10.751936 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3e229-9429-4607-9a3a-0404c67a3f4c admin admin] PATH_INFO: `/v3/projects/1e2e2cfd7b9e42d09041686d66ed9712/users/849a7f34845840d0a804d6f4a1488a6b/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:10.771763 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a3e229-9429-4607-9a3a-0404c67a3f4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e2e2cfd7b9e42d09041686d66ed9712, user_id=849a7f34845840d0a804d6f4a1488a6b, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:10.774481 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a3e229-9429-4607-9a3a-0404c67a3f4c admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:10.790119 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1003/1990] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:13:10 2022] PUT /identity/v3/projects/1e2e2cfd7b9e42d09041686d66ed9712/users/849a7f34845840d0a804d6f4a1488a6b/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:10.804771 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b87652-7bbd-4630-98b8-c62a3ed676c8 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:10.805273 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b87652-7bbd-4630-98b8-c62a3ed676c8 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:10.805683 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b87652-7bbd-4630-98b8-c62a3ed676c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:10.842945 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-06b87652-7bbd-4630-98b8-c62a3ed676c8 None None] MFA Rules not processed for user `849a7f34845840d0a804d6f4a1488a6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:10.844270 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-06b87652-7bbd-4630-98b8-c62a3ed676c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:10.848621 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:10.915922 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 988/1991] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:13:10 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:10.929560 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a3e229-9429-4607-9a3a-0404c67a3f4c admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:10.932734 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-33a3e229-9429-4607-9a3a-0404c67a3f4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:10.958059 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b87652-7bbd-4630-98b8-c62a3ed676c8 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:10.958364 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:10.960584 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-06b87652-7bbd-4630-98b8-c62a3ed676c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:11.016831 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a3e229-9429-4607-9a3a-0404c67a3f4c admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:11.020990 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e5fb0c-9f2e-411a-a934-ac4e8ed95ae1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:11.021660 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5fb0c-9f2e-411a-a934-ac4e8ed95ae1 service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:11.021996 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5fb0c-9f2e-411a-a934-ac4e8ed95ae1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:11.022217 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5fb0c-9f2e-411a-a934-ac4e8ed95ae1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:11.031775 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e5fb0c-9f2e-411a-a934-ac4e8ed95ae1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:11.033276 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e5fb0c-9f2e-411a-a934-ac4e8ed95ae1 service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:11.048866 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1004/1992] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:10 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:11.052418 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b87652-7bbd-4630-98b8-c62a3ed676c8 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:11.062783 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54db4f6f-dbb0-4eb9-8fc3-7ef10287a2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:11.063674 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db4f6f-dbb0-4eb9-8fc3-7ef10287a2e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:11.063954 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db4f6f-dbb0-4eb9-8fc3-7ef10287a2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:11.064216 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db4f6f-dbb0-4eb9-8fc3-7ef10287a2e1 admin admin] PATH_INFO: `/v3/projects/15af7e20eeb149b6a4b853aaa479f2ab` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:11.065542 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54db4f6f-dbb0-4eb9-8fc3-7ef10287a2e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15af7e20eeb149b6a4b853aaa479f2ab)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:11.068392 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54db4f6f-dbb0-4eb9-8fc3-7ef10287a2e1 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:11.130631 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-54db4f6f-dbb0-4eb9-8fc3-7ef10287a2e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15af7e20eeb149b6a4b853aaa479f2ab', 'request_id': 'req-54db4f6f-dbb0-4eb9-8fc3-7ef10287a2e1'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:11.138709 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-54db4f6f-dbb0-4eb9-8fc3-7ef10287a2e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15af7e20eeb149b6a4b853aaa479f2ab', 'request_id': 'req-54db4f6f-dbb0-4eb9-8fc3-7ef10287a2e1'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:11.145410 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-54db4f6f-dbb0-4eb9-8fc3-7ef10287a2e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15af7e20eeb149b6a4b853aaa479f2ab', 'request_id': 'req-54db4f6f-dbb0-4eb9-8fc3-7ef10287a2e1'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:11.159195 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-54db4f6f-dbb0-4eb9-8fc3-7ef10287a2e1 admin admin] The token cache is being invalidate because project 15af7e20eeb149b6a4b853aaa479f2ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:13:11.159497 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-54db4f6f-dbb0-4eb9-8fc3-7ef10287a2e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:11.160173 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-54db4f6f-dbb0-4eb9-8fc3-7ef10287a2e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:11.166464 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 989/1993] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:13:10 2022] DELETE /identity/v3/projects/15af7e20eeb149b6a4b853aaa479f2ab => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:11.171272 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f27c92-398b-411f-b595-7da4ea516b78 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:11.171567 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f27c92-398b-411f-b595-7da4ea516b78 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:11.171845 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f27c92-398b-411f-b595-7da4ea516b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:11.195705 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-15f27c92-398b-411f-b595-7da4ea516b78 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:11.197031 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-15f27c92-398b-411f-b595-7da4ea516b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:11.272630 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1005/1994] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:13:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:13:11.281985 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d106cf3-e082-4c47-952c-bcd890de4e09 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:11.282654 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d106cf3-e082-4c47-952c-bcd890de4e09 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:11.283060 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d106cf3-e082-4c47-952c-bcd890de4e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:11.304620 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-6d106cf3-e082-4c47-952c-bcd890de4e09 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:11.305864 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-6d106cf3-e082-4c47-952c-bcd890de4e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:11.316253 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 990/1995] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:13:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:11.320536 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f27c92-398b-411f-b595-7da4ea516b78 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:11.331829 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f27c92-398b-411f-b595-7da4ea516b78 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:11.337530 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eb03bd-72df-4455-b414-26c720b4974c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:11.338310 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb03bd-72df-4455-b414-26c720b4974c admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:11.338898 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb03bd-72df-4455-b414-26c720b4974c admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:11.339248 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb03bd-72df-4455-b414-26c720b4974c admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:11.340062 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eb03bd-72df-4455-b414-26c720b4974c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:13:11.340481 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eb03bd-72df-4455-b414-26c720b4974c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:11.342569 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eb03bd-72df-4455-b414-26c720b4974c admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:11.356808 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1006/1996] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:13:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:13:11.362204 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d106cf3-e082-4c47-952c-bcd890de4e09 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:11.371591 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d106cf3-e082-4c47-952c-bcd890de4e09 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:11.378120 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1216bb7-7181-489f-a39d-2cdc20a804f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:11.378884 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1216bb7-7181-489f-a39d-2cdc20a804f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:11.379165 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1216bb7-7181-489f-a39d-2cdc20a804f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:11.379443 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1216bb7-7181-489f-a39d-2cdc20a804f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:11.380294 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1216bb7-7181-489f-a39d-2cdc20a804f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:11.382428 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1216bb7-7181-489f-a39d-2cdc20a804f8 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:11.411031 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 991/1997] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:13:11 2022] POST /identity/v3/projects => generated 407 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:11.416301 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eb03bd-72df-4455-b414-26c720b4974c admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:11.426754 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eb03bd-72df-4455-b414-26c720b4974c admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:11.496617 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226d0696-597a-4d3e-b0b3-b65030d10ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:11.497373 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d0696-597a-4d3e-b0b3-b65030d10ded admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:11.497652 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d0696-597a-4d3e-b0b3-b65030d10ded admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:11.498097 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d0696-597a-4d3e-b0b3-b65030d10ded admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:11.499116 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226d0696-597a-4d3e-b0b3-b65030d10ded admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:11.501925 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226d0696-597a-4d3e-b0b3-b65030d10ded admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:11.530946 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1007/1998] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:13:11 2022] POST /identity/v3/users => generated 304 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:13:11.537732 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1216bb7-7181-489f-a39d-2cdc20a804f8 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:11.551521 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1216bb7-7181-489f-a39d-2cdc20a804f8 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:11.556826 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aac059-8c01-4fc6-81c3-95cdb18ed29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:11.557530 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aac059-8c01-4fc6-81c3-95cdb18ed29a admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:11.557814 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aac059-8c01-4fc6-81c3-95cdb18ed29a admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:11.558088 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aac059-8c01-4fc6-81c3-95cdb18ed29a admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:11.558820 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aac059-8c01-4fc6-81c3-95cdb18ed29a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:11.560409 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aac059-8c01-4fc6-81c3-95cdb18ed29a admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:11.561966 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:11.576750 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 992/1999] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:11.577846 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226d0696-597a-4d3e-b0b3-b65030d10ded admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:11.588753 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226d0696-597a-4d3e-b0b3-b65030d10ded admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:11.594520 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265ef521-1942-448c-a710-f8d2bc7b6582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:11.595229 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ef521-1942-448c-a710-f8d2bc7b6582 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:11.595627 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ef521-1942-448c-a710-f8d2bc7b6582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:11.596117 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ef521-1942-448c-a710-f8d2bc7b6582 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:11.597649 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265ef521-1942-448c-a710-f8d2bc7b6582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:11.599279 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265ef521-1942-448c-a710-f8d2bc7b6582 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:11.611538 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1008/2000] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:13:11.615778 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aac059-8c01-4fc6-81c3-95cdb18ed29a admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:11.626933 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aac059-8c01-4fc6-81c3-95cdb18ed29a admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:11.632004 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d531e2b-0e6d-4738-b2bf-c7264ebe8517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:11.632954 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d531e2b-0e6d-4738-b2bf-c7264ebe8517 admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:11.633239 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d531e2b-0e6d-4738-b2bf-c7264ebe8517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:11.633518 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d531e2b-0e6d-4738-b2bf-c7264ebe8517 admin admin] PATH_INFO: `/v3/projects/c755ac1386754dbc8ccdb6677afc0bff/users/be4caee2b039454690828e508d276cc9/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:11.649728 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d531e2b-0e6d-4738-b2bf-c7264ebe8517 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c755ac1386754dbc8ccdb6677afc0bff, user_id=be4caee2b039454690828e508d276cc9, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:11.652352 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d531e2b-0e6d-4738-b2bf-c7264ebe8517 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:11.665034 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 993/2001] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:13:11 2022] PUT /identity/v3/projects/c755ac1386754dbc8ccdb6677afc0bff/users/be4caee2b039454690828e508d276cc9/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:13:11.675759 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b08bdc-c68e-494f-935b-733e1a49887c None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:11.676045 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b08bdc-c68e-494f-935b-733e1a49887c None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:11.676318 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b08bdc-c68e-494f-935b-733e1a49887c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:11.703340 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-56b08bdc-c68e-494f-935b-733e1a49887c None None] MFA Rules not processed for user `be4caee2b039454690828e508d276cc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:11.704627 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-56b08bdc-c68e-494f-935b-733e1a49887c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:11.716252 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:11.769494 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1009/2002] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:13:11 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:11.774084 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d531e2b-0e6d-4738-b2bf-c7264ebe8517 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:11.835453 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d531e2b-0e6d-4738-b2bf-c7264ebe8517 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:11.840001 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edcf26-c5ea-4f26-a49a-9dba272ac367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:11.840665 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edcf26-c5ea-4f26-a49a-9dba272ac367 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:11.840984 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edcf26-c5ea-4f26-a49a-9dba272ac367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:11.841263 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edcf26-c5ea-4f26-a49a-9dba272ac367 admin admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:11.841970 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45edcf26-c5ea-4f26-a49a-9dba272ac367 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:11.844647 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45edcf26-c5ea-4f26-a49a-9dba272ac367 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:11.870311 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 994/2003] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:13:11 2022] POST /identity/v3/projects => generated 407 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:11.874825 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b08bdc-c68e-494f-935b-733e1a49887c None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:11.892857 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b08bdc-c68e-494f-935b-733e1a49887c None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:11.955429 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3502a6-2d1b-4971-b0cd-93df8fdad3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:11.956116 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3502a6-2d1b-4971-b0cd-93df8fdad3f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:11.956402 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3502a6-2d1b-4971-b0cd-93df8fdad3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:11.956679 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3502a6-2d1b-4971-b0cd-93df8fdad3f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:11.957422 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3502a6-2d1b-4971-b0cd-93df8fdad3f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:11.959371 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3502a6-2d1b-4971-b0cd-93df8fdad3f2 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:11.980621 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1010/2004] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:13:11 2022] POST /identity/v3/users => generated 310 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:11.985592 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edcf26-c5ea-4f26-a49a-9dba272ac367 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:11.995842 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edcf26-c5ea-4f26-a49a-9dba272ac367 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:12.001199 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e7209f-24a1-4794-8200-51a5232334d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:12.001852 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7209f-24a1-4794-8200-51a5232334d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:12.002132 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7209f-24a1-4794-8200-51a5232334d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:12.002404 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7209f-24a1-4794-8200-51a5232334d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:12.003138 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e7209f-24a1-4794-8200-51a5232334d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:12.004726 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e7209f-24a1-4794-8200-51a5232334d3 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:12.015035 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 995/2005] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:13:12.019469 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3502a6-2d1b-4971-b0cd-93df8fdad3f2 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:12.029992 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3502a6-2d1b-4971-b0cd-93df8fdad3f2 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:12.035239 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031432a8-c8a0-45ee-b2dc-f32e7c1b28e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:12.036132 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031432a8-c8a0-45ee-b2dc-f32e7c1b28e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:12.036418 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031432a8-c8a0-45ee-b2dc-f32e7c1b28e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:12.036725 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031432a8-c8a0-45ee-b2dc-f32e7c1b28e9 admin admin] PATH_INFO: `/v3/projects/3089db015818422daedb316e0ff1db96/users/1e8d10df9ae149ae9ee17ab5cdefc604/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:12.052116 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031432a8-c8a0-45ee-b2dc-f32e7c1b28e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3089db015818422daedb316e0ff1db96, user_id=1e8d10df9ae149ae9ee17ab5cdefc604, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:12.055251 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031432a8-c8a0-45ee-b2dc-f32e7c1b28e9 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:12.068364 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1011/2006] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:13:12 2022] PUT /identity/v3/projects/3089db015818422daedb316e0ff1db96/users/1e8d10df9ae149ae9ee17ab5cdefc604/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:13:12.072352 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e7209f-24a1-4794-8200-51a5232334d3 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:12.082575 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e7209f-24a1-4794-8200-51a5232334d3 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:12.140021 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f845417-e0eb-4585-92fc-24fb7fc3e420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:12.140723 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f845417-e0eb-4585-92fc-24fb7fc3e420 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:12.141023 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f845417-e0eb-4585-92fc-24fb7fc3e420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:12.141301 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f845417-e0eb-4585-92fc-24fb7fc3e420 admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:12.142036 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f845417-e0eb-4585-92fc-24fb7fc3e420 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:12.143643 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f845417-e0eb-4585-92fc-24fb7fc3e420 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:12.158377 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 996/2007] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:12.160004 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031432a8-c8a0-45ee-b2dc-f32e7c1b28e9 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:12.170629 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031432a8-c8a0-45ee-b2dc-f32e7c1b28e9 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:12.176593 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad123bf-dcd1-421d-8947-3b19d2b2dbc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:12.177527 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad123bf-dcd1-421d-8947-3b19d2b2dbc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:12.177813 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad123bf-dcd1-421d-8947-3b19d2b2dbc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:12.178094 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad123bf-dcd1-421d-8947-3b19d2b2dbc2 admin admin] PATH_INFO: `/v3/projects/3089db015818422daedb316e0ff1db96/users/1e8d10df9ae149ae9ee17ab5cdefc604/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:12.180094 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad123bf-dcd1-421d-8947-3b19d2b2dbc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3089db015818422daedb316e0ff1db96, user_id=1e8d10df9ae149ae9ee17ab5cdefc604, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:12.183009 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad123bf-dcd1-421d-8947-3b19d2b2dbc2 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:12.194099 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1012/2008] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:13:12 2022] PUT /identity/v3/projects/3089db015818422daedb316e0ff1db96/users/1e8d10df9ae149ae9ee17ab5cdefc604/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:12.206276 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f3e12-a898-469c-af3e-4985f72b353e None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:12.206567 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f3e12-a898-469c-af3e-4985f72b353e None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:12.206963 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f3e12-a898-469c-af3e-4985f72b353e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:12.244094 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-144f3e12-a898-469c-af3e-4985f72b353e None None] MFA Rules not processed for user `1e8d10df9ae149ae9ee17ab5cdefc604`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:12.245343 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-144f3e12-a898-469c-af3e-4985f72b353e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:12.277768 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:12.318327 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 997/2009] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:13:12 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:12.329697 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad123bf-dcd1-421d-8947-3b19d2b2dbc2 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:12.331476 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-1ad123bf-dcd1-421d-8947-3b19d2b2dbc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:12.391966 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad123bf-dcd1-421d-8947-3b19d2b2dbc2 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:12.395586 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2507f-0a31-4043-a066-aa03e456f3e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:12.396233 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2507f-0a31-4043-a066-aa03e456f3e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:12.396516 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2507f-0a31-4043-a066-aa03e456f3e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:12.396820 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2507f-0a31-4043-a066-aa03e456f3e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:12.406322 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb2507f-0a31-4043-a066-aa03e456f3e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:12.407747 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb2507f-0a31-4043-a066-aa03e456f3e9 service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:12.417048 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1013/2010] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:12 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:12.589149 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f3e12-a898-469c-af3e-4985f72b353e None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:12.590789 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-144f3e12-a898-469c-af3e-4985f72b353e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:12.605026 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f3e12-a898-469c-af3e-4985f72b353e None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:12.608678 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bccdf2-d996-409c-a75a-f6026e06dafd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:12.609350 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bccdf2-d996-409c-a75a-f6026e06dafd service cinder] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:12.609726 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bccdf2-d996-409c-a75a-f6026e06dafd service cinder] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:12.610003 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bccdf2-d996-409c-a75a-f6026e06dafd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:12.678034 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bccdf2-d996-409c-a75a-f6026e06dafd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:12.679645 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bccdf2-d996-409c-a75a-f6026e06dafd service cinder] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:12.689782 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 998/2011] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:12 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:22.412930 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=91,keystone:INSERT=5 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:22.684671 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=43 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:28.592639 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2507f-0a31-4043-a066-aa03e456f3e9 service cinder] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:28.594871 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-4bb2507f-0a31-4043-a066-aa03e456f3e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:28.737359 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2507f-0a31-4043-a066-aa03e456f3e9 service cinder] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:28.741962 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4a21e-e80f-4aaa-96e9-67f1afd2e31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:28.742859 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4a21e-e80f-4aaa-96e9-67f1afd2e31c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:28.743183 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4a21e-e80f-4aaa-96e9-67f1afd2e31c admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:28.743394 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4a21e-e80f-4aaa-96e9-67f1afd2e31c admin admin] PATH_INFO: `/v3/users/849a7f34845840d0a804d6f4a1488a6b` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:28.744609 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b4a21e-e80f-4aaa-96e9-67f1afd2e31c admin admin] RBAC: Authorizing `identity:delete_user(user_id=849a7f34845840d0a804d6f4a1488a6b)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:28.746920 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b4a21e-e80f-4aaa-96e9-67f1afd2e31c admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:28.797834 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-41b4a21e-e80f-4aaa-96e9-67f1afd2e31c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '849a7f34845840d0a804d6f4a1488a6b'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:28.806355 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-41b4a21e-e80f-4aaa-96e9-67f1afd2e31c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '849a7f34845840d0a804d6f4a1488a6b'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:28.813772 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-41b4a21e-e80f-4aaa-96e9-67f1afd2e31c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '849a7f34845840d0a804d6f4a1488a6b'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:28.825516 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-41b4a21e-e80f-4aaa-96e9-67f1afd2e31c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '849a7f34845840d0a804d6f4a1488a6b'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:28.826165 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-41b4a21e-e80f-4aaa-96e9-67f1afd2e31c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '849a7f34845840d0a804d6f4a1488a6b'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:28.832589 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1014/2012] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:13:28 2022] DELETE /identity/v3/users/849a7f34845840d0a804d6f4a1488a6b => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:13:28.837382 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f48cc-ec79-4462-ba8e-027a8f1d784e None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:28.837883 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f48cc-ec79-4462-ba8e-027a8f1d784e None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:28.838010 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f48cc-ec79-4462-ba8e-027a8f1d784e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:28.866473 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-927f48cc-ec79-4462-ba8e-027a8f1d784e None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:28.867667 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-927f48cc-ec79-4462-ba8e-027a8f1d784e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:28.928272 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 999/2013] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:13:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:28.938219 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4a21e-e80f-4aaa-96e9-67f1afd2e31c admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:28.939627 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-41b4a21e-e80f-4aaa-96e9-67f1afd2e31c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:28.964838 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:29.052796 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4a21e-e80f-4aaa-96e9-67f1afd2e31c admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:29.057495 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13608465-fe75-4e28-aefd-ad573ff0fc80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:29.057495 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13608465-fe75-4e28-aefd-ad573ff0fc80 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:29.057724 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13608465-fe75-4e28-aefd-ad573ff0fc80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:29.058515 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13608465-fe75-4e28-aefd-ad573ff0fc80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:29.072916 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13608465-fe75-4e28-aefd-ad573ff0fc80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:29.074444 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13608465-fe75-4e28-aefd-ad573ff0fc80 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:29.086028 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1015/2014] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:29.477527 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f48cc-ec79-4462-ba8e-027a8f1d784e None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:29.479106 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-927f48cc-ec79-4462-ba8e-027a8f1d784e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:29.492407 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f48cc-ec79-4462-ba8e-027a8f1d784e None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:29.497603 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae82b6d-6a69-4fdd-83ba-6d1d9b702ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:29.498557 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae82b6d-6a69-4fdd-83ba-6d1d9b702ac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:29.498906 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae82b6d-6a69-4fdd-83ba-6d1d9b702ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:29.499244 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae82b6d-6a69-4fdd-83ba-6d1d9b702ac1 admin admin] PATH_INFO: `/v3/projects/1e2e2cfd7b9e42d09041686d66ed9712` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:29.501473 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae82b6d-6a69-4fdd-83ba-6d1d9b702ac1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e2e2cfd7b9e42d09041686d66ed9712)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:29.503450 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae82b6d-6a69-4fdd-83ba-6d1d9b702ac1 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:29.557899 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-3ae82b6d-6a69-4fdd-83ba-6d1d9b702ac1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e2e2cfd7b9e42d09041686d66ed9712', 'request_id': 'req-3ae82b6d-6a69-4fdd-83ba-6d1d9b702ac1'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:29.568524 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-3ae82b6d-6a69-4fdd-83ba-6d1d9b702ac1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e2e2cfd7b9e42d09041686d66ed9712', 'request_id': 'req-3ae82b6d-6a69-4fdd-83ba-6d1d9b702ac1'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:29.576786 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-3ae82b6d-6a69-4fdd-83ba-6d1d9b702ac1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e2e2cfd7b9e42d09041686d66ed9712', 'request_id': 'req-3ae82b6d-6a69-4fdd-83ba-6d1d9b702ac1'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:29.588283 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-3ae82b6d-6a69-4fdd-83ba-6d1d9b702ac1 admin admin] The token cache is being invalidate because project 1e2e2cfd7b9e42d09041686d66ed9712 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:13:29.588597 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-3ae82b6d-6a69-4fdd-83ba-6d1d9b702ac1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:29.589336 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-3ae82b6d-6a69-4fdd-83ba-6d1d9b702ac1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:29.591032 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1000/2015] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:13:29 2022] DELETE /identity/v3/projects/1e2e2cfd7b9e42d09041686d66ed9712 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:30.554608 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13608465-fe75-4e28-aefd-ad573ff0fc80 service neutron] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:30.556679 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-13608465-fe75-4e28-aefd-ad573ff0fc80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:30.572536 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13608465-fe75-4e28-aefd-ad573ff0fc80 service neutron] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:30.644148 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f59ca9d-d485-4517-a877-df5263416994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:30.645076 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f59ca9d-d485-4517-a877-df5263416994 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:30.645357 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f59ca9d-d485-4517-a877-df5263416994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:30.645635 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f59ca9d-d485-4517-a877-df5263416994 admin admin] PATH_INFO: `/v3/users/be4caee2b039454690828e508d276cc9` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:30.646863 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f59ca9d-d485-4517-a877-df5263416994 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be4caee2b039454690828e508d276cc9)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:30.648805 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f59ca9d-d485-4517-a877-df5263416994 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:30.702347 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-0f59ca9d-d485-4517-a877-df5263416994 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be4caee2b039454690828e508d276cc9'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:30.714274 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-0f59ca9d-d485-4517-a877-df5263416994 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be4caee2b039454690828e508d276cc9'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:30.723073 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-0f59ca9d-d485-4517-a877-df5263416994 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be4caee2b039454690828e508d276cc9'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:30.737791 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-0f59ca9d-d485-4517-a877-df5263416994 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be4caee2b039454690828e508d276cc9'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:30.738520 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-0f59ca9d-d485-4517-a877-df5263416994 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be4caee2b039454690828e508d276cc9'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:30.744693 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1016/2016] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:13:30 2022] DELETE /identity/v3/users/be4caee2b039454690828e508d276cc9 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:30.749247 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f8bb5-4d65-4e1f-aec3-5842d0243303 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:30.749839 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f8bb5-4d65-4e1f-aec3-5842d0243303 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:30.749839 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f8bb5-4d65-4e1f-aec3-5842d0243303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:30.769448 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-962f8bb5-4d65-4e1f-aec3-5842d0243303 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:30.770661 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-962f8bb5-4d65-4e1f-aec3-5842d0243303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:30.838432 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1001/2017] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:13:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:30.849069 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f59ca9d-d485-4517-a877-df5263416994 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:30.850814 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-0f59ca9d-d485-4517-a877-df5263416994 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:30.860246 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:30.925972 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f59ca9d-d485-4517-a877-df5263416994 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:30.930652 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9fe6e4-5b8e-492e-8a9d-a067ee1f6eab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:30.930652 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9fe6e4-5b8e-492e-8a9d-a067ee1f6eab service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:30.930652 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9fe6e4-5b8e-492e-8a9d-a067ee1f6eab service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:30.930957 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9fe6e4-5b8e-492e-8a9d-a067ee1f6eab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:30.941785 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9fe6e4-5b8e-492e-8a9d-a067ee1f6eab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:30.943241 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9fe6e4-5b8e-492e-8a9d-a067ee1f6eab service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:30.956371 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1017/2018] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:31.252169 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f8bb5-4d65-4e1f-aec3-5842d0243303 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:31.253694 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-962f8bb5-4d65-4e1f-aec3-5842d0243303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:31.266612 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f8bb5-4d65-4e1f-aec3-5842d0243303 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:31.271812 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312a6da2-470c-43ff-880a-dc5a8cd4d186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:31.272764 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a6da2-470c-43ff-880a-dc5a8cd4d186 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:31.273050 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a6da2-470c-43ff-880a-dc5a8cd4d186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:31.273326 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a6da2-470c-43ff-880a-dc5a8cd4d186 admin admin] PATH_INFO: `/v3/projects/c755ac1386754dbc8ccdb6677afc0bff` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:31.274533 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312a6da2-470c-43ff-880a-dc5a8cd4d186 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c755ac1386754dbc8ccdb6677afc0bff)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:31.276439 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312a6da2-470c-43ff-880a-dc5a8cd4d186 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:31.288312 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:31.326978 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-312a6da2-470c-43ff-880a-dc5a8cd4d186 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c755ac1386754dbc8ccdb6677afc0bff', 'request_id': 'req-312a6da2-470c-43ff-880a-dc5a8cd4d186'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:31.336192 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-312a6da2-470c-43ff-880a-dc5a8cd4d186 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c755ac1386754dbc8ccdb6677afc0bff', 'request_id': 'req-312a6da2-470c-43ff-880a-dc5a8cd4d186'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:31.341638 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-312a6da2-470c-43ff-880a-dc5a8cd4d186 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c755ac1386754dbc8ccdb6677afc0bff', 'request_id': 'req-312a6da2-470c-43ff-880a-dc5a8cd4d186'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:31.352939 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-312a6da2-470c-43ff-880a-dc5a8cd4d186 admin admin] The token cache is being invalidate because project c755ac1386754dbc8ccdb6677afc0bff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:13:31.353139 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-312a6da2-470c-43ff-880a-dc5a8cd4d186 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:31.353862 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-312a6da2-470c-43ff-880a-dc5a8cd4d186 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:31.355421 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1002/2019] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:13:31 2022] DELETE /identity/v3/projects/c755ac1386754dbc8ccdb6677afc0bff => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:31.359654 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9fe6e4-5b8e-492e-8a9d-a067ee1f6eab service neutron] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:31.369825 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9fe6e4-5b8e-492e-8a9d-a067ee1f6eab service neutron] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:31.428025 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca598456-6b83-4935-aa5a-1ff856a9abf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:31.428974 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca598456-6b83-4935-aa5a-1ff856a9abf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:31.429260 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca598456-6b83-4935-aa5a-1ff856a9abf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:31.429539 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca598456-6b83-4935-aa5a-1ff856a9abf1 admin admin] PATH_INFO: `/v3/users/1e8d10df9ae149ae9ee17ab5cdefc604` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:31.430815 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca598456-6b83-4935-aa5a-1ff856a9abf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e8d10df9ae149ae9ee17ab5cdefc604)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:31.432791 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca598456-6b83-4935-aa5a-1ff856a9abf1 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:31.481966 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-ca598456-6b83-4935-aa5a-1ff856a9abf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e8d10df9ae149ae9ee17ab5cdefc604'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:31.489671 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-ca598456-6b83-4935-aa5a-1ff856a9abf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e8d10df9ae149ae9ee17ab5cdefc604'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:31.496522 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-ca598456-6b83-4935-aa5a-1ff856a9abf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e8d10df9ae149ae9ee17ab5cdefc604'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:31.509561 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-ca598456-6b83-4935-aa5a-1ff856a9abf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e8d10df9ae149ae9ee17ab5cdefc604'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:31.510309 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-ca598456-6b83-4935-aa5a-1ff856a9abf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e8d10df9ae149ae9ee17ab5cdefc604'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:31.516922 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1018/2020] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:13:31 2022] DELETE /identity/v3/users/1e8d10df9ae149ae9ee17ab5cdefc604 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:13:31.880759 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312a6da2-470c-43ff-880a-dc5a8cd4d186 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:31.882203 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-312a6da2-470c-43ff-880a-dc5a8cd4d186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:31.896601 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312a6da2-470c-43ff-880a-dc5a8cd4d186 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:31.958538 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d979e7-63d5-408e-a46a-ea544e8f09dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:31.960500 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d979e7-63d5-408e-a46a-ea544e8f09dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:31.960923 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d979e7-63d5-408e-a46a-ea544e8f09dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:31.961284 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d979e7-63d5-408e-a46a-ea544e8f09dd admin admin] PATH_INFO: `/v3/projects/3089db015818422daedb316e0ff1db96` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:31.962625 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d979e7-63d5-408e-a46a-ea544e8f09dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3089db015818422daedb316e0ff1db96)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:31.964652 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d979e7-63d5-408e-a46a-ea544e8f09dd admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:32.012659 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-04d979e7-63d5-408e-a46a-ea544e8f09dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3089db015818422daedb316e0ff1db96', 'request_id': 'req-04d979e7-63d5-408e-a46a-ea544e8f09dd'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:32.020100 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-04d979e7-63d5-408e-a46a-ea544e8f09dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3089db015818422daedb316e0ff1db96', 'request_id': 'req-04d979e7-63d5-408e-a46a-ea544e8f09dd'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:32.025783 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-04d979e7-63d5-408e-a46a-ea544e8f09dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3089db015818422daedb316e0ff1db96', 'request_id': 'req-04d979e7-63d5-408e-a46a-ea544e8f09dd'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:32.038436 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-04d979e7-63d5-408e-a46a-ea544e8f09dd admin admin] The token cache is being invalidate because project 3089db015818422daedb316e0ff1db96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:13:32.038724 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-04d979e7-63d5-408e-a46a-ea544e8f09dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:32.039393 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-04d979e7-63d5-408e-a46a-ea544e8f09dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:32.041002 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1003/2021] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:13:31 2022] DELETE /identity/v3/projects/3089db015818422daedb316e0ff1db96 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:32.046009 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240f9f5-2cf9-497d-8925-1f5974207483 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:32.047206 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240f9f5-2cf9-497d-8925-1f5974207483 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:32.047206 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240f9f5-2cf9-497d-8925-1f5974207483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:32.083656 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-a240f9f5-2cf9-497d-8925-1f5974207483 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:32.084909 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-a240f9f5-2cf9-497d-8925-1f5974207483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:32.090077 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:32.151850 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1019/2022] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:13:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:32.161368 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9022b-0f16-4de3-bd73-6f41bf85a64e None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:32.161655 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9022b-0f16-4de3-bd73-6f41bf85a64e None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:32.161938 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9022b-0f16-4de3-bd73-6f41bf85a64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:32.181176 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-fab9022b-0f16-4de3-bd73-6f41bf85a64e None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:32.182375 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-fab9022b-0f16-4de3-bd73-6f41bf85a64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:32.191899 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1004/2023] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:13:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:32.196931 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a240f9f5-2cf9-497d-8925-1f5974207483 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:32.207781 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a240f9f5-2cf9-497d-8925-1f5974207483 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:32.212328 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b5a2d-33b6-4244-bf75-4bc4cdb55ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:32.213024 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b5a2d-33b6-4244-bf75-4bc4cdb55ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:32.213406 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b5a2d-33b6-4244-bf75-4bc4cdb55ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:32.213684 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b5a2d-33b6-4244-bf75-4bc4cdb55ae7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:32.214417 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b5a2d-33b6-4244-bf75-4bc4cdb55ae7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:13:32.214726 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b5a2d-33b6-4244-bf75-4bc4cdb55ae7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:32.216314 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b5a2d-33b6-4244-bf75-4bc4cdb55ae7 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:32.229693 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1020/2024] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:13:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:13:32.234529 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab9022b-0f16-4de3-bd73-6f41bf85a64e None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:32.243951 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab9022b-0f16-4de3-bd73-6f41bf85a64e None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:32.248953 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3857b63-3274-4098-8ab7-3b35682fbf73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:32.249680 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3857b63-3274-4098-8ab7-3b35682fbf73 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:32.249964 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3857b63-3274-4098-8ab7-3b35682fbf73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:32.250441 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3857b63-3274-4098-8ab7-3b35682fbf73 admin admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:32.251148 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3857b63-3274-4098-8ab7-3b35682fbf73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:32.253241 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3857b63-3274-4098-8ab7-3b35682fbf73 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:32.280109 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1005/2025] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:13:32 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:32.284881 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b5a2d-33b6-4244-bf75-4bc4cdb55ae7 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:32.297279 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b5a2d-33b6-4244-bf75-4bc4cdb55ae7 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:32.356356 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44455669-1f7f-4b56-8e32-af89e708a1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:32.357056 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44455669-1f7f-4b56-8e32-af89e708a1f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:32.357339 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44455669-1f7f-4b56-8e32-af89e708a1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:32.357614 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44455669-1f7f-4b56-8e32-af89e708a1f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:32.358303 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44455669-1f7f-4b56-8e32-af89e708a1f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:32.361526 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44455669-1f7f-4b56-8e32-af89e708a1f8 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:32.385762 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1021/2026] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:13:32 2022] POST /identity/v3/users => generated 286 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:32.389816 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3857b63-3274-4098-8ab7-3b35682fbf73 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:32.395887 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:32.402363 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3857b63-3274-4098-8ab7-3b35682fbf73 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:32.408672 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973aca13-0202-46a5-af3d-c29362836b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:32.409362 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973aca13-0202-46a5-af3d-c29362836b9d admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:32.409650 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973aca13-0202-46a5-af3d-c29362836b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:32.409929 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973aca13-0202-46a5-af3d-c29362836b9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:32.410662 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973aca13-0202-46a5-af3d-c29362836b9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:32.412267 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973aca13-0202-46a5-af3d-c29362836b9d admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:32.423026 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1006/2027] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:32.427041 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44455669-1f7f-4b56-8e32-af89e708a1f8 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:32.437106 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44455669-1f7f-4b56-8e32-af89e708a1f8 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:32.441717 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e7a8ff-0f3d-4c0d-b156-e4fdd1de1098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:32.442380 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7a8ff-0f3d-4c0d-b156-e4fdd1de1098 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:32.442671 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7a8ff-0f3d-4c0d-b156-e4fdd1de1098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:32.442948 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7a8ff-0f3d-4c0d-b156-e4fdd1de1098 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:32.443681 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e7a8ff-0f3d-4c0d-b156-e4fdd1de1098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:32.445314 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e7a8ff-0f3d-4c0d-b156-e4fdd1de1098 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:32.458760 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1022/2028] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:32.460007 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973aca13-0202-46a5-af3d-c29362836b9d admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:32.470890 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973aca13-0202-46a5-af3d-c29362836b9d admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:32.475941 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd56cb0-7685-41a6-acbd-23fb2cc48451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:32.476859 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd56cb0-7685-41a6-acbd-23fb2cc48451 admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:32.477139 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd56cb0-7685-41a6-acbd-23fb2cc48451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:32.477412 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd56cb0-7685-41a6-acbd-23fb2cc48451 admin admin] PATH_INFO: `/v3/projects/73bc609e838648c9860828c85f9d6ceb/users/260f0bff5da64462ad744895f98d5cd4/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:32.492447 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd56cb0-7685-41a6-acbd-23fb2cc48451 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73bc609e838648c9860828c85f9d6ceb, user_id=260f0bff5da64462ad744895f98d5cd4, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:32.495093 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd56cb0-7685-41a6-acbd-23fb2cc48451 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:32.508007 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1007/2029] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:13:32 2022] PUT /identity/v3/projects/73bc609e838648c9860828c85f9d6ceb/users/260f0bff5da64462ad744895f98d5cd4/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:32.519877 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aeb7f5-576b-40d8-9c0c-bb32882cac15 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:32.520241 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aeb7f5-576b-40d8-9c0c-bb32882cac15 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:32.520596 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aeb7f5-576b-40d8-9c0c-bb32882cac15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:32.554227 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-f4aeb7f5-576b-40d8-9c0c-bb32882cac15 None None] MFA Rules not processed for user `260f0bff5da64462ad744895f98d5cd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:32.556255 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-f4aeb7f5-576b-40d8-9c0c-bb32882cac15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:32.621714 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1023/2030] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:13:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:32.632686 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd56cb0-7685-41a6-acbd-23fb2cc48451 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:32.634398 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-acd56cb0-7685-41a6-acbd-23fb2cc48451 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:32.692023 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd56cb0-7685-41a6-acbd-23fb2cc48451 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:32.695592 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c00c5a3-8ffb-46be-8a64-dbeb0228003c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:32.696232 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00c5a3-8ffb-46be-8a64-dbeb0228003c service cinder] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:32.696516 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00c5a3-8ffb-46be-8a64-dbeb0228003c service cinder] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:32.696834 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00c5a3-8ffb-46be-8a64-dbeb0228003c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:32.705953 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c00c5a3-8ffb-46be-8a64-dbeb0228003c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:32.707362 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c00c5a3-8ffb-46be-8a64-dbeb0228003c service cinder] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:32.716587 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1008/2031] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:32.737410 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aeb7f5-576b-40d8-9c0c-bb32882cac15 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:32.745972 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:32.807084 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aeb7f5-576b-40d8-9c0c-bb32882cac15 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:32.811514 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db72a65-fd7e-478a-9007-359b41560f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:32.812933 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db72a65-fd7e-478a-9007-359b41560f8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:32.813210 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db72a65-fd7e-478a-9007-359b41560f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:32.813479 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db72a65-fd7e-478a-9007-359b41560f8b admin admin] PATH_INFO: `/v3/users/260f0bff5da64462ad744895f98d5cd4` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:32.814700 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db72a65-fd7e-478a-9007-359b41560f8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=260f0bff5da64462ad744895f98d5cd4)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:32.816602 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db72a65-fd7e-478a-9007-359b41560f8b admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:32.866422 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-1db72a65-fd7e-478a-9007-359b41560f8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '260f0bff5da64462ad744895f98d5cd4'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:32.873720 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-1db72a65-fd7e-478a-9007-359b41560f8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '260f0bff5da64462ad744895f98d5cd4'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:32.881847 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-1db72a65-fd7e-478a-9007-359b41560f8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '260f0bff5da64462ad744895f98d5cd4'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:32.894989 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-1db72a65-fd7e-478a-9007-359b41560f8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '260f0bff5da64462ad744895f98d5cd4'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:32.895702 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-1db72a65-fd7e-478a-9007-359b41560f8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '260f0bff5da64462ad744895f98d5cd4'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:32.901873 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1024/2032] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:13:32 2022] DELETE /identity/v3/users/260f0bff5da64462ad744895f98d5cd4 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:32.906406 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0287ae-3515-4b67-91cc-93c2566925d2 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:32.906891 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0287ae-3515-4b67-91cc-93c2566925d2 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:32.906998 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0287ae-3515-4b67-91cc-93c2566925d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:32.923938 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-1e0287ae-3515-4b67-91cc-93c2566925d2 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:32.925244 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-1e0287ae-3515-4b67-91cc-93c2566925d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:32.984548 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1009/2033] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:13:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:32.994273 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db72a65-fd7e-478a-9007-359b41560f8b admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:32.995688 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-1db72a65-fd7e-478a-9007-359b41560f8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:33.052633 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db72a65-fd7e-478a-9007-359b41560f8b admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:33.056275 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989f228-d143-48c6-bc81-b02312fa1da7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:33.056954 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989f228-d143-48c6-bc81-b02312fa1da7 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:33.057296 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989f228-d143-48c6-bc81-b02312fa1da7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:33.057522 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989f228-d143-48c6-bc81-b02312fa1da7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:33.067146 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7989f228-d143-48c6-bc81-b02312fa1da7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:33.068569 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7989f228-d143-48c6-bc81-b02312fa1da7 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:33.078614 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1025/2034] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:33.355549 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0287ae-3515-4b67-91cc-93c2566925d2 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:33.357000 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-1e0287ae-3515-4b67-91cc-93c2566925d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:33.386072 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0287ae-3515-4b67-91cc-93c2566925d2 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:33.390843 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031761b1-0d9d-4d41-8f3e-8c5cfd6f82b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:33.391710 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031761b1-0d9d-4d41-8f3e-8c5cfd6f82b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:33.391998 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031761b1-0d9d-4d41-8f3e-8c5cfd6f82b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:33.392272 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031761b1-0d9d-4d41-8f3e-8c5cfd6f82b4 admin admin] PATH_INFO: `/v3/projects/73bc609e838648c9860828c85f9d6ceb` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:33.393477 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031761b1-0d9d-4d41-8f3e-8c5cfd6f82b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73bc609e838648c9860828c85f9d6ceb)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:33.395389 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031761b1-0d9d-4d41-8f3e-8c5cfd6f82b4 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:33.442440 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-031761b1-0d9d-4d41-8f3e-8c5cfd6f82b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73bc609e838648c9860828c85f9d6ceb', 'request_id': 'req-031761b1-0d9d-4d41-8f3e-8c5cfd6f82b4'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:33.449757 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-031761b1-0d9d-4d41-8f3e-8c5cfd6f82b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73bc609e838648c9860828c85f9d6ceb', 'request_id': 'req-031761b1-0d9d-4d41-8f3e-8c5cfd6f82b4'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:33.455723 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-031761b1-0d9d-4d41-8f3e-8c5cfd6f82b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73bc609e838648c9860828c85f9d6ceb', 'request_id': 'req-031761b1-0d9d-4d41-8f3e-8c5cfd6f82b4'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:33.457064 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:33.471059 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-031761b1-0d9d-4d41-8f3e-8c5cfd6f82b4 admin admin] The token cache is being invalidate because project 73bc609e838648c9860828c85f9d6ceb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:13:33.471351 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-031761b1-0d9d-4d41-8f3e-8c5cfd6f82b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:33.472011 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-031761b1-0d9d-4d41-8f3e-8c5cfd6f82b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:33.473610 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1010/2035] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:13:33 2022] DELETE /identity/v3/projects/73bc609e838648c9860828c85f9d6ceb => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:33.478636 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db307894-c0aa-40c5-836f-321d193561e2 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:33.479169 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db307894-c0aa-40c5-836f-321d193561e2 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:33.479539 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db307894-c0aa-40c5-836f-321d193561e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:33.498166 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-db307894-c0aa-40c5-836f-321d193561e2 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:33.500065 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-db307894-c0aa-40c5-836f-321d193561e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:33.524587 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:33.561873 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1026/2036] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:13:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:33.569994 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541015c-7beb-4d0e-ad1d-8ffdce42ea10 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:33.570227 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541015c-7beb-4d0e-ad1d-8ffdce42ea10 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:33.570510 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541015c-7beb-4d0e-ad1d-8ffdce42ea10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:33.588371 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-c541015c-7beb-4d0e-ad1d-8ffdce42ea10 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:33.589608 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-c541015c-7beb-4d0e-ad1d-8ffdce42ea10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:33.598346 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1011/2037] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:13:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:33.602360 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db307894-c0aa-40c5-836f-321d193561e2 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:33.612908 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db307894-c0aa-40c5-836f-321d193561e2 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:33.617541 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dd8754-3fe6-4d28-b905-44cb6ba837b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:33.618302 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd8754-3fe6-4d28-b905-44cb6ba837b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:33.618590 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd8754-3fe6-4d28-b905-44cb6ba837b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:33.618871 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd8754-3fe6-4d28-b905-44cb6ba837b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:33.619602 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dd8754-3fe6-4d28-b905-44cb6ba837b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:13:33.619963 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dd8754-3fe6-4d28-b905-44cb6ba837b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:33.621597 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dd8754-3fe6-4d28-b905-44cb6ba837b6 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:33.633890 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1027/2038] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:13:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:13:33.638135 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c541015c-7beb-4d0e-ad1d-8ffdce42ea10 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:33.647557 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c541015c-7beb-4d0e-ad1d-8ffdce42ea10 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:33.652146 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd89597-f996-4c48-b28e-14a583d628f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:33.652825 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd89597-f996-4c48-b28e-14a583d628f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:33.653106 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd89597-f996-4c48-b28e-14a583d628f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:33.653376 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd89597-f996-4c48-b28e-14a583d628f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:33.654064 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd89597-f996-4c48-b28e-14a583d628f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:33.656533 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd89597-f996-4c48-b28e-14a583d628f2 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:33.681792 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1012/2039] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:13:33 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:33.685779 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dd8754-3fe6-4d28-b905-44cb6ba837b6 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:33.695839 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dd8754-3fe6-4d28-b905-44cb6ba837b6 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:33.753352 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7dc28-56e6-48bc-99db-b89c38fe2280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:33.754011 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7dc28-56e6-48bc-99db-b89c38fe2280 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:33.754291 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7dc28-56e6-48bc-99db-b89c38fe2280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:33.754562 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7dc28-56e6-48bc-99db-b89c38fe2280 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:33.755249 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf7dc28-56e6-48bc-99db-b89c38fe2280 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:33.757179 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf7dc28-56e6-48bc-99db-b89c38fe2280 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:33.777484 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1028/2040] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:13:33 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:33.781933 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd89597-f996-4c48-b28e-14a583d628f2 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:33.792367 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd89597-f996-4c48-b28e-14a583d628f2 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:33.798012 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7bdf37-365f-4819-b228-c00260ebade1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:33.798664 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bdf37-365f-4819-b228-c00260ebade1 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:33.798941 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bdf37-365f-4819-b228-c00260ebade1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:33.799212 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bdf37-365f-4819-b228-c00260ebade1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:33.799938 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7bdf37-365f-4819-b228-c00260ebade1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:33.801551 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7bdf37-365f-4819-b228-c00260ebade1 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:33.811901 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1013/2041] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:33.815997 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7dc28-56e6-48bc-99db-b89c38fe2280 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:33.826003 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7dc28-56e6-48bc-99db-b89c38fe2280 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:33.830821 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b57da9-01c5-4e3d-8f73-1ec2044cc239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:33.831478 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b57da9-01c5-4e3d-8f73-1ec2044cc239 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:33.831761 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b57da9-01c5-4e3d-8f73-1ec2044cc239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:33.832038 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b57da9-01c5-4e3d-8f73-1ec2044cc239 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:33.832802 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b57da9-01c5-4e3d-8f73-1ec2044cc239 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:33.834397 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b57da9-01c5-4e3d-8f73-1ec2044cc239 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:33.844914 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1029/2042] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:33.848748 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7bdf37-365f-4819-b228-c00260ebade1 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:33.858347 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7bdf37-365f-4819-b228-c00260ebade1 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:33.864169 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943f81b7-a1d9-4d27-b952-48ff1973ab37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:33.865121 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f81b7-a1d9-4d27-b952-48ff1973ab37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:33.865432 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f81b7-a1d9-4d27-b952-48ff1973ab37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:33.865711 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f81b7-a1d9-4d27-b952-48ff1973ab37 admin admin] PATH_INFO: `/v3/projects/06b89d2ee7604a2b924bd48be1ccc1a5/users/7917f5d580d54d4584810282b2329070/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:33.880229 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943f81b7-a1d9-4d27-b952-48ff1973ab37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06b89d2ee7604a2b924bd48be1ccc1a5, user_id=7917f5d580d54d4584810282b2329070, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:33.882928 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943f81b7-a1d9-4d27-b952-48ff1973ab37 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:33.896083 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1014/2043] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:13:33 2022] PUT /identity/v3/projects/06b89d2ee7604a2b924bd48be1ccc1a5/users/7917f5d580d54d4584810282b2329070/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:13:33.906715 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8fc149-38f4-4699-911a-81abe5895571 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:33.907001 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8fc149-38f4-4699-911a-81abe5895571 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:33.907279 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8fc149-38f4-4699-911a-81abe5895571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:33.932856 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-1d8fc149-38f4-4699-911a-81abe5895571 None None] MFA Rules not processed for user `7917f5d580d54d4584810282b2329070`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:33.934061 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-1d8fc149-38f4-4699-911a-81abe5895571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:34.006528 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1030/2044] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:13:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:34.011423 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943f81b7-a1d9-4d27-b952-48ff1973ab37 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:34.080957 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943f81b7-a1d9-4d27-b952-48ff1973ab37 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:34.085638 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9e3f0-08e5-432a-8763-9a686c643e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:34.086306 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9e3f0-08e5-432a-8763-9a686c643e06 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:34.086586 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9e3f0-08e5-432a-8763-9a686c643e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:34.086860 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9e3f0-08e5-432a-8763-9a686c643e06 admin admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:34.087558 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9e3f0-08e5-432a-8763-9a686c643e06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:34.089500 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9e3f0-08e5-432a-8763-9a686c643e06 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:34.116572 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1015/2045] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:13:34 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:34.120767 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8fc149-38f4-4699-911a-81abe5895571 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:34.132055 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8fc149-38f4-4699-911a-81abe5895571 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:34.152362 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:34.192547 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d0a03-fdfa-44d5-9495-5cffc05eb27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:34.193382 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d0a03-fdfa-44d5-9495-5cffc05eb27e admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:34.193663 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d0a03-fdfa-44d5-9495-5cffc05eb27e admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:34.193938 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d0a03-fdfa-44d5-9495-5cffc05eb27e admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:34.194640 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533d0a03-fdfa-44d5-9495-5cffc05eb27e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:34.196544 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533d0a03-fdfa-44d5-9495-5cffc05eb27e admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:34.221937 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1031/2046] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:13:34 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:13:34.225840 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9e3f0-08e5-432a-8763-9a686c643e06 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:34.237241 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9e3f0-08e5-432a-8763-9a686c643e06 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:34.241915 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc455a2f-beef-4005-86b0-d0ab80b72a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:34.242576 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc455a2f-beef-4005-86b0-d0ab80b72a2e admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:34.242861 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc455a2f-beef-4005-86b0-d0ab80b72a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:34.243141 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc455a2f-beef-4005-86b0-d0ab80b72a2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:34.243877 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc455a2f-beef-4005-86b0-d0ab80b72a2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:34.245723 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc455a2f-beef-4005-86b0-d0ab80b72a2e admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:34.256908 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1016/2047] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:34.260947 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d0a03-fdfa-44d5-9495-5cffc05eb27e admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:34.272016 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d0a03-fdfa-44d5-9495-5cffc05eb27e admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:34.276631 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b66f9c-1f7a-4b21-9d1a-e4fd181a4fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:34.277544 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b66f9c-1f7a-4b21-9d1a-e4fd181a4fcd admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:34.277832 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b66f9c-1f7a-4b21-9d1a-e4fd181a4fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:34.278138 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b66f9c-1f7a-4b21-9d1a-e4fd181a4fcd admin admin] PATH_INFO: `/v3/projects/26139c2af19c42418840aff7f5fe446a/users/8e11b9c0b70d418087e81328e4fffd68/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:34.292852 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b66f9c-1f7a-4b21-9d1a-e4fd181a4fcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=26139c2af19c42418840aff7f5fe446a, user_id=8e11b9c0b70d418087e81328e4fffd68, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:34.295579 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b66f9c-1f7a-4b21-9d1a-e4fd181a4fcd admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:34.308149 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1032/2048] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:13:34 2022] PUT /identity/v3/projects/26139c2af19c42418840aff7f5fe446a/users/8e11b9c0b70d418087e81328e4fffd68/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:34.312565 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc455a2f-beef-4005-86b0-d0ab80b72a2e admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:34.323381 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc455a2f-beef-4005-86b0-d0ab80b72a2e admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:34.380298 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e00335-166b-4e87-a91b-467fee434ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:34.380988 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e00335-166b-4e87-a91b-467fee434ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:34.381276 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e00335-166b-4e87-a91b-467fee434ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:34.381551 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e00335-166b-4e87-a91b-467fee434ba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:34.382267 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e00335-166b-4e87-a91b-467fee434ba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:34.383847 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e00335-166b-4e87-a91b-467fee434ba3 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:34.388757 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:34.394666 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1017/2049] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:34.398702 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b66f9c-1f7a-4b21-9d1a-e4fd181a4fcd admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:34.409590 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b66f9c-1f7a-4b21-9d1a-e4fd181a4fcd admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:34.414278 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7298733f-4ca7-4eab-a386-533456f61d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:34.415205 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298733f-4ca7-4eab-a386-533456f61d98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:34.415487 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298733f-4ca7-4eab-a386-533456f61d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:34.415783 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298733f-4ca7-4eab-a386-533456f61d98 admin admin] PATH_INFO: `/v3/projects/26139c2af19c42418840aff7f5fe446a/users/8e11b9c0b70d418087e81328e4fffd68/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:34.417801 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7298733f-4ca7-4eab-a386-533456f61d98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26139c2af19c42418840aff7f5fe446a, user_id=8e11b9c0b70d418087e81328e4fffd68, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:34.420415 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7298733f-4ca7-4eab-a386-533456f61d98 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:34.430600 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1033/2050] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:13:34 2022] PUT /identity/v3/projects/26139c2af19c42418840aff7f5fe446a/users/8e11b9c0b70d418087e81328e4fffd68/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:34.441975 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d2be7-0a01-4c66-8ca6-22d6f7a5c410 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:34.442294 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d2be7-0a01-4c66-8ca6-22d6f7a5c410 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:34.442576 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d2be7-0a01-4c66-8ca6-22d6f7a5c410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:34.469423 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-669d2be7-0a01-4c66-8ca6-22d6f7a5c410 None None] MFA Rules not processed for user `8e11b9c0b70d418087e81328e4fffd68`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:34.470785 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-669d2be7-0a01-4c66-8ca6-22d6f7a5c410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:34.540219 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1018/2051] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:13:34 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:34.551819 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7298733f-4ca7-4eab-a386-533456f61d98 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:34.553564 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-7298733f-4ca7-4eab-a386-533456f61d98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:34.613241 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7298733f-4ca7-4eab-a386-533456f61d98 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:34.616827 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7217c4a0-061a-4e1e-937d-071e7ebb2d87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:34.617473 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217c4a0-061a-4e1e-937d-071e7ebb2d87 service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:34.617758 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217c4a0-061a-4e1e-937d-071e7ebb2d87 service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:34.618036 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217c4a0-061a-4e1e-937d-071e7ebb2d87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:34.674761 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7217c4a0-061a-4e1e-937d-071e7ebb2d87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:34.676743 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7217c4a0-061a-4e1e-937d-071e7ebb2d87 service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:34.685801 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1034/2052] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:38.244971 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d2be7-0a01-4c66-8ca6-22d6f7a5c410 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:38.306681 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d2be7-0a01-4c66-8ca6-22d6f7a5c410 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:38.311156 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e9662f-b3de-4307-b493-e35e896a3933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:38.312524 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9662f-b3de-4307-b493-e35e896a3933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:38.313064 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9662f-b3de-4307-b493-e35e896a3933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:38.313179 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9662f-b3de-4307-b493-e35e896a3933 admin admin] PATH_INFO: `/v3/users/7917f5d580d54d4584810282b2329070` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:38.314276 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e9662f-b3de-4307-b493-e35e896a3933 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7917f5d580d54d4584810282b2329070)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:38.316186 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e9662f-b3de-4307-b493-e35e896a3933 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:38.362743 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-f1e9662f-b3de-4307-b493-e35e896a3933 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7917f5d580d54d4584810282b2329070'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:38.370319 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-f1e9662f-b3de-4307-b493-e35e896a3933 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7917f5d580d54d4584810282b2329070'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:38.371011 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-f1e9662f-b3de-4307-b493-e35e896a3933 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7917f5d580d54d4584810282b2329070'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:38.371671 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-f1e9662f-b3de-4307-b493-e35e896a3933 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7917f5d580d54d4584810282b2329070'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:38.385211 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-f1e9662f-b3de-4307-b493-e35e896a3933 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7917f5d580d54d4584810282b2329070'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:38.397833 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1019/2053] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:13:38 2022] DELETE /identity/v3/users/7917f5d580d54d4584810282b2329070 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:38.402289 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86844e62-b28c-4dde-a07e-f4d0c415c591 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:38.402764 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86844e62-b28c-4dde-a07e-f4d0c415c591 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:38.402863 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86844e62-b28c-4dde-a07e-f4d0c415c591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:38.424490 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-86844e62-b28c-4dde-a07e-f4d0c415c591 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:38.425825 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-86844e62-b28c-4dde-a07e-f4d0c415c591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:38.454103 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:38.488541 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1035/2054] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:13:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:38.498056 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e9662f-b3de-4307-b493-e35e896a3933 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:38.500299 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-f1e9662f-b3de-4307-b493-e35e896a3933 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:38.506789 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:38.561540 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e9662f-b3de-4307-b493-e35e896a3933 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:38.565906 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a57724-800d-41f2-a030-b54c87757d0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:38.566589 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a57724-800d-41f2-a030-b54c87757d0e service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:38.566871 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a57724-800d-41f2-a030-b54c87757d0e service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:38.567147 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a57724-800d-41f2-a030-b54c87757d0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:38.576339 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a57724-800d-41f2-a030-b54c87757d0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:38.577935 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a57724-800d-41f2-a030-b54c87757d0e service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:38.587504 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1020/2055] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:38.852395 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86844e62-b28c-4dde-a07e-f4d0c415c591 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:38.854243 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-86844e62-b28c-4dde-a07e-f4d0c415c591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:38.871429 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86844e62-b28c-4dde-a07e-f4d0c415c591 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:38.877953 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611dc2c1-e067-4a7a-8abb-76c3c0fdf021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:38.879112 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611dc2c1-e067-4a7a-8abb-76c3c0fdf021 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:38.879595 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611dc2c1-e067-4a7a-8abb-76c3c0fdf021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:38.880155 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611dc2c1-e067-4a7a-8abb-76c3c0fdf021 admin admin] PATH_INFO: `/v3/projects/06b89d2ee7604a2b924bd48be1ccc1a5` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:38.881614 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611dc2c1-e067-4a7a-8abb-76c3c0fdf021 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06b89d2ee7604a2b924bd48be1ccc1a5)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:38.886831 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611dc2c1-e067-4a7a-8abb-76c3c0fdf021 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:38.943306 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-611dc2c1-e067-4a7a-8abb-76c3c0fdf021 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06b89d2ee7604a2b924bd48be1ccc1a5', 'request_id': 'req-611dc2c1-e067-4a7a-8abb-76c3c0fdf021'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:38.951249 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-611dc2c1-e067-4a7a-8abb-76c3c0fdf021 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06b89d2ee7604a2b924bd48be1ccc1a5', 'request_id': 'req-611dc2c1-e067-4a7a-8abb-76c3c0fdf021'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:38.960628 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-611dc2c1-e067-4a7a-8abb-76c3c0fdf021 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06b89d2ee7604a2b924bd48be1ccc1a5', 'request_id': 'req-611dc2c1-e067-4a7a-8abb-76c3c0fdf021'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:38.972489 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-611dc2c1-e067-4a7a-8abb-76c3c0fdf021 admin admin] The token cache is being invalidate because project 06b89d2ee7604a2b924bd48be1ccc1a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:13:38.972812 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-611dc2c1-e067-4a7a-8abb-76c3c0fdf021 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:38.973500 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-611dc2c1-e067-4a7a-8abb-76c3c0fdf021 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:38.975449 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1036/2056] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:13:38 2022] DELETE /identity/v3/projects/06b89d2ee7604a2b924bd48be1ccc1a5 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:38.979242 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a57724-800d-41f2-a030-b54c87757d0e service neutron] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:38.991071 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a57724-800d-41f2-a030-b54c87757d0e service neutron] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:39.058171 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d02f1e-177f-4849-828d-a5f043343696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:39.058171 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d02f1e-177f-4849-828d-a5f043343696 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:39.058171 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d02f1e-177f-4849-828d-a5f043343696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:39.058171 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d02f1e-177f-4849-828d-a5f043343696 admin admin] PATH_INFO: `/v3/users/8e11b9c0b70d418087e81328e4fffd68` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:39.058549 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d02f1e-177f-4849-828d-a5f043343696 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e11b9c0b70d418087e81328e4fffd68)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:39.058549 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d02f1e-177f-4849-828d-a5f043343696 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:39.103026 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-93d02f1e-177f-4849-828d-a5f043343696 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e11b9c0b70d418087e81328e4fffd68'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:39.110648 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-93d02f1e-177f-4849-828d-a5f043343696 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e11b9c0b70d418087e81328e4fffd68'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:39.111265 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-93d02f1e-177f-4849-828d-a5f043343696 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e11b9c0b70d418087e81328e4fffd68'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:39.111859 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-93d02f1e-177f-4849-828d-a5f043343696 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e11b9c0b70d418087e81328e4fffd68'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:39.125489 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-93d02f1e-177f-4849-828d-a5f043343696 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e11b9c0b70d418087e81328e4fffd68'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:39.137692 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1021/2057] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:13:38 2022] DELETE /identity/v3/users/8e11b9c0b70d418087e81328e4fffd68 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:13:39.409212 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611dc2c1-e067-4a7a-8abb-76c3c0fdf021 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:39.410836 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-611dc2c1-e067-4a7a-8abb-76c3c0fdf021 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:39.429461 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611dc2c1-e067-4a7a-8abb-76c3c0fdf021 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:39.490101 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9491ce-1bdf-4de1-869a-91ab02e52fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:39.490967 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9491ce-1bdf-4de1-869a-91ab02e52fab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:39.491250 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9491ce-1bdf-4de1-869a-91ab02e52fab admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:39.491526 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9491ce-1bdf-4de1-869a-91ab02e52fab admin admin] PATH_INFO: `/v3/projects/26139c2af19c42418840aff7f5fe446a` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:39.492736 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9491ce-1bdf-4de1-869a-91ab02e52fab admin admin] RBAC: Authorizing `identity:delete_project(project_id=26139c2af19c42418840aff7f5fe446a)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:39.494725 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9491ce-1bdf-4de1-869a-91ab02e52fab admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:39.540136 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-5e9491ce-1bdf-4de1-869a-91ab02e52fab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26139c2af19c42418840aff7f5fe446a', 'request_id': 'req-5e9491ce-1bdf-4de1-869a-91ab02e52fab'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:39.544547 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:39.545762 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-5e9491ce-1bdf-4de1-869a-91ab02e52fab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26139c2af19c42418840aff7f5fe446a', 'request_id': 'req-5e9491ce-1bdf-4de1-869a-91ab02e52fab'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:39.554338 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-5e9491ce-1bdf-4de1-869a-91ab02e52fab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26139c2af19c42418840aff7f5fe446a', 'request_id': 'req-5e9491ce-1bdf-4de1-869a-91ab02e52fab'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:39.565283 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-5e9491ce-1bdf-4de1-869a-91ab02e52fab admin admin] The token cache is being invalidate because project 26139c2af19c42418840aff7f5fe446a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:13:39.565632 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-5e9491ce-1bdf-4de1-869a-91ab02e52fab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:39.566283 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-5e9491ce-1bdf-4de1-869a-91ab02e52fab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:39.567831 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1037/2058] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:13:39 2022] DELETE /identity/v3/projects/26139c2af19c42418840aff7f5fe446a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:39.572690 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1395f3-1f30-4a55-b712-74a4a91c8e05 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:39.573135 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1395f3-1f30-4a55-b712-74a4a91c8e05 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:39.573493 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1395f3-1f30-4a55-b712-74a4a91c8e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:39.603141 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-bc1395f3-1f30-4a55-b712-74a4a91c8e05 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:39.604543 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-bc1395f3-1f30-4a55-b712-74a4a91c8e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:39.618485 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:39.667852 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1022/2059] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:13:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:39.676419 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df3c8c-0275-4ca9-8b65-d65b17bbfe61 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:39.676757 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df3c8c-0275-4ca9-8b65-d65b17bbfe61 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:39.677038 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df3c8c-0275-4ca9-8b65-d65b17bbfe61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:39.696107 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-c2df3c8c-0275-4ca9-8b65-d65b17bbfe61 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:39.697355 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-c2df3c8c-0275-4ca9-8b65-d65b17bbfe61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:39.705506 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1038/2060] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:13:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:13:39.709676 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1395f3-1f30-4a55-b712-74a4a91c8e05 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:39.720802 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1395f3-1f30-4a55-b712-74a4a91c8e05 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:39.725320 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61870184-9249-4acf-9218-11033939df1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:39.725969 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61870184-9249-4acf-9218-11033939df1c admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:39.726247 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61870184-9249-4acf-9218-11033939df1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:39.726543 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61870184-9249-4acf-9218-11033939df1c admin admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:39.727267 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61870184-9249-4acf-9218-11033939df1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:13:39.727571 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61870184-9249-4acf-9218-11033939df1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:39.729196 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61870184-9249-4acf-9218-11033939df1c admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:39.741533 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1023/2061] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:13:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:13:39.745693 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df3c8c-0275-4ca9-8b65-d65b17bbfe61 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:39.755221 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df3c8c-0275-4ca9-8b65-d65b17bbfe61 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:39.759804 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2530e6-6321-4092-9743-fdf47d694247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:39.760436 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2530e6-6321-4092-9743-fdf47d694247 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:39.760747 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2530e6-6321-4092-9743-fdf47d694247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:39.761023 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2530e6-6321-4092-9743-fdf47d694247 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:39.761706 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2530e6-6321-4092-9743-fdf47d694247 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:39.763584 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2530e6-6321-4092-9743-fdf47d694247 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:39.789363 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1039/2062] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:13:39 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:13:39.793491 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61870184-9249-4acf-9218-11033939df1c admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:39.804436 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61870184-9249-4acf-9218-11033939df1c admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:39.861707 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83153ed1-6ea8-4115-a0c1-17853b60a5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:39.862375 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83153ed1-6ea8-4115-a0c1-17853b60a5da admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:39.862659 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83153ed1-6ea8-4115-a0c1-17853b60a5da admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:39.862933 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83153ed1-6ea8-4115-a0c1-17853b60a5da admin admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:39.863628 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83153ed1-6ea8-4115-a0c1-17853b60a5da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:39.865583 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83153ed1-6ea8-4115-a0c1-17853b60a5da admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:39.884411 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1024/2063] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:13:39 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:39.888459 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2530e6-6321-4092-9743-fdf47d694247 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:39.907780 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2530e6-6321-4092-9743-fdf47d694247 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:39.913785 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0745082-161a-4276-a134-24d81f72e7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:39.914465 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0745082-161a-4276-a134-24d81f72e7f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:39.914745 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0745082-161a-4276-a134-24d81f72e7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:39.915018 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0745082-161a-4276-a134-24d81f72e7f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:39.916178 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0745082-161a-4276-a134-24d81f72e7f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:39.917948 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0745082-161a-4276-a134-24d81f72e7f4 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:39.934006 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1040/2064] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:39.935149 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83153ed1-6ea8-4115-a0c1-17853b60a5da admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:39.945517 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83153ed1-6ea8-4115-a0c1-17853b60a5da admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:39.950163 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239937ca-acb1-4a8b-9dec-8868deab299a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:39.950817 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239937ca-acb1-4a8b-9dec-8868deab299a admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:39.951096 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239937ca-acb1-4a8b-9dec-8868deab299a admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:39.951369 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239937ca-acb1-4a8b-9dec-8868deab299a admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:39.952096 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239937ca-acb1-4a8b-9dec-8868deab299a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:39.954831 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239937ca-acb1-4a8b-9dec-8868deab299a admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:39.965396 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1025/2065] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:13:39.970307 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0745082-161a-4276-a134-24d81f72e7f4 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:39.980284 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0745082-161a-4276-a134-24d81f72e7f4 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:39.985511 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf6b9a6-3832-46ab-b481-e061e99af55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:39.986399 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6b9a6-3832-46ab-b481-e061e99af55c admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:39.986679 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6b9a6-3832-46ab-b481-e061e99af55c admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:39.986984 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6b9a6-3832-46ab-b481-e061e99af55c admin admin] PATH_INFO: `/v3/projects/b38a00f3ffb54dafae0998b26c2478a1/users/308284e2c67341d181eac71cf19f92c6/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:40.004072 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf6b9a6-3832-46ab-b481-e061e99af55c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b38a00f3ffb54dafae0998b26c2478a1, user_id=308284e2c67341d181eac71cf19f92c6, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:40.006754 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf6b9a6-3832-46ab-b481-e061e99af55c admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:40.021127 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1041/2066] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:13:39 2022] PUT /identity/v3/projects/b38a00f3ffb54dafae0998b26c2478a1/users/308284e2c67341d181eac71cf19f92c6/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:13:40.026395 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53759b45-8562-4a72-8cfa-86bb08ee95e6 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:40.026685 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53759b45-8562-4a72-8cfa-86bb08ee95e6 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:40.026985 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53759b45-8562-4a72-8cfa-86bb08ee95e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:40.046077 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-53759b45-8562-4a72-8cfa-86bb08ee95e6 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:40.047637 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-53759b45-8562-4a72-8cfa-86bb08ee95e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:40.114038 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1026/2067] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:13:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:40.123332 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf6b9a6-3832-46ab-b481-e061e99af55c admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:40.125322 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-8cf6b9a6-3832-46ab-b481-e061e99af55c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:40.185136 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf6b9a6-3832-46ab-b481-e061e99af55c admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:40.189149 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da974d5-6c18-469b-8117-760b28810b3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:40.189793 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da974d5-6c18-469b-8117-760b28810b3c service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:40.190078 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da974d5-6c18-469b-8117-760b28810b3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:40.190351 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da974d5-6c18-469b-8117-760b28810b3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:40.200051 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da974d5-6c18-469b-8117-760b28810b3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:40.201661 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da974d5-6c18-469b-8117-760b28810b3c service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:40.212686 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1042/2068] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:40.826045 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36dd058-e063-461f-9465-aa331bbec9b1 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:40.826584 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36dd058-e063-461f-9465-aa331bbec9b1 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:40.826679 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36dd058-e063-461f-9465-aa331bbec9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:40.853624 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-f36dd058-e063-461f-9465-aa331bbec9b1 None None] MFA Rules not processed for user `308284e2c67341d181eac71cf19f92c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:40.854830 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-f36dd058-e063-461f-9465-aa331bbec9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:40.868356 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:40.927753 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1027/2069] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:13:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:40.939435 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da974d5-6c18-469b-8117-760b28810b3c service neutron] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:40.940934 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-2da974d5-6c18-469b-8117-760b28810b3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:41.001636 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da974d5-6c18-469b-8117-760b28810b3c service neutron] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:41.005278 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be9899-d6b7-4b16-8afe-2cd264fcfbf7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:41.005936 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be9899-d6b7-4b16-8afe-2cd264fcfbf7 service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:41.006220 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be9899-d6b7-4b16-8afe-2cd264fcfbf7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:41.006500 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be9899-d6b7-4b16-8afe-2cd264fcfbf7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:41.015072 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05be9899-d6b7-4b16-8afe-2cd264fcfbf7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:41.016743 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05be9899-d6b7-4b16-8afe-2cd264fcfbf7 service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:41.026002 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1043/2070] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:43.442450 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bdbbdd-c0ce-4130-9092-69ba95ea7403 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:43.442980 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bdbbdd-c0ce-4130-9092-69ba95ea7403 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:43.443075 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bdbbdd-c0ce-4130-9092-69ba95ea7403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:43.461412 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-32bdbbdd-c0ce-4130-9092-69ba95ea7403 None None] MFA Rules not processed for user `308284e2c67341d181eac71cf19f92c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:43.462618 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-32bdbbdd-c0ce-4130-9092-69ba95ea7403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:43.470602 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1028/2071] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:13:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:51.021755 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=84,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:53.455647 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=24 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:02.168361 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be9899-d6b7-4b16-8afe-2cd264fcfbf7 service cinder] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:02.169834 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-05be9899-d6b7-4b16-8afe-2cd264fcfbf7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:02.183513 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be9899-d6b7-4b16-8afe-2cd264fcfbf7 service cinder] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:02.188367 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4812b6-04e1-4b58-949f-fd6c6239c123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:02.189238 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4812b6-04e1-4b58-949f-fd6c6239c123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:02.189517 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4812b6-04e1-4b58-949f-fd6c6239c123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:02.189785 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4812b6-04e1-4b58-949f-fd6c6239c123 admin admin] PATH_INFO: `/v3/users/04f84a274d4547e0a02716c7fc0e72be` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:02.190953 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4812b6-04e1-4b58-949f-fd6c6239c123 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04f84a274d4547e0a02716c7fc0e72be)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:02.192887 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4812b6-04e1-4b58-949f-fd6c6239c123 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:02.239305 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-9b4812b6-04e1-4b58-949f-fd6c6239c123 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04f84a274d4547e0a02716c7fc0e72be'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:02.248178 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-9b4812b6-04e1-4b58-949f-fd6c6239c123 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04f84a274d4547e0a02716c7fc0e72be'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:02.256346 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-9b4812b6-04e1-4b58-949f-fd6c6239c123 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04f84a274d4547e0a02716c7fc0e72be'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:02.268957 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-9b4812b6-04e1-4b58-949f-fd6c6239c123 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04f84a274d4547e0a02716c7fc0e72be'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:02.269624 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-9b4812b6-04e1-4b58-949f-fd6c6239c123 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04f84a274d4547e0a02716c7fc0e72be'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:02.275505 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1044/2072] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:14:02 2022] DELETE /identity/v3/users/04f84a274d4547e0a02716c7fc0e72be => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:02.279911 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952da5b-45a8-449f-9cd2-a84121d9530d None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:02.280365 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952da5b-45a8-449f-9cd2-a84121d9530d None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:02.280475 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952da5b-45a8-449f-9cd2-a84121d9530d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:02.299675 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-9952da5b-45a8-449f-9cd2-a84121d9530d None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:02.300971 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-9952da5b-45a8-449f-9cd2-a84121d9530d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:02.366316 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1029/2073] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:14:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:02.376912 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4812b6-04e1-4b58-949f-fd6c6239c123 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:02.378300 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-9b4812b6-04e1-4b58-949f-fd6c6239c123 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:02.435839 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4812b6-04e1-4b58-949f-fd6c6239c123 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:02.440182 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22741af3-7841-4815-96cd-85216c1d395a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:02.440845 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22741af3-7841-4815-96cd-85216c1d395a service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:02.441127 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22741af3-7841-4815-96cd-85216c1d395a service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:02.441401 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22741af3-7841-4815-96cd-85216c1d395a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:02.450546 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22741af3-7841-4815-96cd-85216c1d395a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:02.451981 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22741af3-7841-4815-96cd-85216c1d395a service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:02.461973 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1045/2074] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:14:02.765949 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9952da5b-45a8-449f-9cd2-a84121d9530d None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:02.767476 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-9952da5b-45a8-449f-9cd2-a84121d9530d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:02.788029 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9952da5b-45a8-449f-9cd2-a84121d9530d None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:02.797885 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06d51bf-700e-4906-aead-9e8d24c864da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:02.798763 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d51bf-700e-4906-aead-9e8d24c864da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:02.799034 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d51bf-700e-4906-aead-9e8d24c864da admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:02.799346 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d51bf-700e-4906-aead-9e8d24c864da admin admin] PATH_INFO: `/v3/projects/248f06d996aa4a20a2c56fdef9550e12` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:02.800526 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06d51bf-700e-4906-aead-9e8d24c864da admin admin] RBAC: Authorizing `identity:delete_project(project_id=248f06d996aa4a20a2c56fdef9550e12)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:02.802462 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06d51bf-700e-4906-aead-9e8d24c864da admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:02.853488 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-a06d51bf-700e-4906-aead-9e8d24c864da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '248f06d996aa4a20a2c56fdef9550e12', 'request_id': 'req-a06d51bf-700e-4906-aead-9e8d24c864da'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:02.879356 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-a06d51bf-700e-4906-aead-9e8d24c864da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '248f06d996aa4a20a2c56fdef9550e12', 'request_id': 'req-a06d51bf-700e-4906-aead-9e8d24c864da'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:02.881766 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-a06d51bf-700e-4906-aead-9e8d24c864da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '248f06d996aa4a20a2c56fdef9550e12', 'request_id': 'req-a06d51bf-700e-4906-aead-9e8d24c864da'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:02.893524 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-a06d51bf-700e-4906-aead-9e8d24c864da admin admin] The token cache is being invalidate because project 248f06d996aa4a20a2c56fdef9550e12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:02.893814 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-a06d51bf-700e-4906-aead-9e8d24c864da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:02.894469 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-a06d51bf-700e-4906-aead-9e8d24c864da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:02.896678 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1030/2075] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:02 2022] DELETE /identity/v3/projects/248f06d996aa4a20a2c56fdef9550e12 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:02.901271 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aaa593-571d-474b-814b-e51364e5798a None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:02.901850 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aaa593-571d-474b-814b-e51364e5798a None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:02.902418 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aaa593-571d-474b-814b-e51364e5798a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:02.930587 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-f1aaa593-571d-474b-814b-e51364e5798a None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:02.931964 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-f1aaa593-571d-474b-814b-e51364e5798a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:03.003454 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1046/2076] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:14:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:03.011657 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be520b0-b88c-486e-8382-c20f5e999fef None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:03.011946 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be520b0-b88c-486e-8382-c20f5e999fef None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:03.012226 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be520b0-b88c-486e-8382-c20f5e999fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:03.032172 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-0be520b0-b88c-486e-8382-c20f5e999fef None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:03.033430 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-0be520b0-b88c-486e-8382-c20f5e999fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:03.041408 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1031/2077] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:14:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:03.045838 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aaa593-571d-474b-814b-e51364e5798a None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:03.057356 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aaa593-571d-474b-814b-e51364e5798a None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:03.065631 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d85f0b-ec0a-48dc-b430-abb2a1bc2c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:03.066652 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d85f0b-ec0a-48dc-b430-abb2a1bc2c69 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:03.066941 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d85f0b-ec0a-48dc-b430-abb2a1bc2c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:03.067213 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d85f0b-ec0a-48dc-b430-abb2a1bc2c69 admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:03.068100 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d85f0b-ec0a-48dc-b430-abb2a1bc2c69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:14:03.068544 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d85f0b-ec0a-48dc-b430-abb2a1bc2c69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:03.071293 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d85f0b-ec0a-48dc-b430-abb2a1bc2c69 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:03.086482 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1047/2078] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:14:03.087601 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be520b0-b88c-486e-8382-c20f5e999fef None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:03.097972 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be520b0-b88c-486e-8382-c20f5e999fef None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:03.102636 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7456ea-b24d-47bd-aad8-353945813f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:03.103288 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7456ea-b24d-47bd-aad8-353945813f37 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:03.103568 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7456ea-b24d-47bd-aad8-353945813f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:03.103843 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7456ea-b24d-47bd-aad8-353945813f37 admin admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:03.104546 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7456ea-b24d-47bd-aad8-353945813f37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:03.106502 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7456ea-b24d-47bd-aad8-353945813f37 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:03.137006 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1032/2079] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:14:03 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:14:03.138461 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d85f0b-ec0a-48dc-b430-abb2a1bc2c69 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:03.144283 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:03.150804 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d85f0b-ec0a-48dc-b430-abb2a1bc2c69 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:03.211731 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b841b39-1b2c-421a-ad6d-52d6fb0c2d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:03.212437 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b841b39-1b2c-421a-ad6d-52d6fb0c2d67 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:03.212748 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b841b39-1b2c-421a-ad6d-52d6fb0c2d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:03.213032 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b841b39-1b2c-421a-ad6d-52d6fb0c2d67 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:03.213724 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b841b39-1b2c-421a-ad6d-52d6fb0c2d67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:03.215762 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b841b39-1b2c-421a-ad6d-52d6fb0c2d67 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:03.235898 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1048/2080] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:14:03 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:03.239837 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7456ea-b24d-47bd-aad8-353945813f37 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:03.249992 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7456ea-b24d-47bd-aad8-353945813f37 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:03.254629 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269b5750-16bd-4eda-870b-cc08b62b4d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:03.255280 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b5750-16bd-4eda-870b-cc08b62b4d28 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:03.255565 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b5750-16bd-4eda-870b-cc08b62b4d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:03.255843 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b5750-16bd-4eda-870b-cc08b62b4d28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:03.256570 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269b5750-16bd-4eda-870b-cc08b62b4d28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:03.258213 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269b5750-16bd-4eda-870b-cc08b62b4d28 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:03.268944 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1033/2081] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:03.272535 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b841b39-1b2c-421a-ad6d-52d6fb0c2d67 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:03.283796 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b841b39-1b2c-421a-ad6d-52d6fb0c2d67 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:03.288411 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1848b9-6886-4c03-99d0-f1bc464ab7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:03.289164 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1848b9-6886-4c03-99d0-f1bc464ab7c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:03.289451 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1848b9-6886-4c03-99d0-f1bc464ab7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:03.289729 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1848b9-6886-4c03-99d0-f1bc464ab7c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:03.290466 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1848b9-6886-4c03-99d0-f1bc464ab7c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:03.292158 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1848b9-6886-4c03-99d0-f1bc464ab7c4 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:03.304130 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1049/2082] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:03.308311 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269b5750-16bd-4eda-870b-cc08b62b4d28 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:03.318617 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269b5750-16bd-4eda-870b-cc08b62b4d28 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:03.323560 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a1de53-6e74-458e-a043-a4cdf4ef9e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:03.324429 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1de53-6e74-458e-a043-a4cdf4ef9e39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:03.324782 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1de53-6e74-458e-a043-a4cdf4ef9e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:03.325006 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1de53-6e74-458e-a043-a4cdf4ef9e39 admin admin] PATH_INFO: `/v3/projects/b5779059557f42f6a6cd758c4538136b/users/646ece2e4b4d4c98bad74c0e40a219c7/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:03.339851 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a1de53-6e74-458e-a043-a4cdf4ef9e39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5779059557f42f6a6cd758c4538136b, user_id=646ece2e4b4d4c98bad74c0e40a219c7, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:03.342523 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a1de53-6e74-458e-a043-a4cdf4ef9e39 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:03.355700 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1034/2083] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:03 2022] PUT /identity/v3/projects/b5779059557f42f6a6cd758c4538136b/users/646ece2e4b4d4c98bad74c0e40a219c7/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:03.366374 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e897c-0f05-4845-ad36-7a9dd85ca037 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:03.366671 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e897c-0f05-4845-ad36-7a9dd85ca037 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:03.366951 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e897c-0f05-4845-ad36-7a9dd85ca037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:03.393300 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-d27e897c-0f05-4845-ad36-7a9dd85ca037 None None] MFA Rules not processed for user `646ece2e4b4d4c98bad74c0e40a219c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:03.394545 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-d27e897c-0f05-4845-ad36-7a9dd85ca037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:03.459648 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1050/2084] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:14:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:03.471195 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a1de53-6e74-458e-a043-a4cdf4ef9e39 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:03.472919 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-09a1de53-6e74-458e-a043-a4cdf4ef9e39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:03.496215 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:03.552942 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a1de53-6e74-458e-a043-a4cdf4ef9e39 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:03.556546 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e6701-8679-4359-b3ea-8a40b438453d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:03.557213 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e6701-8679-4359-b3ea-8a40b438453d service cinder] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:03.557492 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e6701-8679-4359-b3ea-8a40b438453d service cinder] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:03.557763 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e6701-8679-4359-b3ea-8a40b438453d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:03.565885 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35e6701-8679-4359-b3ea-8a40b438453d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:03.567529 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35e6701-8679-4359-b3ea-8a40b438453d service cinder] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:03.576134 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1035/2085] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:13.456572 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=65,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:13.572185 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=26 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:15.918141 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527e298-2fe9-4f28-9e86-8f76f838ea18 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:15.918647 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527e298-2fe9-4f28-9e86-8f76f838ea18 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:15.918769 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527e298-2fe9-4f28-9e86-8f76f838ea18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:15.936584 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-0527e298-2fe9-4f28-9e86-8f76f838ea18 None None] MFA Rules not processed for user `e1516d2903414b7caf082c32dcdac3eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:15.938067 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-0527e298-2fe9-4f28-9e86-8f76f838ea18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:15.996204 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1051/2086] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:14:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:19.639256 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e6701-8679-4359-b3ea-8a40b438453d service cinder] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:19.640656 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-b35e6701-8679-4359-b3ea-8a40b438453d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:19.716994 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527e298-2fe9-4f28-9e86-8f76f838ea18 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:19.718442 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-0527e298-2fe9-4f28-9e86-8f76f838ea18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:19.743109 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e6701-8679-4359-b3ea-8a40b438453d service cinder] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:19.748748 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356026a-e864-49ba-a7b3-768eba53fc34 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f0f9248178049cda6571fa365a21225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:19.749397 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356026a-e864-49ba-a7b3-768eba53fc34 service placement] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:19.749683 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356026a-e864-49ba-a7b3-768eba53fc34 service placement] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:19.750041 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356026a-e864-49ba-a7b3-768eba53fc34 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:19.751753 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-c356026a-e864-49ba-a7b3-768eba53fc34 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:19.763308 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c356026a-e864-49ba-a7b3-768eba53fc34 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:19.764917 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c356026a-e864-49ba-a7b3-768eba53fc34 service placement] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:19.775482 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1036/2087] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:19.789779 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527e298-2fe9-4f28-9e86-8f76f838ea18 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:19.795374 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc32cb24-4752-493c-b120-d9c126d48f3d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f0f9248178049cda6571fa365a21225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:19.796034 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32cb24-4752-493c-b120-d9c126d48f3d service placement] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:19.796312 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32cb24-4752-493c-b120-d9c126d48f3d service placement] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:19.796610 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32cb24-4752-493c-b120-d9c126d48f3d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:19.805891 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc32cb24-4752-493c-b120-d9c126d48f3d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:19.807465 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc32cb24-4752-493c-b120-d9c126d48f3d service placement] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:19.818593 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1052/2088] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:14:27.495020 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356026a-e864-49ba-a7b3-768eba53fc34 service placement] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:27.497266 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-c356026a-e864-49ba-a7b3-768eba53fc34 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:27.570696 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356026a-e864-49ba-a7b3-768eba53fc34 service placement] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:27.576020 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bdab23-028c-476d-a255-bfb0b3b59e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:27.586131 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdab23-028c-476d-a255-bfb0b3b59e99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:27.586870 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdab23-028c-476d-a255-bfb0b3b59e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:27.587386 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdab23-028c-476d-a255-bfb0b3b59e99 admin admin] PATH_INFO: `/v3/users/38af438e8812403d93cb4a41947d7e39` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:27.588994 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bdab23-028c-476d-a255-bfb0b3b59e99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38af438e8812403d93cb4a41947d7e39)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:27.591175 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bdab23-028c-476d-a255-bfb0b3b59e99 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:27.652109 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-56bdab23-028c-476d-a255-bfb0b3b59e99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38af438e8812403d93cb4a41947d7e39'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:27.662524 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-56bdab23-028c-476d-a255-bfb0b3b59e99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38af438e8812403d93cb4a41947d7e39'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:27.664068 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-56bdab23-028c-476d-a255-bfb0b3b59e99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38af438e8812403d93cb4a41947d7e39'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:27.664297 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-56bdab23-028c-476d-a255-bfb0b3b59e99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38af438e8812403d93cb4a41947d7e39'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:27.681149 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-56bdab23-028c-476d-a255-bfb0b3b59e99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38af438e8812403d93cb4a41947d7e39'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:27.682563 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:27.699501 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1037/2089] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:14:27 2022] DELETE /identity/v3/users/38af438e8812403d93cb4a41947d7e39 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:27.704574 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da7ac1-852d-4fc4-a699-1e06abcaf4e3 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:27.705102 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da7ac1-852d-4fc4-a699-1e06abcaf4e3 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:27.705288 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da7ac1-852d-4fc4-a699-1e06abcaf4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:27.725685 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-13da7ac1-852d-4fc4-a699-1e06abcaf4e3 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:27.726945 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-13da7ac1-852d-4fc4-a699-1e06abcaf4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:27.826994 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1053/2090] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:14:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:27.848227 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bdab23-028c-476d-a255-bfb0b3b59e99 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:27.849807 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-56bdab23-028c-476d-a255-bfb0b3b59e99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:27.943429 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bdab23-028c-476d-a255-bfb0b3b59e99 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:27.951786 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4e0f4-e6a7-4de9-a896-d7ed57d56776 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:27.952610 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4e0f4-e6a7-4de9-a896-d7ed57d56776 service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:27.952981 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4e0f4-e6a7-4de9-a896-d7ed57d56776 service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:27.953258 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4e0f4-e6a7-4de9-a896-d7ed57d56776 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:27.972892 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb4e0f4-e6a7-4de9-a896-d7ed57d56776 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:27.974274 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb4e0f4-e6a7-4de9-a896-d7ed57d56776 service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:27.987685 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1038/2091] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:28.517028 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13da7ac1-852d-4fc4-a699-1e06abcaf4e3 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:28.519210 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-13da7ac1-852d-4fc4-a699-1e06abcaf4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:28.537202 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13da7ac1-852d-4fc4-a699-1e06abcaf4e3 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:28.549519 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388c405-1a5a-4924-b14c-a5bd2cb2d477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:28.551072 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388c405-1a5a-4924-b14c-a5bd2cb2d477 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:28.553527 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388c405-1a5a-4924-b14c-a5bd2cb2d477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:28.553808 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388c405-1a5a-4924-b14c-a5bd2cb2d477 admin admin] PATH_INFO: `/v3/projects/d3f1bdea2fac49c289b00445415ac293` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:28.555099 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7388c405-1a5a-4924-b14c-a5bd2cb2d477 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3f1bdea2fac49c289b00445415ac293)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:28.559070 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7388c405-1a5a-4924-b14c-a5bd2cb2d477 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:28.594963 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:28.609429 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-7388c405-1a5a-4924-b14c-a5bd2cb2d477 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3f1bdea2fac49c289b00445415ac293', 'request_id': 'req-7388c405-1a5a-4924-b14c-a5bd2cb2d477'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:28.615235 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-7388c405-1a5a-4924-b14c-a5bd2cb2d477 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3f1bdea2fac49c289b00445415ac293', 'request_id': 'req-7388c405-1a5a-4924-b14c-a5bd2cb2d477'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:28.622563 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-7388c405-1a5a-4924-b14c-a5bd2cb2d477 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3f1bdea2fac49c289b00445415ac293', 'request_id': 'req-7388c405-1a5a-4924-b14c-a5bd2cb2d477'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:28.633803 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-7388c405-1a5a-4924-b14c-a5bd2cb2d477 admin admin] The token cache is being invalidate because project d3f1bdea2fac49c289b00445415ac293 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:28.634088 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-7388c405-1a5a-4924-b14c-a5bd2cb2d477 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:28.634711 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-7388c405-1a5a-4924-b14c-a5bd2cb2d477 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:28.636233 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1054/2092] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:28 2022] DELETE /identity/v3/projects/d3f1bdea2fac49c289b00445415ac293 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:28.641271 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9a7f6-a132-4b17-aa09-982da9a65d5a None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:28.641748 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9a7f6-a132-4b17-aa09-982da9a65d5a None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:28.641842 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9a7f6-a132-4b17-aa09-982da9a65d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:28.660783 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-40f9a7f6-a132-4b17-aa09-982da9a65d5a None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:28.661975 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-40f9a7f6-a132-4b17-aa09-982da9a65d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:28.725132 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1039/2093] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:14:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:28.733448 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582b096-9329-4a2b-bc95-4cf8a9734037 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:28.734123 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582b096-9329-4a2b-bc95-4cf8a9734037 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:28.734717 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582b096-9329-4a2b-bc95-4cf8a9734037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:28.753346 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-d582b096-9329-4a2b-bc95-4cf8a9734037 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:28.754657 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-d582b096-9329-4a2b-bc95-4cf8a9734037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:28.763914 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1055/2094] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:14:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:28.767540 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f9a7f6-a132-4b17-aa09-982da9a65d5a None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:28.778112 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f9a7f6-a132-4b17-aa09-982da9a65d5a None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:28.782771 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a718e7c6-42fb-4d82-a823-66f6246e1fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:28.783692 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718e7c6-42fb-4d82-a823-66f6246e1fbf admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:28.784572 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718e7c6-42fb-4d82-a823-66f6246e1fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:28.785081 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718e7c6-42fb-4d82-a823-66f6246e1fbf admin admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:28.785981 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a718e7c6-42fb-4d82-a823-66f6246e1fbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:14:28.786352 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a718e7c6-42fb-4d82-a823-66f6246e1fbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:28.788017 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a718e7c6-42fb-4d82-a823-66f6246e1fbf admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:28.800511 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1040/2095] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:14:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:14:28.804982 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582b096-9329-4a2b-bc95-4cf8a9734037 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:28.814997 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582b096-9329-4a2b-bc95-4cf8a9734037 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:28.820945 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed583ad3-4217-47eb-9af5-46546c71698b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:28.821756 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed583ad3-4217-47eb-9af5-46546c71698b admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:28.822223 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed583ad3-4217-47eb-9af5-46546c71698b admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:28.822987 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed583ad3-4217-47eb-9af5-46546c71698b admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:28.823221 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed583ad3-4217-47eb-9af5-46546c71698b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:28.825173 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed583ad3-4217-47eb-9af5-46546c71698b admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:28.861365 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1056/2096] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:14:28 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:14:28.864417 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a718e7c6-42fb-4d82-a823-66f6246e1fbf admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:28.880377 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a718e7c6-42fb-4d82-a823-66f6246e1fbf admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:28.958580 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9d17c-e25a-484e-99c0-07e1e537a1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:28.959260 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9d17c-e25a-484e-99c0-07e1e537a1b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:28.959552 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9d17c-e25a-484e-99c0-07e1e537a1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:28.959834 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9d17c-e25a-484e-99c0-07e1e537a1b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:28.960542 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb9d17c-e25a-484e-99c0-07e1e537a1b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:28.962678 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb9d17c-e25a-484e-99c0-07e1e537a1b3 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:28.990154 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1041/2097] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:14:28 2022] POST /identity/v3/users => generated 287 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:28.991275 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed583ad3-4217-47eb-9af5-46546c71698b admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:29.010294 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed583ad3-4217-47eb-9af5-46546c71698b admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:29.016403 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61cfc2-20dd-4d73-8f09-f1918c9c9cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:29.017113 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61cfc2-20dd-4d73-8f09-f1918c9c9cde admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:29.017401 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61cfc2-20dd-4d73-8f09-f1918c9c9cde admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:29.017679 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61cfc2-20dd-4d73-8f09-f1918c9c9cde admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:29.019081 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e61cfc2-20dd-4d73-8f09-f1918c9c9cde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:29.020689 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e61cfc2-20dd-4d73-8f09-f1918c9c9cde admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:29.032436 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1057/2098] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:28 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:29.036763 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9d17c-e25a-484e-99c0-07e1e537a1b3 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:29.046925 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9d17c-e25a-484e-99c0-07e1e537a1b3 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:29.051870 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46830edd-cb99-4258-b327-9ed5a9026907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:29.052538 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46830edd-cb99-4258-b327-9ed5a9026907 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:29.052856 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46830edd-cb99-4258-b327-9ed5a9026907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:29.053139 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46830edd-cb99-4258-b327-9ed5a9026907 admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:29.053881 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46830edd-cb99-4258-b327-9ed5a9026907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:29.055489 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46830edd-cb99-4258-b327-9ed5a9026907 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:29.057797 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:29.069945 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1042/2099] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:29.074435 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61cfc2-20dd-4d73-8f09-f1918c9c9cde admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:29.085499 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61cfc2-20dd-4d73-8f09-f1918c9c9cde admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:29.090103 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58490651-d9f8-4e76-856e-de0937a6f8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:29.090980 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58490651-d9f8-4e76-856e-de0937a6f8a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:29.091256 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58490651-d9f8-4e76-856e-de0937a6f8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:29.091550 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58490651-d9f8-4e76-856e-de0937a6f8a0 admin admin] PATH_INFO: `/v3/projects/4d5f7b9945b84a12b1013394ee5801fb/users/af90f8088bc84988aa18a9b7e6152007/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:29.106483 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58490651-d9f8-4e76-856e-de0937a6f8a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d5f7b9945b84a12b1013394ee5801fb, user_id=af90f8088bc84988aa18a9b7e6152007, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:29.109408 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58490651-d9f8-4e76-856e-de0937a6f8a0 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:29.123691 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1058/2100] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:29 2022] PUT /identity/v3/projects/4d5f7b9945b84a12b1013394ee5801fb/users/af90f8088bc84988aa18a9b7e6152007/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:29.134919 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86cef7-b73f-423c-ba58-19531e244eca None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:29.135236 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86cef7-b73f-423c-ba58-19531e244eca None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:29.135519 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86cef7-b73f-423c-ba58-19531e244eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:29.166395 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-2f86cef7-b73f-423c-ba58-19531e244eca None None] MFA Rules not processed for user `af90f8088bc84988aa18a9b7e6152007`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:29.167637 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-2f86cef7-b73f-423c-ba58-19531e244eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:29.239017 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1043/2101] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:14:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:29.250201 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58490651-d9f8-4e76-856e-de0937a6f8a0 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:29.251893 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-58490651-d9f8-4e76-856e-de0937a6f8a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:29.310064 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58490651-d9f8-4e76-856e-de0937a6f8a0 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:29.313686 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb577a6-6143-4813-a898-1e6f16002aa4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:29.314366 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb577a6-6143-4813-a898-1e6f16002aa4 service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:29.314649 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb577a6-6143-4813-a898-1e6f16002aa4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:29.314961 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb577a6-6143-4813-a898-1e6f16002aa4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:29.324105 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb577a6-6143-4813-a898-1e6f16002aa4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:29.325562 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb577a6-6143-4813-a898-1e6f16002aa4 service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:29.334345 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1059/2102] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:29.357889 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f86cef7-b73f-423c-ba58-19531e244eca None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:29.421408 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f86cef7-b73f-423c-ba58-19531e244eca None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:29.426994 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd20960-f2b3-4aaa-b308-ae0f39a46a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:29.427858 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd20960-f2b3-4aaa-b308-ae0f39a46a5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:29.428138 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd20960-f2b3-4aaa-b308-ae0f39a46a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:29.428410 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd20960-f2b3-4aaa-b308-ae0f39a46a5d admin admin] PATH_INFO: `/v3/users/af90f8088bc84988aa18a9b7e6152007` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:29.429668 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd20960-f2b3-4aaa-b308-ae0f39a46a5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=af90f8088bc84988aa18a9b7e6152007)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:29.431632 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd20960-f2b3-4aaa-b308-ae0f39a46a5d admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:29.478369 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-afd20960-f2b3-4aaa-b308-ae0f39a46a5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af90f8088bc84988aa18a9b7e6152007'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:29.486027 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-afd20960-f2b3-4aaa-b308-ae0f39a46a5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af90f8088bc84988aa18a9b7e6152007'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:29.486718 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-afd20960-f2b3-4aaa-b308-ae0f39a46a5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af90f8088bc84988aa18a9b7e6152007'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:29.488348 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-afd20960-f2b3-4aaa-b308-ae0f39a46a5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af90f8088bc84988aa18a9b7e6152007'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:29.500170 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-afd20960-f2b3-4aaa-b308-ae0f39a46a5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af90f8088bc84988aa18a9b7e6152007'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:29.513123 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1044/2103] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:14:29 2022] DELETE /identity/v3/users/af90f8088bc84988aa18a9b7e6152007 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:29.517597 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e94c40-067d-468e-a7d2-abb8067a945e None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:29.517885 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e94c40-067d-468e-a7d2-abb8067a945e None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:29.518317 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e94c40-067d-468e-a7d2-abb8067a945e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:29.536760 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-71e94c40-067d-468e-a7d2-abb8067a945e None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:29.537978 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-71e94c40-067d-468e-a7d2-abb8067a945e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:29.591061 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:29.602024 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1060/2104] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:14:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:29.612425 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd20960-f2b3-4aaa-b308-ae0f39a46a5d admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:29.614134 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-afd20960-f2b3-4aaa-b308-ae0f39a46a5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:29.624011 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:29.675763 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd20960-f2b3-4aaa-b308-ae0f39a46a5d admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:29.679783 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d1ad39-505d-4fb5-87b8-7f4413741966 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:29.680425 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1ad39-505d-4fb5-87b8-7f4413741966 service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:29.680726 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1ad39-505d-4fb5-87b8-7f4413741966 service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:29.681011 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1ad39-505d-4fb5-87b8-7f4413741966 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:29.689982 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d1ad39-505d-4fb5-87b8-7f4413741966 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:29.691860 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d1ad39-505d-4fb5-87b8-7f4413741966 service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:29.701219 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1045/2105] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:29.959853 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e94c40-067d-468e-a7d2-abb8067a945e None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:29.961285 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-71e94c40-067d-468e-a7d2-abb8067a945e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:29.976318 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e94c40-067d-468e-a7d2-abb8067a945e None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:29.981573 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019eeb7-e7ce-4463-aa10-ccfe09a68120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:29.982585 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019eeb7-e7ce-4463-aa10-ccfe09a68120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:29.985503 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019eeb7-e7ce-4463-aa10-ccfe09a68120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:29.985712 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019eeb7-e7ce-4463-aa10-ccfe09a68120 admin admin] PATH_INFO: `/v3/projects/4d5f7b9945b84a12b1013394ee5801fb` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:29.987757 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0019eeb7-e7ce-4463-aa10-ccfe09a68120 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d5f7b9945b84a12b1013394ee5801fb)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:29.990661 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0019eeb7-e7ce-4463-aa10-ccfe09a68120 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:30.032291 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb95a3-4a85-4881-b6c1-ef8688db1f58 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:30.032602 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb95a3-4a85-4881-b6c1-ef8688db1f58 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:30.033080 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb95a3-4a85-4881-b6c1-ef8688db1f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:30.043088 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-0019eeb7-e7ce-4463-aa10-ccfe09a68120 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d5f7b9945b84a12b1013394ee5801fb', 'request_id': 'req-0019eeb7-e7ce-4463-aa10-ccfe09a68120'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:30.048591 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-0019eeb7-e7ce-4463-aa10-ccfe09a68120 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d5f7b9945b84a12b1013394ee5801fb', 'request_id': 'req-0019eeb7-e7ce-4463-aa10-ccfe09a68120'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:30.050990 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-35eb95a3-4a85-4881-b6c1-ef8688db1f58 None None] MFA Rules not processed for user `308284e2c67341d181eac71cf19f92c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:30.052206 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-35eb95a3-4a85-4881-b6c1-ef8688db1f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:30.056230 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-0019eeb7-e7ce-4463-aa10-ccfe09a68120 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d5f7b9945b84a12b1013394ee5801fb', 'request_id': 'req-0019eeb7-e7ce-4463-aa10-ccfe09a68120'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:30.067384 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-0019eeb7-e7ce-4463-aa10-ccfe09a68120 admin admin] The token cache is being invalidate because project 4d5f7b9945b84a12b1013394ee5801fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:30.067676 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-0019eeb7-e7ce-4463-aa10-ccfe09a68120 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:30.068323 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-0019eeb7-e7ce-4463-aa10-ccfe09a68120 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:30.069899 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1061/2106] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:29 2022] DELETE /identity/v3/projects/4d5f7b9945b84a12b1013394ee5801fb => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:30.074770 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ce5fc-5c41-439b-bd3d-095d1e7758b5 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:30.075059 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ce5fc-5c41-439b-bd3d-095d1e7758b5 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:30.075364 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ce5fc-5c41-439b-bd3d-095d1e7758b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:30.094808 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-cb0ce5fc-5c41-439b-bd3d-095d1e7758b5 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:30.095716 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-cb0ce5fc-5c41-439b-bd3d-095d1e7758b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:30.108574 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1046/2107] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:14:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:14:30.157511 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1062/2108] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:14:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:14:30.166784 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada22890-dbe5-4948-947b-61366c9d5a6e None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:30.167237 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada22890-dbe5-4948-947b-61366c9d5a6e None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:30.167514 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada22890-dbe5-4948-947b-61366c9d5a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:30.190297 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-ada22890-dbe5-4948-947b-61366c9d5a6e None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:30.191537 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-ada22890-dbe5-4948-947b-61366c9d5a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:30.202816 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1047/2109] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:14:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:14:30.204045 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ce5fc-5c41-439b-bd3d-095d1e7758b5 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:30.215126 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ce5fc-5c41-439b-bd3d-095d1e7758b5 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:30.219634 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3998f8fa-e3fe-40da-a143-5c723b9a6a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:30.220304 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998f8fa-e3fe-40da-a143-5c723b9a6a5a admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:30.220593 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998f8fa-e3fe-40da-a143-5c723b9a6a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:30.220899 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998f8fa-e3fe-40da-a143-5c723b9a6a5a admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:30.221734 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3998f8fa-e3fe-40da-a143-5c723b9a6a5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:14:30.222048 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3998f8fa-e3fe-40da-a143-5c723b9a6a5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:30.223679 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3998f8fa-e3fe-40da-a143-5c723b9a6a5a admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:30.241826 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1063/2110] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:14:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:14:30.246046 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada22890-dbe5-4948-947b-61366c9d5a6e None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:30.258312 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada22890-dbe5-4948-947b-61366c9d5a6e None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:30.263301 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7552c426-9b98-402a-9a5b-bda2ac3427e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:30.264260 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552c426-9b98-402a-9a5b-bda2ac3427e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:30.265402 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552c426-9b98-402a-9a5b-bda2ac3427e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:30.265698 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552c426-9b98-402a-9a5b-bda2ac3427e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:30.266412 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7552c426-9b98-402a-9a5b-bda2ac3427e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:30.269047 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7552c426-9b98-402a-9a5b-bda2ac3427e1 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:30.304806 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1048/2111] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:14:30 2022] POST /identity/v3/projects => generated 381 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:30.308848 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3998f8fa-e3fe-40da-a143-5c723b9a6a5a admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:30.320039 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3998f8fa-e3fe-40da-a143-5c723b9a6a5a admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:30.422828 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e465a0f3-5145-4f30-a818-e2139b6bc59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:30.423524 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465a0f3-5145-4f30-a818-e2139b6bc59b admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:30.423807 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465a0f3-5145-4f30-a818-e2139b6bc59b admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:30.424084 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465a0f3-5145-4f30-a818-e2139b6bc59b admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:30.426079 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e465a0f3-5145-4f30-a818-e2139b6bc59b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:30.428129 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e465a0f3-5145-4f30-a818-e2139b6bc59b admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:30.450043 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:30.460981 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1064/2112] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:14:30 2022] POST /identity/v3/users => generated 291 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:14:30.462459 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7552c426-9b98-402a-9a5b-bda2ac3427e1 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:30.475259 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7552c426-9b98-402a-9a5b-bda2ac3427e1 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:30.481418 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04003ba-350d-4f69-bc34-d83f106f1f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:30.482088 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04003ba-350d-4f69-bc34-d83f106f1f51 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:30.482366 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04003ba-350d-4f69-bc34-d83f106f1f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:30.482636 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04003ba-350d-4f69-bc34-d83f106f1f51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:30.483371 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04003ba-350d-4f69-bc34-d83f106f1f51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:30.485421 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04003ba-350d-4f69-bc34-d83f106f1f51 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:30.498264 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1049/2113] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:30.502320 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e465a0f3-5145-4f30-a818-e2139b6bc59b admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:30.513026 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e465a0f3-5145-4f30-a818-e2139b6bc59b admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:30.520096 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d0d37-fd26-4c89-ae5a-ff29ebf0b767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:30.520855 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d0d37-fd26-4c89-ae5a-ff29ebf0b767 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:30.521145 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d0d37-fd26-4c89-ae5a-ff29ebf0b767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:30.521521 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d0d37-fd26-4c89-ae5a-ff29ebf0b767 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:30.522378 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2d0d37-fd26-4c89-ae5a-ff29ebf0b767 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:30.524313 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2d0d37-fd26-4c89-ae5a-ff29ebf0b767 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:30.539081 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1065/2114] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:30.540665 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04003ba-350d-4f69-bc34-d83f106f1f51 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:30.552096 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04003ba-350d-4f69-bc34-d83f106f1f51 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:30.559432 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8e978-a3b6-4921-9524-69c437f2652b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:30.560411 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8e978-a3b6-4921-9524-69c437f2652b admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:30.560732 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8e978-a3b6-4921-9524-69c437f2652b admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:30.561034 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8e978-a3b6-4921-9524-69c437f2652b admin admin] PATH_INFO: `/v3/projects/32eaa17777d1483ebf99b417ca9ad0b9/users/b6cafb20423142db91fcca21cd19ff7d/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:30.579691 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be8e978-a3b6-4921-9524-69c437f2652b admin admin] RBAC: Authorizing `identity:create_grant(project_id=32eaa17777d1483ebf99b417ca9ad0b9, user_id=b6cafb20423142db91fcca21cd19ff7d, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:30.583623 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be8e978-a3b6-4921-9524-69c437f2652b admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:30.602549 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1050/2115] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:30 2022] PUT /identity/v3/projects/32eaa17777d1483ebf99b417ca9ad0b9/users/b6cafb20423142db91fcca21cd19ff7d/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:30.607827 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a0ea7-f5b3-44c7-9647-b0619a1e9dcd None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:30.608221 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a0ea7-f5b3-44c7-9647-b0619a1e9dcd None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:30.608577 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a0ea7-f5b3-44c7-9647-b0619a1e9dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:30.632730 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-dc0a0ea7-f5b3-44c7-9647-b0619a1e9dcd None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:30.633886 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-dc0a0ea7-f5b3-44c7-9647-b0619a1e9dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:30.710051 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1066/2116] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:14:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:14:30.721061 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8e978-a3b6-4921-9524-69c437f2652b admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:30.724294 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-3be8e978-a3b6-4921-9524-69c437f2652b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:30.803154 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8e978-a3b6-4921-9524-69c437f2652b admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:30.806851 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3478a7af-2ed9-47e2-97f9-65ab92c7c23d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:30.807640 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478a7af-2ed9-47e2-97f9-65ab92c7c23d service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:30.807798 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478a7af-2ed9-47e2-97f9-65ab92c7c23d service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:30.808076 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478a7af-2ed9-47e2-97f9-65ab92c7c23d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:30.814765 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:30.824628 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3478a7af-2ed9-47e2-97f9-65ab92c7c23d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:30.827228 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3478a7af-2ed9-47e2-97f9-65ab92c7c23d service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:30.844853 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1051/2117] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:31.427766 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a0ea7-f5b3-44c7-9647-b0619a1e9dcd None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:31.429785 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-dc0a0ea7-f5b3-44c7-9647-b0619a1e9dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:31.445482 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a0ea7-f5b3-44c7-9647-b0619a1e9dcd None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:31.458378 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3947d-98fe-4f2d-9d25-dd5efdc77089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:31.459740 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3947d-98fe-4f2d-9d25-dd5efdc77089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:31.459740 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3947d-98fe-4f2d-9d25-dd5efdc77089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:31.459956 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3947d-98fe-4f2d-9d25-dd5efdc77089 admin admin] PATH_INFO: `/v3/users/646ece2e4b4d4c98bad74c0e40a219c7` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:31.461947 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a3947d-98fe-4f2d-9d25-dd5efdc77089 admin admin] RBAC: Authorizing `identity:delete_user(user_id=646ece2e4b4d4c98bad74c0e40a219c7)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:31.464775 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a3947d-98fe-4f2d-9d25-dd5efdc77089 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:31.521099 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-d8a3947d-98fe-4f2d-9d25-dd5efdc77089 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '646ece2e4b4d4c98bad74c0e40a219c7'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:31.529102 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-d8a3947d-98fe-4f2d-9d25-dd5efdc77089 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '646ece2e4b4d4c98bad74c0e40a219c7'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:31.537582 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-d8a3947d-98fe-4f2d-9d25-dd5efdc77089 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '646ece2e4b4d4c98bad74c0e40a219c7'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:31.551555 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-d8a3947d-98fe-4f2d-9d25-dd5efdc77089 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '646ece2e4b4d4c98bad74c0e40a219c7'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:31.552282 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-d8a3947d-98fe-4f2d-9d25-dd5efdc77089 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '646ece2e4b4d4c98bad74c0e40a219c7'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:31.559537 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1067/2118] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:14:31 2022] DELETE /identity/v3/users/646ece2e4b4d4c98bad74c0e40a219c7 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:31.564791 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb3c62-7017-4fee-b85d-e47c075473cc None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:31.565694 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb3c62-7017-4fee-b85d-e47c075473cc None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:31.566004 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb3c62-7017-4fee-b85d-e47c075473cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:31.584535 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-3dbb3c62-7017-4fee-b85d-e47c075473cc None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:31.585947 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-3dbb3c62-7017-4fee-b85d-e47c075473cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:31.644510 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ddecd-7c28-41d9-858c-4643dba54338 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:31.644942 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ddecd-7c28-41d9-858c-4643dba54338 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:31.645308 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ddecd-7c28-41d9-858c-4643dba54338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:31.676270 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1052/2119] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:14:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:31.681007 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-811ddecd-7c28-41d9-858c-4643dba54338 None None] MFA Rules not processed for user `b6cafb20423142db91fcca21cd19ff7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:31.682872 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb3c62-7017-4fee-b85d-e47c075473cc None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:31.683001 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-811ddecd-7c28-41d9-858c-4643dba54338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:31.686076 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-3dbb3c62-7017-4fee-b85d-e47c075473cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:31.735061 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:31.754737 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb3c62-7017-4fee-b85d-e47c075473cc None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:31.758496 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a2c129-60fd-4043-90b8-0a1a88ae2eff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:31.759148 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a2c129-60fd-4043-90b8-0a1a88ae2eff service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:31.759429 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a2c129-60fd-4043-90b8-0a1a88ae2eff service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:31.759826 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1068/2120] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:14:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:14:31.759943 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a2c129-60fd-4043-90b8-0a1a88ae2eff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:31.771215 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ddecd-7c28-41d9-858c-4643dba54338 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:31.772370 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a2c129-60fd-4043-90b8-0a1a88ae2eff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:31.772631 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-811ddecd-7c28-41d9-858c-4643dba54338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:31.773846 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a2c129-60fd-4043-90b8-0a1a88ae2eff service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:31.785470 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1053/2121] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:14:31.842781 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ddecd-7c28-41d9-858c-4643dba54338 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:31.848470 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5c0c21-df57-477b-99d9-da91a6202968 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:31.849297 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c0c21-df57-477b-99d9-da91a6202968 service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:31.849709 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c0c21-df57-477b-99d9-da91a6202968 service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:31.850224 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c0c21-df57-477b-99d9-da91a6202968 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:31.859684 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5c0c21-df57-477b-99d9-da91a6202968 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:31.861280 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5c0c21-df57-477b-99d9-da91a6202968 service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:31.871224 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1069/2122] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:14:32.185954 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a2c129-60fd-4043-90b8-0a1a88ae2eff service neutron] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:32.188037 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-21a2c129-60fd-4043-90b8-0a1a88ae2eff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:32.216809 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a2c129-60fd-4043-90b8-0a1a88ae2eff service neutron] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:32.231311 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef3442-4955-4ef3-a9c5-abb6cd537829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:32.232476 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef3442-4955-4ef3-a9c5-abb6cd537829 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:32.232801 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef3442-4955-4ef3-a9c5-abb6cd537829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:32.233125 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef3442-4955-4ef3-a9c5-abb6cd537829 admin admin] PATH_INFO: `/v3/projects/b5779059557f42f6a6cd758c4538136b` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:32.234909 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ef3442-4955-4ef3-a9c5-abb6cd537829 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5779059557f42f6a6cd758c4538136b)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:32.238637 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ef3442-4955-4ef3-a9c5-abb6cd537829 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:32.297731 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-10ef3442-4955-4ef3-a9c5-abb6cd537829 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5779059557f42f6a6cd758c4538136b', 'request_id': 'req-10ef3442-4955-4ef3-a9c5-abb6cd537829'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:32.306929 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-10ef3442-4955-4ef3-a9c5-abb6cd537829 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5779059557f42f6a6cd758c4538136b', 'request_id': 'req-10ef3442-4955-4ef3-a9c5-abb6cd537829'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:32.313234 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-10ef3442-4955-4ef3-a9c5-abb6cd537829 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5779059557f42f6a6cd758c4538136b', 'request_id': 'req-10ef3442-4955-4ef3-a9c5-abb6cd537829'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:32.326224 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-10ef3442-4955-4ef3-a9c5-abb6cd537829 admin admin] The token cache is being invalidate because project b5779059557f42f6a6cd758c4538136b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:32.326586 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-10ef3442-4955-4ef3-a9c5-abb6cd537829 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:32.327226 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-10ef3442-4955-4ef3-a9c5-abb6cd537829 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:32.328792 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1054/2123] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:32 2022] DELETE /identity/v3/projects/b5779059557f42f6a6cd758c4538136b => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:32.333896 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea43b9-7d30-4076-bdc9-84f5d4302458 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:32.334217 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea43b9-7d30-4076-bdc9-84f5d4302458 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:32.334498 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea43b9-7d30-4076-bdc9-84f5d4302458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:32.354463 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-e6ea43b9-7d30-4076-bdc9-84f5d4302458 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:32.355232 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-e6ea43b9-7d30-4076-bdc9-84f5d4302458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:32.416362 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1070/2124] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:14:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:32.424761 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2869b-1b04-44fd-a36d-b225810bde4f None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:32.425060 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2869b-1b04-44fd-a36d-b225810bde4f None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:32.425342 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2869b-1b04-44fd-a36d-b225810bde4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:32.444420 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-b7b2869b-1b04-44fd-a36d-b225810bde4f None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:32.445666 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-b7b2869b-1b04-44fd-a36d-b225810bde4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:32.453692 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1055/2125] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:14:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:32.458303 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea43b9-7d30-4076-bdc9-84f5d4302458 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:32.468770 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea43b9-7d30-4076-bdc9-84f5d4302458 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:32.473518 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1e33e-5a3b-4250-8f56-f4d0e7ee2b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:32.474199 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1e33e-5a3b-4250-8f56-f4d0e7ee2b48 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:32.474618 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1e33e-5a3b-4250-8f56-f4d0e7ee2b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:32.474904 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1e33e-5a3b-4250-8f56-f4d0e7ee2b48 admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:32.475674 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc1e33e-5a3b-4250-8f56-f4d0e7ee2b48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:14:32.475988 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc1e33e-5a3b-4250-8f56-f4d0e7ee2b48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:32.477631 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc1e33e-5a3b-4250-8f56-f4d0e7ee2b48 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:32.493736 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1071/2126] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:14:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:14:32.495987 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b2869b-1b04-44fd-a36d-b225810bde4f None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:32.509831 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b2869b-1b04-44fd-a36d-b225810bde4f None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:32.514627 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e91b25-452b-4949-b31a-37dccb84d3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:32.515291 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e91b25-452b-4949-b31a-37dccb84d3ef admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:32.515816 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e91b25-452b-4949-b31a-37dccb84d3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:32.516048 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e91b25-452b-4949-b31a-37dccb84d3ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:32.516789 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e91b25-452b-4949-b31a-37dccb84d3ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:32.519712 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e91b25-452b-4949-b31a-37dccb84d3ef admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:32.531747 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:32.556917 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1056/2127] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:14:32 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:32.558013 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1e33e-5a3b-4250-8f56-f4d0e7ee2b48 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:32.568820 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1e33e-5a3b-4250-8f56-f4d0e7ee2b48 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:32.643933 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e8ef5-f625-4a0f-8348-84d5ed7ce522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:32.645128 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e8ef5-f625-4a0f-8348-84d5ed7ce522 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:32.645607 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e8ef5-f625-4a0f-8348-84d5ed7ce522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:32.645950 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e8ef5-f625-4a0f-8348-84d5ed7ce522 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:32.646662 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498e8ef5-f625-4a0f-8348-84d5ed7ce522 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:32.648592 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498e8ef5-f625-4a0f-8348-84d5ed7ce522 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:32.680961 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1072/2128] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:14:32 2022] POST /identity/v3/users => generated 289 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:32.685771 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e91b25-452b-4949-b31a-37dccb84d3ef admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:32.705911 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e91b25-452b-4949-b31a-37dccb84d3ef admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:32.715241 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6bf231-b808-4368-b13f-fae806331fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:32.715924 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6bf231-b808-4368-b13f-fae806331fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:32.716204 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6bf231-b808-4368-b13f-fae806331fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:32.716479 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6bf231-b808-4368-b13f-fae806331fc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:32.717247 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6bf231-b808-4368-b13f-fae806331fc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:32.722276 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6bf231-b808-4368-b13f-fae806331fc1 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:32.749376 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1057/2129] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:32.753484 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e8ef5-f625-4a0f-8348-84d5ed7ce522 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:32.763846 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e8ef5-f625-4a0f-8348-84d5ed7ce522 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:32.769647 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5049ef5-87bd-451f-8592-bd6d9c8a99c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:32.770652 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5049ef5-87bd-451f-8592-bd6d9c8a99c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:32.771192 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5049ef5-87bd-451f-8592-bd6d9c8a99c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:32.771476 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5049ef5-87bd-451f-8592-bd6d9c8a99c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:32.772223 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5049ef5-87bd-451f-8592-bd6d9c8a99c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:32.773961 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5049ef5-87bd-451f-8592-bd6d9c8a99c8 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:32.776410 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:32.792226 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1073/2130] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:14:32.793459 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6bf231-b808-4368-b13f-fae806331fc1 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:32.805132 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6bf231-b808-4368-b13f-fae806331fc1 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:32.810951 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627d792-a915-453d-8556-18620cc88634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:32.812282 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627d792-a915-453d-8556-18620cc88634 admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:32.812574 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627d792-a915-453d-8556-18620cc88634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:32.812894 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627d792-a915-453d-8556-18620cc88634 admin admin] PATH_INFO: `/v3/projects/7bcde2f2809247979837902b91d6a6cb/users/b19967e2b09342e9ac006151002bf71a/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:32.834564 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4627d792-a915-453d-8556-18620cc88634 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bcde2f2809247979837902b91d6a6cb, user_id=b19967e2b09342e9ac006151002bf71a, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:32.838098 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4627d792-a915-453d-8556-18620cc88634 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:32.856130 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1058/2131] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:32 2022] PUT /identity/v3/projects/7bcde2f2809247979837902b91d6a6cb/users/b19967e2b09342e9ac006151002bf71a/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:32.862295 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e74ccd-be4f-4b36-a645-fd5dae07248e None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:32.862789 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e74ccd-be4f-4b36-a645-fd5dae07248e None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:32.862789 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e74ccd-be4f-4b36-a645-fd5dae07248e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:32.882236 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-45e74ccd-be4f-4b36-a645-fd5dae07248e None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:32.882657 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-45e74ccd-be4f-4b36-a645-fd5dae07248e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:32.948367 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1074/2132] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:14:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:32.983188 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627d792-a915-453d-8556-18620cc88634 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:32.985699 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-4627d792-a915-453d-8556-18620cc88634 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:33.053450 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627d792-a915-453d-8556-18620cc88634 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:33.058472 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a0b01-06dc-446d-8694-01b8e9fddc89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:33.059148 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a0b01-06dc-446d-8694-01b8e9fddc89 service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:33.059433 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a0b01-06dc-446d-8694-01b8e9fddc89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:33.059711 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a0b01-06dc-446d-8694-01b8e9fddc89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:33.075243 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a0b01-06dc-446d-8694-01b8e9fddc89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:33.076867 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a0b01-06dc-446d-8694-01b8e9fddc89 service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:33.093413 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1059/2133] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:33.342629 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf97a2-5514-402d-a98a-7ece30ccba48 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:33.343005 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf97a2-5514-402d-a98a-7ece30ccba48 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:33.343288 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf97a2-5514-402d-a98a-7ece30ccba48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:33.363348 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-a9cf97a2-5514-402d-a98a-7ece30ccba48 None None] MFA Rules not processed for user `b6cafb20423142db91fcca21cd19ff7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:33.364681 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-a9cf97a2-5514-402d-a98a-7ece30ccba48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:33.428244 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1075/2134] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:14:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:38.556993 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de030184-a1ea-4f36-8ad5-4105b51d2bee None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:38.557467 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de030184-a1ea-4f36-8ad5-4105b51d2bee None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:38.557588 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de030184-a1ea-4f36-8ad5-4105b51d2bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:38.593389 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-de030184-a1ea-4f36-8ad5-4105b51d2bee None None] MFA Rules not processed for user `b19967e2b09342e9ac006151002bf71a`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:38.594633 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-de030184-a1ea-4f36-8ad5-4105b51d2bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:38.728833 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1060/2135] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:14:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:38.729999 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf97a2-5514-402d-a98a-7ece30ccba48 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:38.748174 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf97a2-5514-402d-a98a-7ece30ccba48 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:38.759509 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892ea8b-d5c6-4650-8026-a1ce26ea9b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:38.760225 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892ea8b-d5c6-4650-8026-a1ce26ea9b84 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:38.760510 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892ea8b-d5c6-4650-8026-a1ce26ea9b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:38.760815 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892ea8b-d5c6-4650-8026-a1ce26ea9b84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:38.762076 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b892ea8b-d5c6-4650-8026-a1ce26ea9b84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:38.764174 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b892ea8b-d5c6-4650-8026-a1ce26ea9b84 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:38.801894 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1076/2136] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:14:38 2022] POST /identity/v3/projects => generated 377 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:14:38.805672 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de030184-a1ea-4f36-8ad5-4105b51d2bee None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:38.821423 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de030184-a1ea-4f36-8ad5-4105b51d2bee None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:38.896054 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:38.921780 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8869013-cf77-4b1c-9185-473b35489154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:38.922931 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8869013-cf77-4b1c-9185-473b35489154 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:38.923258 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8869013-cf77-4b1c-9185-473b35489154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:38.924736 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8869013-cf77-4b1c-9185-473b35489154 admin admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:38.925122 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8869013-cf77-4b1c-9185-473b35489154 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:38.927444 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8869013-cf77-4b1c-9185-473b35489154 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:38.973826 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1061/2137] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:14:38 2022] POST /identity/v3/users => generated 295 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:38.978074 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892ea8b-d5c6-4650-8026-a1ce26ea9b84 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:38.993732 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892ea8b-d5c6-4650-8026-a1ce26ea9b84 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:39.000260 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a63a9a-cf47-4401-b4b5-c7a3c8801398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:39.001198 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a63a9a-cf47-4401-b4b5-c7a3c8801398 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:39.001555 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a63a9a-cf47-4401-b4b5-c7a3c8801398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:39.002467 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a63a9a-cf47-4401-b4b5-c7a3c8801398 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:39.003612 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a63a9a-cf47-4401-b4b5-c7a3c8801398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:39.005358 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a63a9a-cf47-4401-b4b5-c7a3c8801398 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:39.023012 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1077/2138] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:38 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:39.027208 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8869013-cf77-4b1c-9185-473b35489154 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:39.038501 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8869013-cf77-4b1c-9185-473b35489154 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:39.043965 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ab1b1-bb06-4aad-80b1-6f80e6a65de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:39.045021 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ab1b1-bb06-4aad-80b1-6f80e6a65de6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:39.045310 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ab1b1-bb06-4aad-80b1-6f80e6a65de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:39.045578 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ab1b1-bb06-4aad-80b1-6f80e6a65de6 admin admin] PATH_INFO: `/v3/projects/92ced46eec104b358b23bfdec193c211/users/d741439ce8c343fc9f2dbbb1ec28066c/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:39.068043 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380ab1b1-bb06-4aad-80b1-6f80e6a65de6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92ced46eec104b358b23bfdec193c211, user_id=d741439ce8c343fc9f2dbbb1ec28066c, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:39.071338 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380ab1b1-bb06-4aad-80b1-6f80e6a65de6 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:39.090757 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1062/2139] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:39 2022] PUT /identity/v3/projects/92ced46eec104b358b23bfdec193c211/users/d741439ce8c343fc9f2dbbb1ec28066c/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:39.094701 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a63a9a-cf47-4401-b4b5-c7a3c8801398 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:39.109834 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a63a9a-cf47-4401-b4b5-c7a3c8801398 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:39.208318 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b6638-de03-415d-aa45-e45621a00ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:39.209755 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b6638-de03-415d-aa45-e45621a00ada admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:39.210230 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b6638-de03-415d-aa45-e45621a00ada admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:39.211072 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b6638-de03-415d-aa45-e45621a00ada admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:39.211814 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103b6638-de03-415d-aa45-e45621a00ada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:39.214455 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103b6638-de03-415d-aa45-e45621a00ada admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:39.233574 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1078/2140] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:39 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:14:39.237590 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ab1b1-bb06-4aad-80b1-6f80e6a65de6 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:39.267458 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ab1b1-bb06-4aad-80b1-6f80e6a65de6 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:39.274353 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2774e-cc92-4d7e-9e42-db46dc45cbcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:39.275492 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2774e-cc92-4d7e-9e42-db46dc45cbcc admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:39.275873 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2774e-cc92-4d7e-9e42-db46dc45cbcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:39.276242 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2774e-cc92-4d7e-9e42-db46dc45cbcc admin admin] PATH_INFO: `/v3/projects/92ced46eec104b358b23bfdec193c211/users/d741439ce8c343fc9f2dbbb1ec28066c/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:39.279854 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba2774e-cc92-4d7e-9e42-db46dc45cbcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=92ced46eec104b358b23bfdec193c211, user_id=d741439ce8c343fc9f2dbbb1ec28066c, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:39.285890 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba2774e-cc92-4d7e-9e42-db46dc45cbcc admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:39.331412 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1063/2141] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:39 2022] PUT /identity/v3/projects/92ced46eec104b358b23bfdec193c211/users/d741439ce8c343fc9f2dbbb1ec28066c/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:45.161565 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0d7b1-35fc-40f9-aa60-7b4a5674e98a None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:45.162091 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0d7b1-35fc-40f9-aa60-7b4a5674e98a None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:45.162200 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0d7b1-35fc-40f9-aa60-7b4a5674e98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:45.178053 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:45.196685 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-21d0d7b1-35fc-40f9-aa60-7b4a5674e98a None None] MFA Rules not processed for user `d741439ce8c343fc9f2dbbb1ec28066c`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:45.199301 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-21d0d7b1-35fc-40f9-aa60-7b4a5674e98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:45.285089 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1079/2142] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:14:45 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:45.302638 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2774e-cc92-4d7e-9e42-db46dc45cbcc admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:45.304506 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-2ba2774e-cc92-4d7e-9e42-db46dc45cbcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:45.486800 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2774e-cc92-4d7e-9e42-db46dc45cbcc admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:45.499845 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ce262-5c05-4139-824e-e47d2c587eba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cee106502e54829ad802ee41c9165fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:45.500684 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ce262-5c05-4139-824e-e47d2c587eba service nova] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:45.501112 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ce262-5c05-4139-824e-e47d2c587eba service nova] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:45.501492 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ce262-5c05-4139-824e-e47d2c587eba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:45.624887 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ce262-5c05-4139-824e-e47d2c587eba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:45.627983 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ce262-5c05-4139-824e-e47d2c587eba service nova] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:45.661482 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1064/2143] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:55.281500 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=31 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:55.644583 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=90,keystone:INSERT=5 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:11.917295 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6a0b3-b8c0-4df9-8357-a677740ad08b None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:11.917819 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6a0b3-b8c0-4df9-8357-a677740ad08b None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:11.917918 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6a0b3-b8c0-4df9-8357-a677740ad08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:11.980431 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-9ea6a0b3-b8c0-4df9-8357-a677740ad08b None None] MFA Rules not processed for user `8c0f131484cb48d289cae1f473ec2fbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:11.981746 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-9ea6a0b3-b8c0-4df9-8357-a677740ad08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:12.049241 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1080/2144] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Jun 20 06:15:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:15:12.090557 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ce262-5c05-4139-824e-e47d2c587eba service nova] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:12.092065 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-e96ce262-5c05-4139-824e-e47d2c587eba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:12.188111 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ce262-5c05-4139-824e-e47d2c587eba service nova] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:12.193864 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd5a01-22de-4e6a-931e-5371e2408786 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b490cf71bc468da5ea2be04239e33f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:12.194503 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd5a01-22de-4e6a-931e-5371e2408786 service swift] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:12.194784 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd5a01-22de-4e6a-931e-5371e2408786 service swift] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:12.195056 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd5a01-22de-4e6a-931e-5371e2408786 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:12.203030 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd5a01-22de-4e6a-931e-5371e2408786 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:12.204588 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd5a01-22de-4e6a-931e-5371e2408786 service swift] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:12.213114 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1065/2145] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Jun 20 06:15:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 06:15:22.045991 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=44 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:22.209842 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=41 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:33.834346 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6183dafa-d329-477f-a5ed-fcab9cca3771 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:33.834875 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6183dafa-d329-477f-a5ed-fcab9cca3771 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:33.834875 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6183dafa-d329-477f-a5ed-fcab9cca3771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:33.852565 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-6183dafa-d329-477f-a5ed-fcab9cca3771 None None] MFA Rules not processed for user `8c0f131484cb48d289cae1f473ec2fbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:33.853811 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-6183dafa-d329-477f-a5ed-fcab9cca3771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:33.861105 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1081/2146] 10.222.0.39 () {58 vars in 967 bytes} [Mon Jun 20 06:15:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:15:33.873955 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd5a01-22de-4e6a-931e-5371e2408786 service swift] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:33.885036 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd5a01-22de-4e6a-931e-5371e2408786 service swift] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:33.890186 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a373e0-b4c2-4cdb-8fa9-573aca5feaaf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b490cf71bc468da5ea2be04239e33f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:33.890876 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a373e0-b4c2-4cdb-8fa9-573aca5feaaf service swift] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:33.891161 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a373e0-b4c2-4cdb-8fa9-573aca5feaaf service swift] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:33.891438 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a373e0-b4c2-4cdb-8fa9-573aca5feaaf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:33.899985 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a373e0-b4c2-4cdb-8fa9-573aca5feaaf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:33.901671 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a373e0-b4c2-4cdb-8fa9-573aca5feaaf service swift] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:33.909881 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1066/2147] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Jun 20 06:15:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 20 06:15:36.303168 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ea386-6773-405b-8e1c-e36e51108452 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:36.304135 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ea386-6773-405b-8e1c-e36e51108452 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:36.304417 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ea386-6773-405b-8e1c-e36e51108452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:36.322998 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-cd6ea386-6773-405b-8e1c-e36e51108452 None None] MFA Rules not processed for user `b19967e2b09342e9ac006151002bf71a`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:36.324457 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-cd6ea386-6773-405b-8e1c-e36e51108452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:36.331961 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1082/2148] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:15:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:15:37.208665 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a373e0-b4c2-4cdb-8fa9-573aca5feaaf service swift] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:37.210783 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-f9a373e0-b4c2-4cdb-8fa9-573aca5feaaf service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:37.291377 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a373e0-b4c2-4cdb-8fa9-573aca5feaaf service swift] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:37.295898 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b8d74c-ef48-4375-9c4f-f11f0f13b845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:37.296790 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8d74c-ef48-4375-9c4f-f11f0f13b845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:37.297075 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8d74c-ef48-4375-9c4f-f11f0f13b845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:37.297350 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8d74c-ef48-4375-9c4f-f11f0f13b845 admin admin] PATH_INFO: `/v3/users/308284e2c67341d181eac71cf19f92c6` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:37.298589 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b8d74c-ef48-4375-9c4f-f11f0f13b845 admin admin] RBAC: Authorizing `identity:delete_user(user_id=308284e2c67341d181eac71cf19f92c6)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:37.301648 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b8d74c-ef48-4375-9c4f-f11f0f13b845 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:37.352400 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-f3b8d74c-ef48-4375-9c4f-f11f0f13b845 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '308284e2c67341d181eac71cf19f92c6'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:37.360728 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-f3b8d74c-ef48-4375-9c4f-f11f0f13b845 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '308284e2c67341d181eac71cf19f92c6'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:37.361356 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-f3b8d74c-ef48-4375-9c4f-f11f0f13b845 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '308284e2c67341d181eac71cf19f92c6'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:37.361957 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-f3b8d74c-ef48-4375-9c4f-f11f0f13b845 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '308284e2c67341d181eac71cf19f92c6'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:37.377085 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-f3b8d74c-ef48-4375-9c4f-f11f0f13b845 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '308284e2c67341d181eac71cf19f92c6'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:37.391197 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1067/2149] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:15:37 2022] DELETE /identity/v3/users/308284e2c67341d181eac71cf19f92c6 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:15:37.589540 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ea386-6773-405b-8e1c-e36e51108452 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:37.601648 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ea386-6773-405b-8e1c-e36e51108452 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:37.688930 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6713ad4-b596-477e-80b0-8d1eebcba642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:37.690642 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6713ad4-b596-477e-80b0-8d1eebcba642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:37.691162 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6713ad4-b596-477e-80b0-8d1eebcba642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:37.692930 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6713ad4-b596-477e-80b0-8d1eebcba642 admin admin] PATH_INFO: `/v3/projects/b38a00f3ffb54dafae0998b26c2478a1` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:37.694806 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6713ad4-b596-477e-80b0-8d1eebcba642 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b38a00f3ffb54dafae0998b26c2478a1)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:37.696964 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6713ad4-b596-477e-80b0-8d1eebcba642 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:37.755149 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-a6713ad4-b596-477e-80b0-8d1eebcba642 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b38a00f3ffb54dafae0998b26c2478a1', 'request_id': 'req-a6713ad4-b596-477e-80b0-8d1eebcba642'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:37.761269 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-a6713ad4-b596-477e-80b0-8d1eebcba642 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b38a00f3ffb54dafae0998b26c2478a1', 'request_id': 'req-a6713ad4-b596-477e-80b0-8d1eebcba642'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:37.769612 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-a6713ad4-b596-477e-80b0-8d1eebcba642 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b38a00f3ffb54dafae0998b26c2478a1', 'request_id': 'req-a6713ad4-b596-477e-80b0-8d1eebcba642'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:37.787533 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-a6713ad4-b596-477e-80b0-8d1eebcba642 admin admin] The token cache is being invalidate because project b38a00f3ffb54dafae0998b26c2478a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:15:37.788265 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-a6713ad4-b596-477e-80b0-8d1eebcba642 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:37.789241 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-a6713ad4-b596-477e-80b0-8d1eebcba642 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:37.791294 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1083/2150] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:15:37 2022] DELETE /identity/v3/projects/b38a00f3ffb54dafae0998b26c2478a1 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:15:37.796523 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f662696-48bc-4a96-8a10-ee091373c84b None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:37.797051 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f662696-48bc-4a96-8a10-ee091373c84b None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:37.797328 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f662696-48bc-4a96-8a10-ee091373c84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:37.823976 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-6f662696-48bc-4a96-8a10-ee091373c84b None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:37.825226 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-6f662696-48bc-4a96-8a10-ee091373c84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:37.899729 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1068/2151] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:15:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:15:37.908038 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15676e-427c-4cfc-97c3-510980fcaa01 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:37.908382 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15676e-427c-4cfc-97c3-510980fcaa01 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:37.908669 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15676e-427c-4cfc-97c3-510980fcaa01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:37.932030 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-3b15676e-427c-4cfc-97c3-510980fcaa01 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:37.933838 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-3b15676e-427c-4cfc-97c3-510980fcaa01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:37.942126 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1084/2152] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:15:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:15:37.946673 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f662696-48bc-4a96-8a10-ee091373c84b None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:37.958820 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f662696-48bc-4a96-8a10-ee091373c84b None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:37.967136 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a0cec7-01e5-4e5c-a331-6a6331fc31f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:37.967651 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a0cec7-01e5-4e5c-a331-6a6331fc31f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:37.967943 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a0cec7-01e5-4e5c-a331-6a6331fc31f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:37.968213 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a0cec7-01e5-4e5c-a331-6a6331fc31f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:37.969054 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a0cec7-01e5-4e5c-a331-6a6331fc31f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:15:37.969337 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a0cec7-01e5-4e5c-a331-6a6331fc31f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:37.970994 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a0cec7-01e5-4e5c-a331-6a6331fc31f6 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:37.973868 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:37.991191 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1069/2153] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:15:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:15:37.993140 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b15676e-427c-4cfc-97c3-510980fcaa01 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:38.002738 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b15676e-427c-4cfc-97c3-510980fcaa01 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:38.008091 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff64212b-866c-483c-a830-37e681e7203e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:38.008877 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64212b-866c-483c-a830-37e681e7203e admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:38.009228 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64212b-866c-483c-a830-37e681e7203e admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:38.009571 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64212b-866c-483c-a830-37e681e7203e admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:38.010347 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff64212b-866c-483c-a830-37e681e7203e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:38.012314 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff64212b-866c-483c-a830-37e681e7203e admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:38.044366 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1085/2154] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:15:37 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:15:38.048405 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a0cec7-01e5-4e5c-a331-6a6331fc31f6 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:38.060381 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a0cec7-01e5-4e5c-a331-6a6331fc31f6 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:38.153420 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4eb57c-74ac-4a69-aebe-d62dc879317a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:38.154112 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4eb57c-74ac-4a69-aebe-d62dc879317a admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:38.154449 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4eb57c-74ac-4a69-aebe-d62dc879317a admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:38.154783 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4eb57c-74ac-4a69-aebe-d62dc879317a admin admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:38.155639 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4eb57c-74ac-4a69-aebe-d62dc879317a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:38.157772 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4eb57c-74ac-4a69-aebe-d62dc879317a admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:38.202147 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1070/2155] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:15:38 2022] POST /identity/v3/users => generated 292 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:15:38.206283 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff64212b-866c-483c-a830-37e681e7203e admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:38.216776 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff64212b-866c-483c-a830-37e681e7203e admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:38.221775 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7bbec4-1777-4708-a8b8-867c9b821df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:38.222473 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7bbec4-1777-4708-a8b8-867c9b821df7 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:38.222821 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7bbec4-1777-4708-a8b8-867c9b821df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:38.223405 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7bbec4-1777-4708-a8b8-867c9b821df7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:38.224174 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7bbec4-1777-4708-a8b8-867c9b821df7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:38.225829 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7bbec4-1777-4708-a8b8-867c9b821df7 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:38.242284 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1086/2156] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:15:38.243901 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4eb57c-74ac-4a69-aebe-d62dc879317a admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:38.258927 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4eb57c-74ac-4a69-aebe-d62dc879317a admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:38.265418 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381b178-bf7e-448e-bcd6-17c15abb2054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:38.266224 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381b178-bf7e-448e-bcd6-17c15abb2054 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:38.266634 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381b178-bf7e-448e-bcd6-17c15abb2054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:38.267005 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381b178-bf7e-448e-bcd6-17c15abb2054 admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:38.267847 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3381b178-bf7e-448e-bcd6-17c15abb2054 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:38.271309 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3381b178-bf7e-448e-bcd6-17c15abb2054 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:38.287335 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7bbec4-1777-4708-a8b8-867c9b821df7 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:38.295511 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1071/2157] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:15:38.300493 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7bbec4-1777-4708-a8b8-867c9b821df7 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:38.313989 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6c079-7069-46a9-8d1e-d56b4e52df8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:38.315176 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6c079-7069-46a9-8d1e-d56b4e52df8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:38.315640 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6c079-7069-46a9-8d1e-d56b4e52df8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:38.318085 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6c079-7069-46a9-8d1e-d56b4e52df8b admin admin] PATH_INFO: `/v3/projects/17f4518dc67e44c7b8d8a782aed49951/users/be67a10ae0a2495ca194cb7683627275/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:38.333070 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c6c079-7069-46a9-8d1e-d56b4e52df8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=17f4518dc67e44c7b8d8a782aed49951, user_id=be67a10ae0a2495ca194cb7683627275, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:38.335869 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c6c079-7069-46a9-8d1e-d56b4e52df8b admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:38.352716 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1087/2158] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:15:38 2022] PUT /identity/v3/projects/17f4518dc67e44c7b8d8a782aed49951/users/be67a10ae0a2495ca194cb7683627275/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:15:38.362577 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ab58e-abd6-4695-a865-5fca8578fd5d None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:38.362866 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ab58e-abd6-4695-a865-5fca8578fd5d None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:38.363140 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ab58e-abd6-4695-a865-5fca8578fd5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:38.392881 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-434ab58e-abd6-4695-a865-5fca8578fd5d None None] MFA Rules not processed for user `be67a10ae0a2495ca194cb7683627275`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:38.394193 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-434ab58e-abd6-4695-a865-5fca8578fd5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:38.464850 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1072/2159] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:15:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:15:38.476342 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6c079-7069-46a9-8d1e-d56b4e52df8b admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:38.478038 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-68c6c079-7069-46a9-8d1e-d56b4e52df8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:38.493457 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:38.540728 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6c079-7069-46a9-8d1e-d56b4e52df8b admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:38.544459 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a54473-ab0b-4de8-b453-af0b662e01cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:38.545144 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a54473-ab0b-4de8-b453-af0b662e01cb service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:38.545430 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a54473-ab0b-4de8-b453-af0b662e01cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:38.545710 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a54473-ab0b-4de8-b453-af0b662e01cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:38.555238 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a54473-ab0b-4de8-b453-af0b662e01cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:38.556677 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a54473-ab0b-4de8-b453-af0b662e01cb service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:38.565603 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1088/2160] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:15:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:15:41.229901 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a0fb7-a0b7-42e8-866b-2f84b1386839 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:41.230422 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a0fb7-a0b7-42e8-866b-2f84b1386839 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:41.230515 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a0fb7-a0b7-42e8-866b-2f84b1386839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:41.248686 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-7c7a0fb7-a0b7-42e8-866b-2f84b1386839 None None] MFA Rules not processed for user `68c4b81f2f704a9bbe15fd0f3326bb3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:41.249934 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-7c7a0fb7-a0b7-42e8-866b-2f84b1386839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:41.314346 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a54473-ab0b-4de8-b453-af0b662e01cb service cinder] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:41.326344 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1073/2161] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:15:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:15:41.401474 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a54473-ab0b-4de8-b453-af0b662e01cb service cinder] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:41.406135 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5056845-c7ca-42c5-9cd2-1242bc684e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:41.407002 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5056845-c7ca-42c5-9cd2-1242bc684e24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:41.407289 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5056845-c7ca-42c5-9cd2-1242bc684e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:41.407682 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5056845-c7ca-42c5-9cd2-1242bc684e24 admin admin] PATH_INFO: `/v3/users/be67a10ae0a2495ca194cb7683627275` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:41.408946 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5056845-c7ca-42c5-9cd2-1242bc684e24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be67a10ae0a2495ca194cb7683627275)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:41.411592 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5056845-c7ca-42c5-9cd2-1242bc684e24 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:41.469257 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-b5056845-c7ca-42c5-9cd2-1242bc684e24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be67a10ae0a2495ca194cb7683627275'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:41.477551 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-b5056845-c7ca-42c5-9cd2-1242bc684e24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be67a10ae0a2495ca194cb7683627275'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:41.489921 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-b5056845-c7ca-42c5-9cd2-1242bc684e24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be67a10ae0a2495ca194cb7683627275'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:41.502870 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-b5056845-c7ca-42c5-9cd2-1242bc684e24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be67a10ae0a2495ca194cb7683627275'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:41.503573 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-b5056845-c7ca-42c5-9cd2-1242bc684e24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be67a10ae0a2495ca194cb7683627275'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:41.510041 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1089/2162] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:15:41 2022] DELETE /identity/v3/users/be67a10ae0a2495ca194cb7683627275 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:15:41.514506 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83302abf-ceeb-4f23-a819-0f5ce4076ef5 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:41.515036 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83302abf-ceeb-4f23-a819-0f5ce4076ef5 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:41.515376 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83302abf-ceeb-4f23-a819-0f5ce4076ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:41.528215 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:41.534533 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-83302abf-ceeb-4f23-a819-0f5ce4076ef5 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:41.536042 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-83302abf-ceeb-4f23-a819-0f5ce4076ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:41.598327 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1074/2163] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:15:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:15:41.607910 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5056845-c7ca-42c5-9cd2-1242bc684e24 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:41.609592 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-b5056845-c7ca-42c5-9cd2-1242bc684e24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:41.652991 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:41.671479 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5056845-c7ca-42c5-9cd2-1242bc684e24 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:41.675225 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e24186-5283-4c66-a14b-d5dc48a65d15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:41.675900 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e24186-5283-4c66-a14b-d5dc48a65d15 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:41.676221 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e24186-5283-4c66-a14b-d5dc48a65d15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:41.676469 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e24186-5283-4c66-a14b-d5dc48a65d15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:41.686025 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e24186-5283-4c66-a14b-d5dc48a65d15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:41.687527 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e24186-5283-4c66-a14b-d5dc48a65d15 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:41.703520 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1090/2164] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:15:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:15:41.975923 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83302abf-ceeb-4f23-a819-0f5ce4076ef5 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:41.977549 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-83302abf-ceeb-4f23-a819-0f5ce4076ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:42.004629 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83302abf-ceeb-4f23-a819-0f5ce4076ef5 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:42.012020 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d553b-03d0-4f76-bb1c-9132aa94fa7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:42.013006 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d553b-03d0-4f76-bb1c-9132aa94fa7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:42.013355 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d553b-03d0-4f76-bb1c-9132aa94fa7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:42.013711 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d553b-03d0-4f76-bb1c-9132aa94fa7d admin admin] PATH_INFO: `/v3/projects/17f4518dc67e44c7b8d8a782aed49951` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:42.014970 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d553b-03d0-4f76-bb1c-9132aa94fa7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=17f4518dc67e44c7b8d8a782aed49951)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:42.016987 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d553b-03d0-4f76-bb1c-9132aa94fa7d admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:42.080593 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-a58d553b-03d0-4f76-bb1c-9132aa94fa7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17f4518dc67e44c7b8d8a782aed49951', 'request_id': 'req-a58d553b-03d0-4f76-bb1c-9132aa94fa7d'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:42.090517 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-a58d553b-03d0-4f76-bb1c-9132aa94fa7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17f4518dc67e44c7b8d8a782aed49951', 'request_id': 'req-a58d553b-03d0-4f76-bb1c-9132aa94fa7d'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:42.100572 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-a58d553b-03d0-4f76-bb1c-9132aa94fa7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17f4518dc67e44c7b8d8a782aed49951', 'request_id': 'req-a58d553b-03d0-4f76-bb1c-9132aa94fa7d'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:42.112521 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-a58d553b-03d0-4f76-bb1c-9132aa94fa7d admin admin] The token cache is being invalidate because project 17f4518dc67e44c7b8d8a782aed49951 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:15:42.112912 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-a58d553b-03d0-4f76-bb1c-9132aa94fa7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:42.114159 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-a58d553b-03d0-4f76-bb1c-9132aa94fa7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:42.119169 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1075/2165] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:15:41 2022] DELETE /identity/v3/projects/17f4518dc67e44c7b8d8a782aed49951 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:15:42.121125 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9e3b4-af4c-4b00-be0b-493ce3e0cf55 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:42.121414 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9e3b4-af4c-4b00-be0b-493ce3e0cf55 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:42.121691 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9e3b4-af4c-4b00-be0b-493ce3e0cf55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:42.139631 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-13d9e3b4-af4c-4b00-be0b-493ce3e0cf55 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:42.140861 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-13d9e3b4-af4c-4b00-be0b-493ce3e0cf55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:42.203862 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1091/2166] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:15:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:15:42.212158 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8434544-9e65-41ee-8c1c-a071dbe70a1b None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:42.212602 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8434544-9e65-41ee-8c1c-a071dbe70a1b None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:42.213394 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8434544-9e65-41ee-8c1c-a071dbe70a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:42.233383 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-b8434544-9e65-41ee-8c1c-a071dbe70a1b None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:42.234727 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-b8434544-9e65-41ee-8c1c-a071dbe70a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:42.245175 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1076/2167] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:15:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:15:42.249943 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d9e3b4-af4c-4b00-be0b-493ce3e0cf55 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:42.262069 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d9e3b4-af4c-4b00-be0b-493ce3e0cf55 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:42.267662 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e8138a-d1fc-473b-b982-5f2c67708b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:42.268394 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8138a-d1fc-473b-b982-5f2c67708b8a admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:42.269435 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8138a-d1fc-473b-b982-5f2c67708b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:42.269830 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8138a-d1fc-473b-b982-5f2c67708b8a admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:42.270668 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e8138a-d1fc-473b-b982-5f2c67708b8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:15:42.271039 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e8138a-d1fc-473b-b982-5f2c67708b8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:42.272725 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e8138a-d1fc-473b-b982-5f2c67708b8a admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:42.285876 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1092/2168] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:15:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:15:42.290535 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8434544-9e65-41ee-8c1c-a071dbe70a1b None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:42.302965 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8434544-9e65-41ee-8c1c-a071dbe70a1b None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:42.307494 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4afe18-0a41-47ee-8d94-37fef9c16e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:42.308429 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4afe18-0a41-47ee-8d94-37fef9c16e98 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:42.308578 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4afe18-0a41-47ee-8d94-37fef9c16e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:42.310421 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4afe18-0a41-47ee-8d94-37fef9c16e98 admin admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:42.310421 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4afe18-0a41-47ee-8d94-37fef9c16e98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:42.311813 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4afe18-0a41-47ee-8d94-37fef9c16e98 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:42.371056 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1077/2169] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:15:42 2022] POST /identity/v3/projects => generated 375 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:15:42.375554 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e8138a-d1fc-473b-b982-5f2c67708b8a admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:42.387678 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e8138a-d1fc-473b-b982-5f2c67708b8a admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:42.480282 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa2cd8-f98b-4224-bfbd-74e372f03a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:42.480840 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa2cd8-f98b-4224-bfbd-74e372f03a6b admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:42.481072 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa2cd8-f98b-4224-bfbd-74e372f03a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:42.481348 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa2cd8-f98b-4224-bfbd-74e372f03a6b admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:42.482052 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fa2cd8-f98b-4224-bfbd-74e372f03a6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:42.484284 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fa2cd8-f98b-4224-bfbd-74e372f03a6b admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:42.509028 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1093/2170] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:15:42 2022] POST /identity/v3/users => generated 288 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:15:42.512870 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4afe18-0a41-47ee-8d94-37fef9c16e98 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:42.524139 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4afe18-0a41-47ee-8d94-37fef9c16e98 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:42.530468 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193cf8b8-c555-4f94-9b6b-f54b8ae9f7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:42.536818 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193cf8b8-c555-4f94-9b6b-f54b8ae9f7fc admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:42.537186 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193cf8b8-c555-4f94-9b6b-f54b8ae9f7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:42.537532 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193cf8b8-c555-4f94-9b6b-f54b8ae9f7fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:42.538418 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193cf8b8-c555-4f94-9b6b-f54b8ae9f7fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:42.540961 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193cf8b8-c555-4f94-9b6b-f54b8ae9f7fc admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:42.553635 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1078/2171] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:15:42.558552 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa2cd8-f98b-4224-bfbd-74e372f03a6b admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:42.570732 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa2cd8-f98b-4224-bfbd-74e372f03a6b admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:42.576717 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3913ce7-d3bd-440a-b6ba-f8291fc1b838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:42.577461 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3913ce7-d3bd-440a-b6ba-f8291fc1b838 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:42.578202 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3913ce7-d3bd-440a-b6ba-f8291fc1b838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:42.578603 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3913ce7-d3bd-440a-b6ba-f8291fc1b838 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:42.579483 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3913ce7-d3bd-440a-b6ba-f8291fc1b838 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:42.581235 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3913ce7-d3bd-440a-b6ba-f8291fc1b838 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:42.593605 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1094/2172] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:15:42.600121 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193cf8b8-c555-4f94-9b6b-f54b8ae9f7fc admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:42.610654 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193cf8b8-c555-4f94-9b6b-f54b8ae9f7fc admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:42.616821 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665eb17-9509-4a6e-abc3-fd07475b606f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:42.617718 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665eb17-9509-4a6e-abc3-fd07475b606f admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:42.618006 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665eb17-9509-4a6e-abc3-fd07475b606f admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:42.618315 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665eb17-9509-4a6e-abc3-fd07475b606f admin admin] PATH_INFO: `/v3/projects/eacc7c8afabe4ac4a9d585ed6f2ae4ef/users/619ee1d4e1274269823ef8500d264852/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:42.634998 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5665eb17-9509-4a6e-abc3-fd07475b606f admin admin] RBAC: Authorizing `identity:create_grant(project_id=eacc7c8afabe4ac4a9d585ed6f2ae4ef, user_id=619ee1d4e1274269823ef8500d264852, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:42.640176 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5665eb17-9509-4a6e-abc3-fd07475b606f admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:42.655281 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1079/2173] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:15:42 2022] PUT /identity/v3/projects/eacc7c8afabe4ac4a9d585ed6f2ae4ef/users/619ee1d4e1274269823ef8500d264852/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:15:42.667796 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114da977-31ad-4e69-981c-7b8634a817d7 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:42.668150 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114da977-31ad-4e69-981c-7b8634a817d7 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:42.668414 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114da977-31ad-4e69-981c-7b8634a817d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:42.696510 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-114da977-31ad-4e69-981c-7b8634a817d7 None None] MFA Rules not processed for user `619ee1d4e1274269823ef8500d264852`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:42.697784 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-114da977-31ad-4e69-981c-7b8634a817d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:42.733470 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:42.772061 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1095/2174] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:15:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:15:42.783306 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665eb17-9509-4a6e-abc3-fd07475b606f admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:42.785285 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-5665eb17-9509-4a6e-abc3-fd07475b606f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:42.820548 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:42.851099 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665eb17-9509-4a6e-abc3-fd07475b606f admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:42.854846 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c761ba7-5ecd-4557-8b0b-f0a3671a80a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:42.855503 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c761ba7-5ecd-4557-8b0b-f0a3671a80a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:42.855787 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c761ba7-5ecd-4557-8b0b-f0a3671a80a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:42.856064 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c761ba7-5ecd-4557-8b0b-f0a3671a80a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:42.865903 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c761ba7-5ecd-4557-8b0b-f0a3671a80a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:42.867343 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c761ba7-5ecd-4557-8b0b-f0a3671a80a8 service cinder] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:42.876899 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1080/2175] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:15:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:15:44.263544 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f0821-65ff-4a46-9412-14d89b58a55b None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:44.264063 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f0821-65ff-4a46-9412-14d89b58a55b None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:44.264481 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f0821-65ff-4a46-9412-14d89b58a55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:44.304085 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-d12f0821-65ff-4a46-9412-14d89b58a55b None None] MFA Rules not processed for user `619ee1d4e1274269823ef8500d264852`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:44.305370 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-d12f0821-65ff-4a46-9412-14d89b58a55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:44.322082 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1096/2176] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:15:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:15:46.336758 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1efecde-4810-4f1d-8731-4713d71629dd None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:46.337284 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1efecde-4810-4f1d-8731-4713d71629dd None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:46.337380 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1efecde-4810-4f1d-8731-4713d71629dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:46.358272 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-b1efecde-4810-4f1d-8731-4713d71629dd None None] MFA Rules not processed for user `8c0f131484cb48d289cae1f473ec2fbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:46.359686 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-b1efecde-4810-4f1d-8731-4713d71629dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:46.430191 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1081/2177] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Jun 20 06:15:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:15:46.442862 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12f0821-65ff-4a46-9412-14d89b58a55b None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:46.444244 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-d12f0821-65ff-4a46-9412-14d89b58a55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:46.522111 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12f0821-65ff-4a46-9412-14d89b58a55b None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:46.526967 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3baa2-37b3-435a-8c86-2692659ccc24 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b490cf71bc468da5ea2be04239e33f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:46.527615 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3baa2-37b3-435a-8c86-2692659ccc24 service swift] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:46.527895 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3baa2-37b3-435a-8c86-2692659ccc24 service swift] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:46.528167 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3baa2-37b3-435a-8c86-2692659ccc24 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:46.538043 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3baa2-37b3-435a-8c86-2692659ccc24 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:46.539622 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3baa2-37b3-435a-8c86-2692659ccc24 service swift] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:46.547780 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1097/2178] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Jun 20 06:15:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 06:15:56.422273 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=39 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:56.548038 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=47 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:04.354670 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1efecde-4810-4f1d-8731-4713d71629dd None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:04.356089 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-b1efecde-4810-4f1d-8731-4713d71629dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:04.417549 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1efecde-4810-4f1d-8731-4713d71629dd None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:04.421221 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a44e31-8a05-4531-830c-9e893a9ab829 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:04.421939 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a44e31-8a05-4531-830c-9e893a9ab829 service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:04.422312 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a44e31-8a05-4531-830c-9e893a9ab829 service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:04.422656 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a44e31-8a05-4531-830c-9e893a9ab829 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:04.424493 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-b1a44e31-8a05-4531-830c-9e893a9ab829 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:04.504383 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a44e31-8a05-4531-830c-9e893a9ab829 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:04.505933 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a44e31-8a05-4531-830c-9e893a9ab829 service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:04.516828 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1082/2179] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:16:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:16:05.788937 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3baa2-37b3-435a-8c86-2692659ccc24 service swift] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:05.798436 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3baa2-37b3-435a-8c86-2692659ccc24 service swift] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:05.803099 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9faf99-69a5-41f4-ab19-07e1caa97ef3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:05.803737 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9faf99-69a5-41f4-ab19-07e1caa97ef3 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:05.804024 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9faf99-69a5-41f4-ab19-07e1caa97ef3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:05.804302 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9faf99-69a5-41f4-ab19-07e1caa97ef3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:05.806135 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-ca9faf99-69a5-41f4-ab19-07e1caa97ef3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:05.823115 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9faf99-69a5-41f4-ab19-07e1caa97ef3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:05.824627 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9faf99-69a5-41f4-ab19-07e1caa97ef3 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:05.837524 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1098/2180] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:16:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:16:14.511966 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=54 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:15.832097 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=6 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:19.959671 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a44e31-8a05-4531-830c-9e893a9ab829 service neutron] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:19.961717 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-b1a44e31-8a05-4531-830c-9e893a9ab829 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:19.976868 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a44e31-8a05-4531-830c-9e893a9ab829 service neutron] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:19.982414 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf3f1e-2d9c-4198-887a-af6934cae446 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cee106502e54829ad802ee41c9165fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:19.983245 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf3f1e-2d9c-4198-887a-af6934cae446 service nova] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:19.983524 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf3f1e-2d9c-4198-887a-af6934cae446 service nova] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:19.983796 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf3f1e-2d9c-4198-887a-af6934cae446 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:19.985538 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-37bf3f1e-2d9c-4198-887a-af6934cae446 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:20.050269 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf3f1e-2d9c-4198-887a-af6934cae446 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:20.051852 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf3f1e-2d9c-4198-887a-af6934cae446 service nova] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:20.061651 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1083/2181] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:16:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:16:20.978966 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9faf99-69a5-41f4-ab19-07e1caa97ef3 service neutron] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:20.986395 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9faf99-69a5-41f4-ab19-07e1caa97ef3 service neutron] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:20.995468 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d1a11-9bc5-4db5-a7e9-216051065b1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cee106502e54829ad802ee41c9165fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:20.996397 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d1a11-9bc5-4db5-a7e9-216051065b1f service nova] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:20.996875 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d1a11-9bc5-4db5-a7e9-216051065b1f service nova] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:20.997157 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d1a11-9bc5-4db5-a7e9-216051065b1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:20.998943 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-b21d1a11-9bc5-4db5-a7e9-216051065b1f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:21.063455 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21d1a11-9bc5-4db5-a7e9-216051065b1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:21.065083 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21d1a11-9bc5-4db5-a7e9-216051065b1f service nova] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:21.075146 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1099/2182] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:16:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:16:30.057322 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=28 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:30.715137 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa801af-707e-4954-accb-8133ebe3823c None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:30.715503 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa801af-707e-4954-accb-8133ebe3823c None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:30.715705 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa801af-707e-4954-accb-8133ebe3823c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:30.736487 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-4aa801af-707e-4954-accb-8133ebe3823c None None] MFA Rules not processed for user `8c0f131484cb48d289cae1f473ec2fbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:16:30.738030 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-4aa801af-707e-4954-accb-8133ebe3823c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:30.747440 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1084/2183] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Jun 20 06:16:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:16:30.774188 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d1a11-9bc5-4db5-a7e9-216051065b1f service nova] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:30.787204 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d1a11-9bc5-4db5-a7e9-216051065b1f service nova] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:30.804331 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71700994-85fc-4ed3-8dee-610e2081c66a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b490cf71bc468da5ea2be04239e33f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:30.805028 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71700994-85fc-4ed3-8dee-610e2081c66a service swift] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:30.805309 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71700994-85fc-4ed3-8dee-610e2081c66a service swift] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:30.805583 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71700994-85fc-4ed3-8dee-610e2081c66a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:30.814616 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71700994-85fc-4ed3-8dee-610e2081c66a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:30.816222 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71700994-85fc-4ed3-8dee-610e2081c66a service swift] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:30.826479 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1100/2184] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Jun 20 06:16:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 06:16:30.896448 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936a429-fa36-4a66-8d91-06078f531235 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:30.896658 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936a429-fa36-4a66-8d91-06078f531235 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:30.897144 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936a429-fa36-4a66-8d91-06078f531235 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:30.898912 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1085/2185] 10.222.0.39 () {54 vars in 921 bytes} [Mon Jun 20 06:16:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:16:30.906247 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78eab95-654e-4faa-a936-aaa4d4139a40 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:30.906540 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78eab95-654e-4faa-a936-aaa4d4139a40 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:30.906822 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78eab95-654e-4faa-a936-aaa4d4139a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:30.941740 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0936a429-fa36-4a66-8d91-06078f531235 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:30.955469 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-f78eab95-654e-4faa-a936-aaa4d4139a40 None None] MFA Rules not processed for user `3cee106502e54829ad802ee41c9165fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:16:30.957154 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0936a429-fa36-4a66-8d91-06078f531235 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:30.957590 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-f78eab95-654e-4faa-a936-aaa4d4139a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:30.975596 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1101/2186] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Jun 20 06:16:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:16:30.979709 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980aaaba-b96c-4f33-910f-6bd0cbad587e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:30.980596 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980aaaba-b96c-4f33-910f-6bd0cbad587e service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:30.980885 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980aaaba-b96c-4f33-910f-6bd0cbad587e service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:30.981255 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980aaaba-b96c-4f33-910f-6bd0cbad587e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:30.985606 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78eab95-654e-4faa-a936-aaa4d4139a40 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:30.988079 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-f78eab95-654e-4faa-a936-aaa4d4139a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:30.997323 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-980aaaba-b96c-4f33-910f-6bd0cbad587e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:31.025169 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980aaaba-b96c-4f33-910f-6bd0cbad587e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:31.026636 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980aaaba-b96c-4f33-910f-6bd0cbad587e service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:31.046701 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1086/2187] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:16:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:16:31.102038 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78eab95-654e-4faa-a936-aaa4d4139a40 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:31.106949 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bfcfe6-89d5-404b-a341-965a22d5175c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cb22811a754357ab9d839b70d44261', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:31.107871 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bfcfe6-89d5-404b-a341-965a22d5175c service glance] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:31.108150 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bfcfe6-89d5-404b-a341-965a22d5175c service glance] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:31.108423 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bfcfe6-89d5-404b-a341-965a22d5175c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:31.129503 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bfcfe6-89d5-404b-a341-965a22d5175c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:31.132830 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bfcfe6-89d5-404b-a341-965a22d5175c service glance] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:31.145070 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1102/2188] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:16:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:16:31.220759 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b08ce-7b81-452a-8081-f691a6f4b446 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:31.221251 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b08ce-7b81-452a-8081-f691a6f4b446 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:31.221400 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b08ce-7b81-452a-8081-f691a6f4b446 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:31.222851 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1087/2189] 10.222.0.39 () {54 vars in 921 bytes} [Mon Jun 20 06:16:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:16:31.229665 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfad01e-4c80-4050-bf35-793fc4788403 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:31.230347 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfad01e-4c80-4050-bf35-793fc4788403 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:31.230638 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfad01e-4c80-4050-bf35-793fc4788403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:31.255755 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-ccfad01e-4c80-4050-bf35-793fc4788403 None None] MFA Rules not processed for user `83e77cb05c4546c7a98ada817573edf3`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:16:31.257454 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-ccfad01e-4c80-4050-bf35-793fc4788403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:31.267758 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1103/2190] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Jun 20 06:16:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:16:31.281801 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b08ce-7b81-452a-8081-f691a6f4b446 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:31.296921 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b08ce-7b81-452a-8081-f691a6f4b446 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:31.300998 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3483a57b-3e49-4841-bf41-3405088a43ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:31.301744 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483a57b-3e49-4841-bf41-3405088a43ac service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:31.302747 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483a57b-3e49-4841-bf41-3405088a43ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:31.303126 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483a57b-3e49-4841-bf41-3405088a43ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:31.312291 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3483a57b-3e49-4841-bf41-3405088a43ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:31.313947 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3483a57b-3e49-4841-bf41-3405088a43ac service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:31.323905 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1088/2191] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:16:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:16:31.511202 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559be00-d8d2-4c70-bf42-ddefc2475862 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:31.511590 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559be00-d8d2-4c70-bf42-ddefc2475862 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:31.512000 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559be00-d8d2-4c70-bf42-ddefc2475862 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:31.513689 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1104/2192] 10.222.0.39 () {54 vars in 921 bytes} [Mon Jun 20 06:16:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 06:16:31.529438 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f0479-dcfb-468a-a669-80282be6d531 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:31.529438 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f0479-dcfb-468a-a669-80282be6d531 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:31.529438 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f0479-dcfb-468a-a669-80282be6d531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:31.538525 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2437e-af03-4c82-b52f-c221dacb40e1 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:31.538818 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2437e-af03-4c82-b52f-c221dacb40e1 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:31.539101 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2437e-af03-4c82-b52f-c221dacb40e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:31.548958 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-cf4f0479-dcfb-468a-a669-80282be6d531 None None] MFA Rules not processed for user `3cee106502e54829ad802ee41c9165fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:16:31.550516 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-cf4f0479-dcfb-468a-a669-80282be6d531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:31.560417 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-4ac2437e-af03-4c82-b52f-c221dacb40e1 None None] MFA Rules not processed for user `8c0f131484cb48d289cae1f473ec2fbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:16:31.561669 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-4ac2437e-af03-4c82-b52f-c221dacb40e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:31.564048 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1089/2193] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Jun 20 06:16:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:16:31.570905 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1105/2194] 10.222.0.39 () {58 vars in 967 bytes} [Mon Jun 20 06:16:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:16:31.577284 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4f0479-dcfb-468a-a669-80282be6d531 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:31.579369 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-cf4f0479-dcfb-468a-a669-80282be6d531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:31.585096 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac2437e-af03-4c82-b52f-c221dacb40e1 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:31.592964 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4f0479-dcfb-468a-a669-80282be6d531 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:31.596841 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5722c46-635b-485e-b33b-8295c4eb1088 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:31.597296 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac2437e-af03-4c82-b52f-c221dacb40e1 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:31.597488 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5722c46-635b-485e-b33b-8295c4eb1088 service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:31.597770 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5722c46-635b-485e-b33b-8295c4eb1088 service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:31.598045 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5722c46-635b-485e-b33b-8295c4eb1088 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:31.603309 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb10d5-abb5-40f5-a769-d03a0b246ae5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b490cf71bc468da5ea2be04239e33f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:31.604037 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb10d5-abb5-40f5-a769-d03a0b246ae5 service swift] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:31.604395 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb10d5-abb5-40f5-a769-d03a0b246ae5 service swift] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:31.604673 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb10d5-abb5-40f5-a769-d03a0b246ae5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:31.610177 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5722c46-635b-485e-b33b-8295c4eb1088 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:31.611594 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5722c46-635b-485e-b33b-8295c4eb1088 service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:31.613574 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eb10d5-abb5-40f5-a769-d03a0b246ae5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:31.615174 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eb10d5-abb5-40f5-a769-d03a0b246ae5 service swift] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:31.622860 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1090/2195] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:16:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:16:31.623430 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1106/2196] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Jun 20 06:16:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 20 06:16:31.694465 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5722c46-635b-485e-b33b-8295c4eb1088 service neutron] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:31.695877 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-e5722c46-635b-485e-b33b-8295c4eb1088 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:31.791252 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5722c46-635b-485e-b33b-8295c4eb1088 service neutron] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:31.797909 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fecd31-ae0b-418d-baf8-92d2044613bb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f0f9248178049cda6571fa365a21225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:31.798562 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fecd31-ae0b-418d-baf8-92d2044613bb service placement] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:31.799046 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fecd31-ae0b-418d-baf8-92d2044613bb service placement] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:31.799670 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fecd31-ae0b-418d-baf8-92d2044613bb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:31.802179 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-38fecd31-ae0b-418d-baf8-92d2044613bb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:31.816517 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fecd31-ae0b-418d-baf8-92d2044613bb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:31.818909 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fecd31-ae0b-418d-baf8-92d2044613bb service placement] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:31.836596 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1091/2197] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:16:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:16:31.852631 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b94b059-c1d5-49bf-95db-95f8bf775649 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:31.853208 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b94b059-c1d5-49bf-95db-95f8bf775649 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:31.854438 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b94b059-c1d5-49bf-95db-95f8bf775649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:31.874014 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-3b94b059-c1d5-49bf-95db-95f8bf775649 None None] MFA Rules not processed for user `8c0f131484cb48d289cae1f473ec2fbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:16:31.875595 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-3b94b059-c1d5-49bf-95db-95f8bf775649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:31.886734 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1107/2198] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Jun 20 06:16:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:16:31.902708 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fecd31-ae0b-418d-baf8-92d2044613bb service placement] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:31.914740 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fecd31-ae0b-418d-baf8-92d2044613bb service placement] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:31.920996 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399cfb62-bfd5-45d6-9a16-be56f3125702 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b490cf71bc468da5ea2be04239e33f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:31.921914 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399cfb62-bfd5-45d6-9a16-be56f3125702 service swift] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:31.922432 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399cfb62-bfd5-45d6-9a16-be56f3125702 service swift] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:31.923045 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399cfb62-bfd5-45d6-9a16-be56f3125702 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:31.933598 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399cfb62-bfd5-45d6-9a16-be56f3125702 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:31.935598 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399cfb62-bfd5-45d6-9a16-be56f3125702 service swift] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:31.948389 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1092/2199] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Jun 20 06:16:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 06:16:32.318929 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac57b9-9c46-4701-b7cb-8631d102147e None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:32.319212 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac57b9-9c46-4701-b7cb-8631d102147e None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:32.319539 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac57b9-9c46-4701-b7cb-8631d102147e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:32.338499 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-4dac57b9-9c46-4701-b7cb-8631d102147e None None] MFA Rules not processed for user `8c0f131484cb48d289cae1f473ec2fbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:16:32.340018 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-4dac57b9-9c46-4701-b7cb-8631d102147e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:32.347764 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1108/2200] 10.222.0.39 () {58 vars in 967 bytes} [Mon Jun 20 06:16:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:16:32.369054 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399cfb62-bfd5-45d6-9a16-be56f3125702 service swift] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:32.382281 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399cfb62-bfd5-45d6-9a16-be56f3125702 service swift] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:32.389699 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c9eb6-cf4e-4a03-936e-8bfc443a34af service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b490cf71bc468da5ea2be04239e33f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:32.390398 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c9eb6-cf4e-4a03-936e-8bfc443a34af service swift] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:32.390721 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c9eb6-cf4e-4a03-936e-8bfc443a34af service swift] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:32.391067 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c9eb6-cf4e-4a03-936e-8bfc443a34af service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:32.401012 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3c9eb6-cf4e-4a03-936e-8bfc443a34af service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:32.402891 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3c9eb6-cf4e-4a03-936e-8bfc443a34af service swift] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:32.414464 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1093/2201] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Jun 20 06:16:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 06:16:37.725749 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac57b9-9c46-4701-b7cb-8631d102147e None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:37.735764 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:37.789144 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac57b9-9c46-4701-b7cb-8631d102147e None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:37.793662 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f26214c-a114-468c-9825-0f4dd748bef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:37.794528 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26214c-a114-468c-9825-0f4dd748bef2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:37.794813 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26214c-a114-468c-9825-0f4dd748bef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:37.795090 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26214c-a114-468c-9825-0f4dd748bef2 admin admin] PATH_INFO: `/v3/users/619ee1d4e1274269823ef8500d264852` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:37.796281 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f26214c-a114-468c-9825-0f4dd748bef2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=619ee1d4e1274269823ef8500d264852)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:37.798236 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f26214c-a114-468c-9825-0f4dd748bef2 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:37.844039 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-0f26214c-a114-468c-9825-0f4dd748bef2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '619ee1d4e1274269823ef8500d264852'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:16:37.851963 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-0f26214c-a114-468c-9825-0f4dd748bef2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '619ee1d4e1274269823ef8500d264852'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:16:37.859186 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-0f26214c-a114-468c-9825-0f4dd748bef2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '619ee1d4e1274269823ef8500d264852'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:16:37.871433 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-0f26214c-a114-468c-9825-0f4dd748bef2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '619ee1d4e1274269823ef8500d264852'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:16:37.872069 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-0f26214c-a114-468c-9825-0f4dd748bef2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '619ee1d4e1274269823ef8500d264852'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:16:37.878152 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1109/2202] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:16:37 2022] DELETE /identity/v3/users/619ee1d4e1274269823ef8500d264852 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:16:37.882843 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ec7e2-df13-4582-9e49-cb038301ba3d None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:37.883337 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ec7e2-df13-4582-9e49-cb038301ba3d None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:37.883455 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ec7e2-df13-4582-9e49-cb038301ba3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:37.900786 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-4b2ec7e2-df13-4582-9e49-cb038301ba3d None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:16:37.902103 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-4b2ec7e2-df13-4582-9e49-cb038301ba3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:37.962919 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1094/2203] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:16:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:16:37.972392 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f26214c-a114-468c-9825-0f4dd748bef2 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:37.976187 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-0f26214c-a114-468c-9825-0f4dd748bef2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:38.040012 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f26214c-a114-468c-9825-0f4dd748bef2 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:38.044945 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ccfa5-1b4e-46f6-9827-1e53d8074037 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:38.046081 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ccfa5-1b4e-46f6-9827-1e53d8074037 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:38.046081 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ccfa5-1b4e-46f6-9827-1e53d8074037 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:38.046291 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ccfa5-1b4e-46f6-9827-1e53d8074037 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:38.058592 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673ccfa5-1b4e-46f6-9827-1e53d8074037 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:38.060036 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673ccfa5-1b4e-46f6-9827-1e53d8074037 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:38.070218 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1110/2204] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:16:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:16:38.246332 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ec7e2-df13-4582-9e49-cb038301ba3d None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:38.248154 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-4b2ec7e2-df13-4582-9e49-cb038301ba3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:38.262521 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ec7e2-df13-4582-9e49-cb038301ba3d None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:38.269176 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beaac07-304b-491f-88b2-0750619df76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:38.271241 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beaac07-304b-491f-88b2-0750619df76b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:38.271667 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beaac07-304b-491f-88b2-0750619df76b admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:38.272029 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beaac07-304b-491f-88b2-0750619df76b admin admin] PATH_INFO: `/v3/projects/eacc7c8afabe4ac4a9d585ed6f2ae4ef` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:38.273444 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beaac07-304b-491f-88b2-0750619df76b admin admin] RBAC: Authorizing `identity:delete_project(project_id=eacc7c8afabe4ac4a9d585ed6f2ae4ef)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:38.275658 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beaac07-304b-491f-88b2-0750619df76b admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:38.298289 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:38.348083 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-7beaac07-304b-491f-88b2-0750619df76b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eacc7c8afabe4ac4a9d585ed6f2ae4ef', 'request_id': 'req-7beaac07-304b-491f-88b2-0750619df76b'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:16:38.361613 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-7beaac07-304b-491f-88b2-0750619df76b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eacc7c8afabe4ac4a9d585ed6f2ae4ef', 'request_id': 'req-7beaac07-304b-491f-88b2-0750619df76b'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:16:38.369831 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-7beaac07-304b-491f-88b2-0750619df76b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eacc7c8afabe4ac4a9d585ed6f2ae4ef', 'request_id': 'req-7beaac07-304b-491f-88b2-0750619df76b'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:16:38.382522 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-7beaac07-304b-491f-88b2-0750619df76b admin admin] The token cache is being invalidate because project eacc7c8afabe4ac4a9d585ed6f2ae4ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:16:38.382888 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-7beaac07-304b-491f-88b2-0750619df76b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:16:38.383607 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-7beaac07-304b-491f-88b2-0750619df76b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:16:38.385395 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1095/2205] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:16:38 2022] DELETE /identity/v3/projects/eacc7c8afabe4ac4a9d585ed6f2ae4ef => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:16:38.967265 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0d811-5ca3-495c-a556-27c10591e456 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:38.967742 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0d811-5ca3-495c-a556-27c10591e456 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:38.967837 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0d811-5ca3-495c-a556-27c10591e456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:38.986002 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-3cc0d811-5ca3-495c-a556-27c10591e456 None None] MFA Rules not processed for user `8c0f131484cb48d289cae1f473ec2fbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:16:38.987196 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-3cc0d811-5ca3-495c-a556-27c10591e456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:39.013857 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:39.043211 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1111/2206] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Jun 20 06:16:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:16:39.054996 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beaac07-304b-491f-88b2-0750619df76b admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:39.056398 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-7beaac07-304b-491f-88b2-0750619df76b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:39.125499 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beaac07-304b-491f-88b2-0750619df76b admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:39.130408 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe1771-c859-4128-9036-4e4d8dd393b9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b490cf71bc468da5ea2be04239e33f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:39.131046 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe1771-c859-4128-9036-4e4d8dd393b9 service swift] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:39.131326 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe1771-c859-4128-9036-4e4d8dd393b9 service swift] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:39.131599 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe1771-c859-4128-9036-4e4d8dd393b9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:39.139594 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabe1771-c859-4128-9036-4e4d8dd393b9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:39.141239 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabe1771-c859-4128-9036-4e4d8dd393b9 service swift] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:39.150186 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1096/2207] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Jun 20 06:16:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 06:16:45.770025 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676773e-0e4d-4570-95ff-2ec4d2b54ff3 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:45.770707 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676773e-0e4d-4570-95ff-2ec4d2b54ff3 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:45.770707 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676773e-0e4d-4570-95ff-2ec4d2b54ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:45.790303 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-d676773e-0e4d-4570-95ff-2ec4d2b54ff3 None None] MFA Rules not processed for user `b6cafb20423142db91fcca21cd19ff7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:16:45.791546 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-d676773e-0e4d-4570-95ff-2ec4d2b54ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:45.857329 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1112/2208] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:16:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:16:46.097661 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe1771-c859-4128-9036-4e4d8dd393b9 service swift] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:46.099897 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-eabe1771-c859-4128-9036-4e4d8dd393b9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:46.166324 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe1771-c859-4128-9036-4e4d8dd393b9 service swift] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:46.170285 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6d701d-1d4f-48c9-8491-a59864a7a0c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:46.170932 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d701d-1d4f-48c9-8491-a59864a7a0c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:46.171211 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d701d-1d4f-48c9-8491-a59864a7a0c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:46.171483 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d701d-1d4f-48c9-8491-a59864a7a0c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:46.173305 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-7f6d701d-1d4f-48c9-8491-a59864a7a0c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:46.183375 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6d701d-1d4f-48c9-8491-a59864a7a0c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:46.184873 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6d701d-1d4f-48c9-8491-a59864a7a0c4 service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:46.193387 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1097/2209] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:16:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:16:55.850056 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=36 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:56.189473 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=80,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:59.761599 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676773e-0e4d-4570-95ff-2ec4d2b54ff3 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:59.763095 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-d676773e-0e4d-4570-95ff-2ec4d2b54ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:59.838295 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676773e-0e4d-4570-95ff-2ec4d2b54ff3 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:59.843786 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b39e5-92ef-4d87-b143-6d283d5fa9ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cee106502e54829ad802ee41c9165fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:59.844439 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b39e5-92ef-4d87-b143-6d283d5fa9ef service nova] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:59.845064 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b39e5-92ef-4d87-b143-6d283d5fa9ef service nova] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:59.845064 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b39e5-92ef-4d87-b143-6d283d5fa9ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:59.846797 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-2d2b39e5-92ef-4d87-b143-6d283d5fa9ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:59.859277 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b39e5-92ef-4d87-b143-6d283d5fa9ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:59.860888 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b39e5-92ef-4d87-b143-6d283d5fa9ef service nova] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:59.871431 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1113/2210] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:16:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:17:06.950284 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6d701d-1d4f-48c9-8491-a59864a7a0c4 service neutron] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:06.964184 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6d701d-1d4f-48c9-8491-a59864a7a0c4 service neutron] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:06.969939 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e84891-bce1-442b-86e8-69e5914f002d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cee106502e54829ad802ee41c9165fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:06.970741 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e84891-bce1-442b-86e8-69e5914f002d service nova] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:06.971130 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e84891-bce1-442b-86e8-69e5914f002d service nova] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:06.971521 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e84891-bce1-442b-86e8-69e5914f002d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:06.973511 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-e8e84891-bce1-442b-86e8-69e5914f002d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:17:06.987562 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e84891-bce1-442b-86e8-69e5914f002d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:06.989317 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e84891-bce1-442b-86e8-69e5914f002d service nova] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:07.001238 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1098/2211] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:17:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:17:09.867170 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=34 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:17:14.926281 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b39e5-92ef-4d87-b143-6d283d5fa9ef service nova] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:14.937542 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b39e5-92ef-4d87-b143-6d283d5fa9ef service nova] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:14.943492 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42103a57-53f7-472f-8015-52195e747805 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cee106502e54829ad802ee41c9165fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:14.944130 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42103a57-53f7-472f-8015-52195e747805 service nova] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:14.944410 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42103a57-53f7-472f-8015-52195e747805 service nova] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:14.944684 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42103a57-53f7-472f-8015-52195e747805 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:14.946469 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-42103a57-53f7-472f-8015-52195e747805 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:17:15.004328 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42103a57-53f7-472f-8015-52195e747805 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:15.006640 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42103a57-53f7-472f-8015-52195e747805 service nova] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:15.015525 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1114/2212] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:17:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:17:15.457681 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9099965d-beea-4752-a8a2-71b29af6c325 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:15.458207 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9099965d-beea-4752-a8a2-71b29af6c325 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:15.458207 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9099965d-beea-4752-a8a2-71b29af6c325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:15.475915 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-9099965d-beea-4752-a8a2-71b29af6c325 None None] MFA Rules not processed for user `8c0f131484cb48d289cae1f473ec2fbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:17:15.477137 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-9099965d-beea-4752-a8a2-71b29af6c325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:17:15.484619 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1099/2213] 10.222.0.39 () {58 vars in 967 bytes} [Mon Jun 20 06:17:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:17:15.499395 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42103a57-53f7-472f-8015-52195e747805 service nova] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:15.512648 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42103a57-53f7-472f-8015-52195e747805 service nova] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:15.518366 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecc8dca-0ab2-4f45-969c-7ecc7ec01836 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b490cf71bc468da5ea2be04239e33f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:15.519031 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc8dca-0ab2-4f45-969c-7ecc7ec01836 service swift] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:15.519319 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc8dca-0ab2-4f45-969c-7ecc7ec01836 service swift] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:15.519628 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc8dca-0ab2-4f45-969c-7ecc7ec01836 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:15.528621 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecc8dca-0ab2-4f45-969c-7ecc7ec01836 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:15.530233 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecc8dca-0ab2-4f45-969c-7ecc7ec01836 service swift] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:15.539017 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1115/2214] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Jun 20 06:17:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 06:17:19.563875 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9099965d-beea-4752-a8a2-71b29af6c325 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:19.573603 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9099965d-beea-4752-a8a2-71b29af6c325 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:19.577101 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ffca9d-cbe8-4367-ac08-fceb7e78b667 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:19.577732 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ffca9d-cbe8-4367-ac08-fceb7e78b667 service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:19.578012 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ffca9d-cbe8-4367-ac08-fceb7e78b667 service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:19.578284 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ffca9d-cbe8-4367-ac08-fceb7e78b667 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:19.580018 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-44ffca9d-cbe8-4367-ac08-fceb7e78b667 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:17:19.653540 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ffca9d-cbe8-4367-ac08-fceb7e78b667 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:19.654977 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ffca9d-cbe8-4367-ac08-fceb7e78b667 service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:19.664628 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1100/2215] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:17:19 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:17:25.535028 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=34 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:17:29.660130 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=39 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:17:55.266881 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be818179-16fb-4d95-9ad0-633fcb38b593 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:55.267425 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be818179-16fb-4d95-9ad0-633fcb38b593 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:55.267425 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be818179-16fb-4d95-9ad0-633fcb38b593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:55.285279 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-be818179-16fb-4d95-9ad0-633fcb38b593 None None] MFA Rules not processed for user `e1516d2903414b7caf082c32dcdac3eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:17:55.286469 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-be818179-16fb-4d95-9ad0-633fcb38b593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:17:55.294214 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1116/2216] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:17:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:18:05.280578 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:18:10.969437 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ffca9d-cbe8-4367-ac08-fceb7e78b667 service neutron] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:18:10.970819 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-44ffca9d-cbe8-4367-ac08-fceb7e78b667 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:18:11.023140 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be818179-16fb-4d95-9ad0-633fcb38b593 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:18:11.024812 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-be818179-16fb-4d95-9ad0-633fcb38b593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:18:11.049633 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ffca9d-cbe8-4367-ac08-fceb7e78b667 service neutron] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:18:11.054598 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef576d8a-d2f1-4043-b469-5ca00d7f6505 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f0f9248178049cda6571fa365a21225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:18:11.055248 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef576d8a-d2f1-4043-b469-5ca00d7f6505 service placement] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:18:11.056185 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef576d8a-d2f1-4043-b469-5ca00d7f6505 service placement] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:18:11.056542 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef576d8a-d2f1-4043-b469-5ca00d7f6505 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:18:11.058398 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-ef576d8a-d2f1-4043-b469-5ca00d7f6505 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:18:11.069962 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef576d8a-d2f1-4043-b469-5ca00d7f6505 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:18:11.071616 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef576d8a-d2f1-4043-b469-5ca00d7f6505 service placement] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:18:11.081740 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1101/2217] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:18:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:18:11.109885 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be818179-16fb-4d95-9ad0-633fcb38b593 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:18:11.114667 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489cd944-a87b-4685-ad83-5163f0428f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:18:11.115540 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489cd944-a87b-4685-ad83-5163f0428f61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:18:11.115823 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489cd944-a87b-4685-ad83-5163f0428f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:18:11.116123 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489cd944-a87b-4685-ad83-5163f0428f61 admin admin] PATH_INFO: `/v3/users/b6cafb20423142db91fcca21cd19ff7d` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:18:11.117347 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489cd944-a87b-4685-ad83-5163f0428f61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6cafb20423142db91fcca21cd19ff7d)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:18:11.119673 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489cd944-a87b-4685-ad83-5163f0428f61 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:18:11.167604 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-489cd944-a87b-4685-ad83-5163f0428f61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6cafb20423142db91fcca21cd19ff7d'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:18:11.174853 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-489cd944-a87b-4685-ad83-5163f0428f61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6cafb20423142db91fcca21cd19ff7d'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:18:11.182203 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-489cd944-a87b-4685-ad83-5163f0428f61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6cafb20423142db91fcca21cd19ff7d'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:18:11.193817 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-489cd944-a87b-4685-ad83-5163f0428f61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6cafb20423142db91fcca21cd19ff7d'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:18:11.194458 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-489cd944-a87b-4685-ad83-5163f0428f61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6cafb20423142db91fcca21cd19ff7d'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:18:11.201235 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1117/2218] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:18:11 2022] DELETE /identity/v3/users/b6cafb20423142db91fcca21cd19ff7d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:18:11.374775 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef576d8a-d2f1-4043-b469-5ca00d7f6505 service placement] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:18:11.388420 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef576d8a-d2f1-4043-b469-5ca00d7f6505 service placement] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:18:11.447872 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c3d8b-bb19-4471-817d-513184a8e161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:18:11.448769 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c3d8b-bb19-4471-817d-513184a8e161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:18:11.449052 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c3d8b-bb19-4471-817d-513184a8e161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:18:11.449332 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c3d8b-bb19-4471-817d-513184a8e161 admin admin] PATH_INFO: `/v3/projects/32eaa17777d1483ebf99b417ca9ad0b9` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:18:11.450513 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7c3d8b-bb19-4471-817d-513184a8e161 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32eaa17777d1483ebf99b417ca9ad0b9)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:18:11.452440 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7c3d8b-bb19-4471-817d-513184a8e161 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:18:11.499925 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-ad7c3d8b-bb19-4471-817d-513184a8e161 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32eaa17777d1483ebf99b417ca9ad0b9', 'request_id': 'req-ad7c3d8b-bb19-4471-817d-513184a8e161'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:18:11.508105 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-ad7c3d8b-bb19-4471-817d-513184a8e161 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32eaa17777d1483ebf99b417ca9ad0b9', 'request_id': 'req-ad7c3d8b-bb19-4471-817d-513184a8e161'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:18:11.514307 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-ad7c3d8b-bb19-4471-817d-513184a8e161 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32eaa17777d1483ebf99b417ca9ad0b9', 'request_id': 'req-ad7c3d8b-bb19-4471-817d-513184a8e161'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:18:11.525108 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-ad7c3d8b-bb19-4471-817d-513184a8e161 admin admin] The token cache is being invalidate because project 32eaa17777d1483ebf99b417ca9ad0b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:18:11.525396 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-ad7c3d8b-bb19-4471-817d-513184a8e161 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:18:11.526029 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-ad7c3d8b-bb19-4471-817d-513184a8e161 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:18:11.527583 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1102/2219] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:18:11 2022] DELETE /identity/v3/projects/32eaa17777d1483ebf99b417ca9ad0b9 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:18:21.197676 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=53,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:18:21.522130 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=83,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:18:34.877904 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489cd944-a87b-4685-ad83-5163f0428f61 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:18:34.879235 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-489cd944-a87b-4685-ad83-5163f0428f61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:18:34.960825 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489cd944-a87b-4685-ad83-5163f0428f61 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:18:35.023065 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d8b47-017c-4d9a-bba6-78a0db351016 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cee106502e54829ad802ee41c9165fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:18:35.023840 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d8b47-017c-4d9a-bba6-78a0db351016 service nova] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:18:35.024131 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d8b47-017c-4d9a-bba6-78a0db351016 service nova] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:18:35.024490 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d8b47-017c-4d9a-bba6-78a0db351016 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:18:35.026364 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-734d8b47-017c-4d9a-bba6-78a0db351016 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:18:35.085313 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734d8b47-017c-4d9a-bba6-78a0db351016 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:18:35.088398 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734d8b47-017c-4d9a-bba6-78a0db351016 service nova] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:18:35.099594 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1118/2220] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:18:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:18:45.095354 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=84 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:18:47.753664 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e61d80-6cf3-433d-b6e0-b7a410b5f049 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:18:47.754138 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e61d80-6cf3-433d-b6e0-b7a410b5f049 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:18:47.754367 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e61d80-6cf3-433d-b6e0-b7a410b5f049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:18:47.773655 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-f8e61d80-6cf3-433d-b6e0-b7a410b5f049 None None] MFA Rules not processed for user `498822fcffaf4cc79532c487418cb11c`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:18:47.775865 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-f8e61d80-6cf3-433d-b6e0-b7a410b5f049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:18:47.845171 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1103/2221] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:18:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:18:50.848645 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11273d-dadb-413d-a04b-4208ce456612 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:18:50.849160 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11273d-dadb-413d-a04b-4208ce456612 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:18:50.849254 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11273d-dadb-413d-a04b-4208ce456612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:18:50.875627 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-9d11273d-dadb-413d-a04b-4208ce456612 None None] MFA Rules not processed for user `68c4b81f2f704a9bbe15fd0f3326bb3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:18:50.877184 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-9d11273d-dadb-413d-a04b-4208ce456612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:18:50.888754 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1119/2222] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:18:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:18:57.838408 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=25 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:19:00.870507 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:19:04.341168 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e61d80-6cf3-433d-b6e0-b7a410b5f049 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:19:04.342784 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-f8e61d80-6cf3-433d-b6e0-b7a410b5f049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:19:04.360983 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e61d80-6cf3-433d-b6e0-b7a410b5f049 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:19:04.366605 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73456c3f-bfdc-4731-9cbd-567290d33efb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cee106502e54829ad802ee41c9165fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:19:04.367324 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73456c3f-bfdc-4731-9cbd-567290d33efb service nova] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:04.367612 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73456c3f-bfdc-4731-9cbd-567290d33efb service nova] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:04.367888 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73456c3f-bfdc-4731-9cbd-567290d33efb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:04.370147 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-73456c3f-bfdc-4731-9cbd-567290d33efb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:19:04.382560 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73456c3f-bfdc-4731-9cbd-567290d33efb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:19:04.385309 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73456c3f-bfdc-4731-9cbd-567290d33efb service nova] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:19:04.402465 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1104/2223] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:19:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:19:14.394970 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=6 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:19:20.184736 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d11273d-dadb-413d-a04b-4208ce456612 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:19:20.186827 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-9d11273d-dadb-413d-a04b-4208ce456612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:19:20.270545 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d11273d-dadb-413d-a04b-4208ce456612 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:19:20.275953 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8b871-418c-444b-94c2-3473ff685e1c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f0f9248178049cda6571fa365a21225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:19:20.276607 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8b871-418c-444b-94c2-3473ff685e1c service placement] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:20.277040 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8b871-418c-444b-94c2-3473ff685e1c service placement] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:20.277322 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8b871-418c-444b-94c2-3473ff685e1c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:20.279248 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-1fe8b871-418c-444b-94c2-3473ff685e1c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:19:20.294115 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe8b871-418c-444b-94c2-3473ff685e1c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:19:20.295711 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe8b871-418c-444b-94c2-3473ff685e1c service placement] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:19:20.307472 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1120/2224] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:19:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:19:30.302477 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=32 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:19:30.650994 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae55f4-e030-4839-955d-ab483d214919 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:30.651503 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae55f4-e030-4839-955d-ab483d214919 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:30.651611 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae55f4-e030-4839-955d-ab483d214919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:30.669456 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-69ae55f4-e030-4839-955d-ab483d214919 None None] MFA Rules not processed for user `b19967e2b09342e9ac006151002bf71a`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:19:30.670645 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-69ae55f4-e030-4839-955d-ab483d214919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:19:30.731648 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1105/2225] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:19:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:19:32.798764 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8b871-418c-444b-94c2-3473ff685e1c service placement] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:19:32.800218 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-1fe8b871-418c-444b-94c2-3473ff685e1c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:19:32.870779 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8b871-418c-444b-94c2-3473ff685e1c service placement] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:19:32.876390 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecfd129-d021-4200-9ac3-c01ecda82aaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:19:32.877117 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfd129-d021-4200-9ac3-c01ecda82aaa service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:32.877596 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfd129-d021-4200-9ac3-c01ecda82aaa service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:32.878050 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfd129-d021-4200-9ac3-c01ecda82aaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:32.880823 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-eecfd129-d021-4200-9ac3-c01ecda82aaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:19:32.955606 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecfd129-d021-4200-9ac3-c01ecda82aaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:19:32.957315 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecfd129-d021-4200-9ac3-c01ecda82aaa service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:19:32.968808 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1121/2226] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:19:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:19:36.508289 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae55f4-e030-4839-955d-ab483d214919 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:19:36.509825 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-69ae55f4-e030-4839-955d-ab483d214919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:19:36.528387 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae55f4-e030-4839-955d-ab483d214919 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:19:36.538064 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb0aad-643d-4912-9a5a-febe77fac745 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f0f9248178049cda6571fa365a21225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:19:36.538718 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb0aad-643d-4912-9a5a-febe77fac745 service placement] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:36.539003 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb0aad-643d-4912-9a5a-febe77fac745 service placement] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:36.539272 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb0aad-643d-4912-9a5a-febe77fac745 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:36.541932 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-3abb0aad-643d-4912-9a5a-febe77fac745 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:19:36.557796 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb0aad-643d-4912-9a5a-febe77fac745 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:19:36.559791 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb0aad-643d-4912-9a5a-febe77fac745 service placement] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:19:36.579520 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecfd129-d021-4200-9ac3-c01ecda82aaa service neutron] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:19:36.580819 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1106/2227] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:19:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:19:36.581015 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-eecfd129-d021-4200-9ac3-c01ecda82aaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:19:36.594222 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecfd129-d021-4200-9ac3-c01ecda82aaa service neutron] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:19:36.599440 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89004005-dcc0-4312-a915-65f3c5a874fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:19:36.600314 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89004005-dcc0-4312-a915-65f3c5a874fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:36.600595 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89004005-dcc0-4312-a915-65f3c5a874fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:36.601103 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89004005-dcc0-4312-a915-65f3c5a874fd admin admin] PATH_INFO: `/v3/users/e1516d2903414b7caf082c32dcdac3eb` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:36.603332 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89004005-dcc0-4312-a915-65f3c5a874fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1516d2903414b7caf082c32dcdac3eb)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:19:36.605469 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89004005-dcc0-4312-a915-65f3c5a874fd admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:19:36.654803 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-89004005-dcc0-4312-a915-65f3c5a874fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1516d2903414b7caf082c32dcdac3eb'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:36.662500 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-89004005-dcc0-4312-a915-65f3c5a874fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1516d2903414b7caf082c32dcdac3eb'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:36.670740 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-89004005-dcc0-4312-a915-65f3c5a874fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1516d2903414b7caf082c32dcdac3eb'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:36.683824 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-89004005-dcc0-4312-a915-65f3c5a874fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1516d2903414b7caf082c32dcdac3eb'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:36.684558 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-89004005-dcc0-4312-a915-65f3c5a874fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1516d2903414b7caf082c32dcdac3eb'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:36.690955 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1122/2228] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:19:36 2022] DELETE /identity/v3/users/e1516d2903414b7caf082c32dcdac3eb => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:19:36.956770 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb0aad-643d-4912-9a5a-febe77fac745 service placement] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:19:36.968804 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb0aad-643d-4912-9a5a-febe77fac745 service placement] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:19:37.031049 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61f8494-8326-406c-b491-ba22f7e094b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:19:37.031950 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f8494-8326-406c-b491-ba22f7e094b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:37.032237 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f8494-8326-406c-b491-ba22f7e094b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:37.032511 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f8494-8326-406c-b491-ba22f7e094b6 admin admin] PATH_INFO: `/v3/projects/9f7a1ff44e2a455ba4260b74ae06b50c` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:37.033750 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61f8494-8326-406c-b491-ba22f7e094b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f7a1ff44e2a455ba4260b74ae06b50c)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:19:37.035665 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61f8494-8326-406c-b491-ba22f7e094b6 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:19:37.098757 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-f61f8494-8326-406c-b491-ba22f7e094b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f7a1ff44e2a455ba4260b74ae06b50c', 'request_id': 'req-f61f8494-8326-406c-b491-ba22f7e094b6'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:37.110445 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-f61f8494-8326-406c-b491-ba22f7e094b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f7a1ff44e2a455ba4260b74ae06b50c', 'request_id': 'req-f61f8494-8326-406c-b491-ba22f7e094b6'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:37.117159 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-f61f8494-8326-406c-b491-ba22f7e094b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f7a1ff44e2a455ba4260b74ae06b50c', 'request_id': 'req-f61f8494-8326-406c-b491-ba22f7e094b6'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:37.132905 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-f61f8494-8326-406c-b491-ba22f7e094b6 admin admin] The token cache is being invalidate because project 9f7a1ff44e2a455ba4260b74ae06b50c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:19:37.133276 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-f61f8494-8326-406c-b491-ba22f7e094b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:37.135007 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-f61f8494-8326-406c-b491-ba22f7e094b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:37.144465 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1107/2229] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:19:36 2022] DELETE /identity/v3/projects/9f7a1ff44e2a455ba4260b74ae06b50c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:19:37.150479 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ba74e-ad73-454b-bc79-1a16c6aab2cc None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:37.150994 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ba74e-ad73-454b-bc79-1a16c6aab2cc None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:37.151472 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ba74e-ad73-454b-bc79-1a16c6aab2cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:37.176748 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-594ba74e-ad73-454b-bc79-1a16c6aab2cc None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:19:37.178195 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-594ba74e-ad73-454b-bc79-1a16c6aab2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:19:37.204686 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:19:37.252021 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1123/2230] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:19:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:19:37.260791 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7608cbc-c080-4a27-bc2f-431c4014350b None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:37.261082 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7608cbc-c080-4a27-bc2f-431c4014350b None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:37.261362 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7608cbc-c080-4a27-bc2f-431c4014350b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:37.281895 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-c7608cbc-c080-4a27-bc2f-431c4014350b None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:19:37.283533 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-c7608cbc-c080-4a27-bc2f-431c4014350b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:19:37.292105 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1108/2231] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:19:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:19:37.296351 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ba74e-ad73-454b-bc79-1a16c6aab2cc None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:19:37.306797 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ba74e-ad73-454b-bc79-1a16c6aab2cc None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:19:37.311536 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56982bf-0ef3-4686-bce5-44f65fd63646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:19:37.312212 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56982bf-0ef3-4686-bce5-44f65fd63646 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:37.312500 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56982bf-0ef3-4686-bce5-44f65fd63646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:37.312821 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56982bf-0ef3-4686-bce5-44f65fd63646 admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:37.313635 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56982bf-0ef3-4686-bce5-44f65fd63646 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:19:37.313948 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56982bf-0ef3-4686-bce5-44f65fd63646 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:19:37.315600 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56982bf-0ef3-4686-bce5-44f65fd63646 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:19:37.332435 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1124/2232] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:19:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:19:37.334652 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7608cbc-c080-4a27-bc2f-431c4014350b None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:19:37.355739 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7608cbc-c080-4a27-bc2f-431c4014350b None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:19:37.361001 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc952b57-3762-4bd5-897a-a81ba63edd8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:19:37.361669 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc952b57-3762-4bd5-897a-a81ba63edd8d admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:37.361948 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc952b57-3762-4bd5-897a-a81ba63edd8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:37.362224 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc952b57-3762-4bd5-897a-a81ba63edd8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:37.362932 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc952b57-3762-4bd5-897a-a81ba63edd8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:19:37.364869 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc952b57-3762-4bd5-897a-a81ba63edd8d admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:19:37.380462 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:19:37.408054 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1109/2233] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:19:37 2022] POST /identity/v3/projects => generated 405 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:19:37.412078 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56982bf-0ef3-4686-bce5-44f65fd63646 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:19:37.424162 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56982bf-0ef3-4686-bce5-44f65fd63646 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:19:37.490169 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e103390-02cc-4018-83a7-eb22f68f1a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:19:37.490848 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e103390-02cc-4018-83a7-eb22f68f1a79 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:37.491133 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e103390-02cc-4018-83a7-eb22f68f1a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:37.491412 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e103390-02cc-4018-83a7-eb22f68f1a79 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:37.492111 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e103390-02cc-4018-83a7-eb22f68f1a79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:19:37.494486 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e103390-02cc-4018-83a7-eb22f68f1a79 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:19:37.517814 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1125/2234] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:19:37 2022] POST /identity/v3/users => generated 303 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:19:37.519442 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc952b57-3762-4bd5-897a-a81ba63edd8d admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:19:37.531316 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc952b57-3762-4bd5-897a-a81ba63edd8d admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:19:37.536161 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ebc50e-e0ee-495a-b43d-a4cd9e9260eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:19:37.536964 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ebc50e-e0ee-495a-b43d-a4cd9e9260eb admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:37.537256 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ebc50e-e0ee-495a-b43d-a4cd9e9260eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:37.537536 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ebc50e-e0ee-495a-b43d-a4cd9e9260eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:37.538275 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ebc50e-e0ee-495a-b43d-a4cd9e9260eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:19:37.540679 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ebc50e-e0ee-495a-b43d-a4cd9e9260eb admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:19:37.551661 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1110/2235] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:19:37.556381 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e103390-02cc-4018-83a7-eb22f68f1a79 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:19:37.566710 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e103390-02cc-4018-83a7-eb22f68f1a79 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:19:37.572064 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78db63-a566-4c28-94c3-97c91d0c2ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:19:37.572738 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78db63-a566-4c28-94c3-97c91d0c2ab4 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:37.573032 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78db63-a566-4c28-94c3-97c91d0c2ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:37.573311 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78db63-a566-4c28-94c3-97c91d0c2ab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:37.574053 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab78db63-a566-4c28-94c3-97c91d0c2ab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:19:37.575696 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab78db63-a566-4c28-94c3-97c91d0c2ab4 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:19:37.587669 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1126/2236] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:19:37.591956 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ebc50e-e0ee-495a-b43d-a4cd9e9260eb admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:19:37.602076 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ebc50e-e0ee-495a-b43d-a4cd9e9260eb admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:19:37.607720 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9a44a4-b443-458b-a7a3-8ea6040e4e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:19:37.608605 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a44a4-b443-458b-a7a3-8ea6040e4e1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:37.608920 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a44a4-b443-458b-a7a3-8ea6040e4e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:37.609201 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a44a4-b443-458b-a7a3-8ea6040e4e1e admin admin] PATH_INFO: `/v3/projects/a1f560aef37246c78224620e76581090/users/cb8139eccd7e42989b4d3b859be9237d/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:37.624445 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9a44a4-b443-458b-a7a3-8ea6040e4e1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1f560aef37246c78224620e76581090, user_id=cb8139eccd7e42989b4d3b859be9237d, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:19:37.627136 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9a44a4-b443-458b-a7a3-8ea6040e4e1e admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:19:37.640464 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1111/2237] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:19:37 2022] PUT /identity/v3/projects/a1f560aef37246c78224620e76581090/users/cb8139eccd7e42989b4d3b859be9237d/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:19:37.646029 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff87b6-76a3-4f03-b923-ba577e09794d None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:37.646441 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff87b6-76a3-4f03-b923-ba577e09794d None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:37.646870 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff87b6-76a3-4f03-b923-ba577e09794d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:37.667116 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-8aff87b6-76a3-4f03-b923-ba577e09794d None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:19:37.668831 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-8aff87b6-76a3-4f03-b923-ba577e09794d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:19:37.738447 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1127/2238] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:19:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:19:37.750476 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9a44a4-b443-458b-a7a3-8ea6040e4e1e admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:19:37.752250 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-0d9a44a4-b443-458b-a7a3-8ea6040e4e1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:19:37.812552 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9a44a4-b443-458b-a7a3-8ea6040e4e1e admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:19:37.816212 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4ac74-9443-4d02-a171-ef6e1cfbb596 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:19:37.816965 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4ac74-9443-4d02-a171-ef6e1cfbb596 service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:37.817257 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4ac74-9443-4d02-a171-ef6e1cfbb596 service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:37.817537 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4ac74-9443-4d02-a171-ef6e1cfbb596 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:37.827875 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff4ac74-9443-4d02-a171-ef6e1cfbb596 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:19:37.829369 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff4ac74-9443-4d02-a171-ef6e1cfbb596 service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:19:37.841020 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1112/2239] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:19:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:19:38.577338 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d2336-fd36-4d78-9de9-d2075d8f0190 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:38.577696 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d2336-fd36-4d78-9de9-d2075d8f0190 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:38.577933 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d2336-fd36-4d78-9de9-d2075d8f0190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:38.623903 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-bc6d2336-fd36-4d78-9de9-d2075d8f0190 None None] MFA Rules not processed for user `cb8139eccd7e42989b4d3b859be9237d`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:19:38.625201 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-bc6d2336-fd36-4d78-9de9-d2075d8f0190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:19:38.660752 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:19:38.740292 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1128/2240] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:19:38 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:19:38.746337 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4ac74-9443-4d02-a171-ef6e1cfbb596 service neutron] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:19:38.760227 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4ac74-9443-4d02-a171-ef6e1cfbb596 service neutron] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:19:38.766870 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c94c5d-d329-43cd-abb0-8ed91986de35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:19:38.768200 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c94c5d-d329-43cd-abb0-8ed91986de35 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:38.768556 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c94c5d-d329-43cd-abb0-8ed91986de35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:38.768951 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c94c5d-d329-43cd-abb0-8ed91986de35 admin admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:38.769775 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c94c5d-d329-43cd-abb0-8ed91986de35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:19:38.771916 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c94c5d-d329-43cd-abb0-8ed91986de35 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:19:38.811344 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1113/2241] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:19:38 2022] POST /identity/v3/projects => generated 405 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:19:38.817947 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d2336-fd36-4d78-9de9-d2075d8f0190 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:19:38.832525 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d2336-fd36-4d78-9de9-d2075d8f0190 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:19:38.894151 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1913b3e4-1a11-446f-beea-2c990a50e49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:19:38.894847 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913b3e4-1a11-446f-beea-2c990a50e49b admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:38.895140 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913b3e4-1a11-446f-beea-2c990a50e49b admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:38.895417 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913b3e4-1a11-446f-beea-2c990a50e49b admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:38.896140 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1913b3e4-1a11-446f-beea-2c990a50e49b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:19:38.898163 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1913b3e4-1a11-446f-beea-2c990a50e49b admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:19:38.928486 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1129/2242] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:19:38 2022] POST /identity/v3/users => generated 309 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:19:38.929988 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c94c5d-d329-43cd-abb0-8ed91986de35 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:19:38.942301 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c94c5d-d329-43cd-abb0-8ed91986de35 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:19:38.948590 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67521b2b-cd20-48aa-a832-708f0ce7b917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:19:38.949400 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67521b2b-cd20-48aa-a832-708f0ce7b917 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:38.949931 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67521b2b-cd20-48aa-a832-708f0ce7b917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:38.950276 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67521b2b-cd20-48aa-a832-708f0ce7b917 admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:38.951088 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67521b2b-cd20-48aa-a832-708f0ce7b917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:19:38.952846 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67521b2b-cd20-48aa-a832-708f0ce7b917 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:19:38.967575 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1114/2243] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:19:38 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:19:38.972884 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1913b3e4-1a11-446f-beea-2c990a50e49b admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:19:38.989955 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1913b3e4-1a11-446f-beea-2c990a50e49b admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:19:38.996419 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77b5cf-a2e1-4afd-beef-1de4f8cf1fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:19:38.997386 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77b5cf-a2e1-4afd-beef-1de4f8cf1fe8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:38.997675 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77b5cf-a2e1-4afd-beef-1de4f8cf1fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:38.998012 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77b5cf-a2e1-4afd-beef-1de4f8cf1fe8 admin admin] PATH_INFO: `/v3/projects/26783b902cfe479cb9064379b7a8c6de/users/4fb25267b718437d94772075070e2ef8/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:39.027838 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e77b5cf-a2e1-4afd-beef-1de4f8cf1fe8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26783b902cfe479cb9064379b7a8c6de, user_id=4fb25267b718437d94772075070e2ef8, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:19:39.030576 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e77b5cf-a2e1-4afd-beef-1de4f8cf1fe8 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:19:39.055851 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1130/2244] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:19:38 2022] PUT /identity/v3/projects/26783b902cfe479cb9064379b7a8c6de/users/4fb25267b718437d94772075070e2ef8/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:19:39.060255 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67521b2b-cd20-48aa-a832-708f0ce7b917 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:19:39.083371 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67521b2b-cd20-48aa-a832-708f0ce7b917 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:19:39.159291 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43903d13-3cf2-4cf4-aaf6-09711d081ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:19:39.159966 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43903d13-3cf2-4cf4-aaf6-09711d081ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:39.160281 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43903d13-3cf2-4cf4-aaf6-09711d081ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:39.160559 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43903d13-3cf2-4cf4-aaf6-09711d081ac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:39.161367 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43903d13-3cf2-4cf4-aaf6-09711d081ac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:19:39.163427 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43903d13-3cf2-4cf4-aaf6-09711d081ac7 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:19:39.176810 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1115/2245] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:19:39.189052 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77b5cf-a2e1-4afd-beef-1de4f8cf1fe8 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:19:39.204193 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77b5cf-a2e1-4afd-beef-1de4f8cf1fe8 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:19:39.210745 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72142f88-fda0-4759-93d6-dee7246e5ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:19:39.211755 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72142f88-fda0-4759-93d6-dee7246e5ac9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:39.212050 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72142f88-fda0-4759-93d6-dee7246e5ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:39.212317 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72142f88-fda0-4759-93d6-dee7246e5ac9 admin admin] PATH_INFO: `/v3/projects/26783b902cfe479cb9064379b7a8c6de/users/4fb25267b718437d94772075070e2ef8/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:39.214597 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72142f88-fda0-4759-93d6-dee7246e5ac9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26783b902cfe479cb9064379b7a8c6de, user_id=4fb25267b718437d94772075070e2ef8, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:19:39.217402 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72142f88-fda0-4759-93d6-dee7246e5ac9 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:19:39.233312 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1131/2246] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:19:39 2022] PUT /identity/v3/projects/26783b902cfe479cb9064379b7a8c6de/users/4fb25267b718437d94772075070e2ef8/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:19:39.917791 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355f69f-3065-4b60-97b1-e912bf323818 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:39.919033 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355f69f-3065-4b60-97b1-e912bf323818 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:39.919529 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355f69f-3065-4b60-97b1-e912bf323818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:39.959951 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-6355f69f-3065-4b60-97b1-e912bf323818 None None] MFA Rules not processed for user `4fb25267b718437d94772075070e2ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:19:39.962155 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-6355f69f-3065-4b60-97b1-e912bf323818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:19:39.977871 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:19:40.069282 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1116/2247] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:19:39 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:19:41.564211 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72142f88-fda0-4759-93d6-dee7246e5ac9 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:19:41.637952 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72142f88-fda0-4759-93d6-dee7246e5ac9 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:19:41.642901 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd132f-a6eb-4d73-8dc9-305659ab4c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:19:41.643772 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd132f-a6eb-4d73-8dc9-305659ab4c1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:41.644056 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd132f-a6eb-4d73-8dc9-305659ab4c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:41.644334 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd132f-a6eb-4d73-8dc9-305659ab4c1f admin admin] PATH_INFO: `/v3/users/cb8139eccd7e42989b4d3b859be9237d` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:41.645610 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffd132f-a6eb-4d73-8dc9-305659ab4c1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb8139eccd7e42989b4d3b859be9237d)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:19:41.647564 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffd132f-a6eb-4d73-8dc9-305659ab4c1f admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:19:41.662838 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:19:41.707625 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-1ffd132f-a6eb-4d73-8dc9-305659ab4c1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb8139eccd7e42989b4d3b859be9237d'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:41.718896 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-1ffd132f-a6eb-4d73-8dc9-305659ab4c1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb8139eccd7e42989b4d3b859be9237d'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:41.726647 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-1ffd132f-a6eb-4d73-8dc9-305659ab4c1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb8139eccd7e42989b4d3b859be9237d'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:41.744566 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-1ffd132f-a6eb-4d73-8dc9-305659ab4c1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb8139eccd7e42989b4d3b859be9237d'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:41.745181 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-1ffd132f-a6eb-4d73-8dc9-305659ab4c1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb8139eccd7e42989b4d3b859be9237d'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:41.752685 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1132/2248] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:19:41 2022] DELETE /identity/v3/users/cb8139eccd7e42989b4d3b859be9237d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:19:42.008720 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6355f69f-3065-4b60-97b1-e912bf323818 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:19:42.022788 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6355f69f-3065-4b60-97b1-e912bf323818 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:19:42.088653 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a736c697-afea-47f8-b3d8-32d783c49729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:19:42.090177 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736c697-afea-47f8-b3d8-32d783c49729 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:42.090466 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736c697-afea-47f8-b3d8-32d783c49729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:42.090748 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736c697-afea-47f8-b3d8-32d783c49729 admin admin] PATH_INFO: `/v3/projects/a1f560aef37246c78224620e76581090` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:42.091969 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a736c697-afea-47f8-b3d8-32d783c49729 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1f560aef37246c78224620e76581090)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:19:42.093924 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a736c697-afea-47f8-b3d8-32d783c49729 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:19:42.101052 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052cb75-4ed0-4201-8020-933d04ebdb74 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:42.101344 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052cb75-4ed0-4201-8020-933d04ebdb74 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:42.101627 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052cb75-4ed0-4201-8020-933d04ebdb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:42.119931 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-3052cb75-4ed0-4201-8020-933d04ebdb74 None None] MFA Rules not processed for user `b511b8f2ba394fa9b276f76a52247184`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:19:42.121114 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-3052cb75-4ed0-4201-8020-933d04ebdb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:19:42.145795 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-a736c697-afea-47f8-b3d8-32d783c49729 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1f560aef37246c78224620e76581090', 'request_id': 'req-a736c697-afea-47f8-b3d8-32d783c49729'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:42.155003 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-a736c697-afea-47f8-b3d8-32d783c49729 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1f560aef37246c78224620e76581090', 'request_id': 'req-a736c697-afea-47f8-b3d8-32d783c49729'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:42.161265 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-a736c697-afea-47f8-b3d8-32d783c49729 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1f560aef37246c78224620e76581090', 'request_id': 'req-a736c697-afea-47f8-b3d8-32d783c49729'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:42.175134 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-a736c697-afea-47f8-b3d8-32d783c49729 admin admin] The token cache is being invalidate because project a1f560aef37246c78224620e76581090 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:19:42.175429 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-a736c697-afea-47f8-b3d8-32d783c49729 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:42.176105 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-a736c697-afea-47f8-b3d8-32d783c49729 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:42.177718 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1117/2249] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:19:42 2022] DELETE /identity/v3/projects/a1f560aef37246c78224620e76581090 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:19:42.182108 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a736c697-afea-47f8-b3d8-32d783c49729 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:19:42.182955 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1133/2250] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:19:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:19:42.187314 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-a736c697-afea-47f8-b3d8-32d783c49729 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:19:42.218043 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:19:42.252172 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a736c697-afea-47f8-b3d8-32d783c49729 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:19:42.256878 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4adc0e9-8e20-4261-838f-ffdb97cc4db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:19:42.257749 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4adc0e9-8e20-4261-838f-ffdb97cc4db2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:42.258029 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4adc0e9-8e20-4261-838f-ffdb97cc4db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:42.258820 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4adc0e9-8e20-4261-838f-ffdb97cc4db2 admin admin] PATH_INFO: `/v3/users/4fb25267b718437d94772075070e2ef8` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:42.260259 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4adc0e9-8e20-4261-838f-ffdb97cc4db2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fb25267b718437d94772075070e2ef8)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:19:42.262222 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4adc0e9-8e20-4261-838f-ffdb97cc4db2 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:19:42.315544 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-b4adc0e9-8e20-4261-838f-ffdb97cc4db2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fb25267b718437d94772075070e2ef8'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:42.323930 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-b4adc0e9-8e20-4261-838f-ffdb97cc4db2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fb25267b718437d94772075070e2ef8'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:42.324560 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-b4adc0e9-8e20-4261-838f-ffdb97cc4db2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fb25267b718437d94772075070e2ef8'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:42.325234 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-b4adc0e9-8e20-4261-838f-ffdb97cc4db2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fb25267b718437d94772075070e2ef8'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:42.338832 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-b4adc0e9-8e20-4261-838f-ffdb97cc4db2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fb25267b718437d94772075070e2ef8'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:42.351637 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1118/2251] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:19:42 2022] DELETE /identity/v3/users/4fb25267b718437d94772075070e2ef8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:19:42.532253 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3052cb75-4ed0-4201-8020-933d04ebdb74 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:19:42.550127 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3052cb75-4ed0-4201-8020-933d04ebdb74 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:19:42.614405 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6be6f2-be5f-48fe-b502-00cbd8141ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:19:42.615365 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6be6f2-be5f-48fe-b502-00cbd8141ac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:42.615654 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6be6f2-be5f-48fe-b502-00cbd8141ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:42.615930 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6be6f2-be5f-48fe-b502-00cbd8141ac4 admin admin] PATH_INFO: `/v3/projects/26783b902cfe479cb9064379b7a8c6de` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:42.617243 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6be6f2-be5f-48fe-b502-00cbd8141ac4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26783b902cfe479cb9064379b7a8c6de)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:19:42.619442 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6be6f2-be5f-48fe-b502-00cbd8141ac4 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:19:42.659848 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:19:42.669648 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-dc6be6f2-be5f-48fe-b502-00cbd8141ac4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26783b902cfe479cb9064379b7a8c6de', 'request_id': 'req-dc6be6f2-be5f-48fe-b502-00cbd8141ac4'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:42.675503 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-dc6be6f2-be5f-48fe-b502-00cbd8141ac4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26783b902cfe479cb9064379b7a8c6de', 'request_id': 'req-dc6be6f2-be5f-48fe-b502-00cbd8141ac4'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:42.684019 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-dc6be6f2-be5f-48fe-b502-00cbd8141ac4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26783b902cfe479cb9064379b7a8c6de', 'request_id': 'req-dc6be6f2-be5f-48fe-b502-00cbd8141ac4'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:42.696396 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-dc6be6f2-be5f-48fe-b502-00cbd8141ac4 admin admin] The token cache is being invalidate because project 26783b902cfe479cb9064379b7a8c6de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:19:42.696805 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-dc6be6f2-be5f-48fe-b502-00cbd8141ac4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:42.697390 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-dc6be6f2-be5f-48fe-b502-00cbd8141ac4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:42.698937 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1134/2252] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:19:42 2022] DELETE /identity/v3/projects/26783b902cfe479cb9064379b7a8c6de => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:19:42.703861 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac338df-2021-41ba-a340-786b04d006ac None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:42.704394 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac338df-2021-41ba-a340-786b04d006ac None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:42.704916 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac338df-2021-41ba-a340-786b04d006ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:42.724161 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-4ac338df-2021-41ba-a340-786b04d006ac None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:19:42.725390 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-4ac338df-2021-41ba-a340-786b04d006ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:19:42.795893 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1119/2253] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:19:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:19:42.798316 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800a2bb-e155-442e-a6b1-1ffc5a27e6f3 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:42.798605 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800a2bb-e155-442e-a6b1-1ffc5a27e6f3 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:42.799065 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800a2bb-e155-442e-a6b1-1ffc5a27e6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:42.835648 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-8800a2bb-e155-442e-a6b1-1ffc5a27e6f3 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:19:42.837011 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-8800a2bb-e155-442e-a6b1-1ffc5a27e6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:19:42.852102 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1135/2254] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:19:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:19:42.856596 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac338df-2021-41ba-a340-786b04d006ac None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:19:42.868237 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac338df-2021-41ba-a340-786b04d006ac None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:19:42.873217 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1bc7a-bac1-4b56-bbe9-f275710aeb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:19:42.874034 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1bc7a-bac1-4b56-bbe9-f275710aeb52 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:42.874318 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1bc7a-bac1-4b56-bbe9-f275710aeb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:42.874661 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1bc7a-bac1-4b56-bbe9-f275710aeb52 admin admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:42.875386 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e1bc7a-bac1-4b56-bbe9-f275710aeb52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:19:42.875691 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e1bc7a-bac1-4b56-bbe9-f275710aeb52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:19:42.877403 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e1bc7a-bac1-4b56-bbe9-f275710aeb52 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:19:42.892746 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1120/2255] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:19:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:19:42.895358 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8800a2bb-e155-442e-a6b1-1ffc5a27e6f3 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:19:42.906032 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8800a2bb-e155-442e-a6b1-1ffc5a27e6f3 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:19:42.910947 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac71623-7e99-4383-b18f-043515af0b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:19:42.911609 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac71623-7e99-4383-b18f-043515af0b87 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:42.911895 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac71623-7e99-4383-b18f-043515af0b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:42.912177 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac71623-7e99-4383-b18f-043515af0b87 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:42.912927 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac71623-7e99-4383-b18f-043515af0b87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:19:42.915652 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac71623-7e99-4383-b18f-043515af0b87 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:19:42.945753 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1136/2256] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:19:42 2022] POST /identity/v3/projects => generated 357 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:19:42.950793 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1bc7a-bac1-4b56-bbe9-f275710aeb52 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:19:42.962676 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1bc7a-bac1-4b56-bbe9-f275710aeb52 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:19:43.006543 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:19:43.036379 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f287539-488e-4106-a7fa-065f32375196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:19:43.038049 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f287539-488e-4106-a7fa-065f32375196 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:43.038332 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f287539-488e-4106-a7fa-065f32375196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:43.038628 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f287539-488e-4106-a7fa-065f32375196 admin admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:43.039293 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f287539-488e-4106-a7fa-065f32375196 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:19:43.042029 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f287539-488e-4106-a7fa-065f32375196 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:19:43.066794 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1121/2257] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:19:42 2022] POST /identity/v3/users => generated 279 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:19:43.071005 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac71623-7e99-4383-b18f-043515af0b87 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:19:43.084566 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac71623-7e99-4383-b18f-043515af0b87 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:19:43.089947 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb9b83-04b5-40d1-b690-ed7c3f4854a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:19:43.090617 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb9b83-04b5-40d1-b690-ed7c3f4854a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:43.090898 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb9b83-04b5-40d1-b690-ed7c3f4854a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:43.091169 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb9b83-04b5-40d1-b690-ed7c3f4854a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:43.091932 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abb9b83-04b5-40d1-b690-ed7c3f4854a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:19:43.093678 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abb9b83-04b5-40d1-b690-ed7c3f4854a2 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:19:43.105556 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1137/2258] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:19:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:19:43.109906 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f287539-488e-4106-a7fa-065f32375196 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:19:43.121404 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f287539-488e-4106-a7fa-065f32375196 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:19:43.127425 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da842ce5-b674-4fd3-a3d5-bbd4b2d7ea0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:19:43.128079 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da842ce5-b674-4fd3-a3d5-bbd4b2d7ea0d admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:43.128359 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da842ce5-b674-4fd3-a3d5-bbd4b2d7ea0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:43.128631 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da842ce5-b674-4fd3-a3d5-bbd4b2d7ea0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:43.129384 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da842ce5-b674-4fd3-a3d5-bbd4b2d7ea0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:19:43.130970 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da842ce5-b674-4fd3-a3d5-bbd4b2d7ea0d admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:19:43.143876 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1122/2259] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:19:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:19:43.148046 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb9b83-04b5-40d1-b690-ed7c3f4854a2 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:19:43.158395 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb9b83-04b5-40d1-b690-ed7c3f4854a2 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:19:43.163898 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66712568-1845-4bd7-a553-390c8e17156c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:19:43.165497 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66712568-1845-4bd7-a553-390c8e17156c admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:43.165921 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66712568-1845-4bd7-a553-390c8e17156c admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:43.166298 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66712568-1845-4bd7-a553-390c8e17156c admin admin] PATH_INFO: `/v3/projects/bbc3bca8101540718f1ea96e72b0a4a9/users/fb7e2b7ba7114bee9a4fd284b9b3fc33/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:43.183183 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66712568-1845-4bd7-a553-390c8e17156c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbc3bca8101540718f1ea96e72b0a4a9, user_id=fb7e2b7ba7114bee9a4fd284b9b3fc33, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:19:43.185895 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66712568-1845-4bd7-a553-390c8e17156c admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:19:43.199251 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1138/2260] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:19:43 2022] PUT /identity/v3/projects/bbc3bca8101540718f1ea96e72b0a4a9/users/fb7e2b7ba7114bee9a4fd284b9b3fc33/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:19:43.210478 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c06bf-ee11-464c-84d9-33a132d19da0 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:43.210842 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c06bf-ee11-464c-84d9-33a132d19da0 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:43.211126 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c06bf-ee11-464c-84d9-33a132d19da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:43.238255 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-e15c06bf-ee11-464c-84d9-33a132d19da0 None None] MFA Rules not processed for user `fb7e2b7ba7114bee9a4fd284b9b3fc33`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:19:43.239510 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-e15c06bf-ee11-464c-84d9-33a132d19da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:19:43.310189 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1123/2261] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:19:43 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:19:43.314578 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66712568-1845-4bd7-a553-390c8e17156c admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:19:43.381168 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66712568-1845-4bd7-a553-390c8e17156c admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:19:43.385944 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2dcf4f-72d4-4322-8e4b-64bf766fdb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:19:43.386612 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2dcf4f-72d4-4322-8e4b-64bf766fdb26 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:43.386898 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2dcf4f-72d4-4322-8e4b-64bf766fdb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:43.387179 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2dcf4f-72d4-4322-8e4b-64bf766fdb26 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:43.387886 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2dcf4f-72d4-4322-8e4b-64bf766fdb26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:19:43.389859 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2dcf4f-72d4-4322-8e4b-64bf766fdb26 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:19:43.419321 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1139/2262] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:19:43 2022] POST /identity/v3/projects => generated 355 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:19:43.423361 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15c06bf-ee11-464c-84d9-33a132d19da0 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:19:43.436355 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15c06bf-ee11-464c-84d9-33a132d19da0 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:19:43.500750 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fa4b81-177c-48d8-93f2-a9bafbb3a72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:19:43.501416 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa4b81-177c-48d8-93f2-a9bafbb3a72c admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:43.501697 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa4b81-177c-48d8-93f2-a9bafbb3a72c admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:43.501968 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa4b81-177c-48d8-93f2-a9bafbb3a72c admin admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:43.502662 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fa4b81-177c-48d8-93f2-a9bafbb3a72c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:19:43.504553 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fa4b81-177c-48d8-93f2-a9bafbb3a72c admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:19:43.526962 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1124/2263] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:19:43 2022] POST /identity/v3/users => generated 284 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:19:43.530937 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2dcf4f-72d4-4322-8e4b-64bf766fdb26 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:19:43.542430 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2dcf4f-72d4-4322-8e4b-64bf766fdb26 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:19:43.547024 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f331dd-bb40-4fed-a99e-cc1ca14597af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:19:43.547679 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f331dd-bb40-4fed-a99e-cc1ca14597af admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:43.547966 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f331dd-bb40-4fed-a99e-cc1ca14597af admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:43.548246 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f331dd-bb40-4fed-a99e-cc1ca14597af admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:43.549017 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f331dd-bb40-4fed-a99e-cc1ca14597af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:19:43.550614 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f331dd-bb40-4fed-a99e-cc1ca14597af admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:19:43.561712 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1140/2264] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:19:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:19:43.565877 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fa4b81-177c-48d8-93f2-a9bafbb3a72c admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:19:43.576532 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fa4b81-177c-48d8-93f2-a9bafbb3a72c admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:19:43.581210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f777030e-56a7-4248-ab8e-912a7af73cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:19:43.582139 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777030e-56a7-4248-ab8e-912a7af73cb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:43.582422 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777030e-56a7-4248-ab8e-912a7af73cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:43.582693 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777030e-56a7-4248-ab8e-912a7af73cb6 admin admin] PATH_INFO: `/v3/projects/9326069e21e54b9a9a46a05ee7ce51bf/users/6edad4fad90949288db345ba73928d83/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:43.598103 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f777030e-56a7-4248-ab8e-912a7af73cb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9326069e21e54b9a9a46a05ee7ce51bf, user_id=6edad4fad90949288db345ba73928d83, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:19:43.600811 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f777030e-56a7-4248-ab8e-912a7af73cb6 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:19:43.614275 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1125/2265] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:19:43 2022] PUT /identity/v3/projects/9326069e21e54b9a9a46a05ee7ce51bf/users/6edad4fad90949288db345ba73928d83/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:19:43.618933 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f331dd-bb40-4fed-a99e-cc1ca14597af admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:19:43.628966 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f331dd-bb40-4fed-a99e-cc1ca14597af admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:19:43.662265 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:19:43.688966 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795842fb-154a-4ea1-871f-ff54e7c89f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:19:43.689565 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795842fb-154a-4ea1-871f-ff54e7c89f86 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:43.689852 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795842fb-154a-4ea1-871f-ff54e7c89f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:43.690133 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795842fb-154a-4ea1-871f-ff54e7c89f86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:43.690860 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795842fb-154a-4ea1-871f-ff54e7c89f86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:19:43.692461 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795842fb-154a-4ea1-871f-ff54e7c89f86 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:19:43.703154 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1141/2266] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:19:43 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:19:43.707262 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f777030e-56a7-4248-ab8e-912a7af73cb6 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:19:43.718030 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f777030e-56a7-4248-ab8e-912a7af73cb6 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:19:43.722571 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f612d-74e1-47e2-9f70-5ffb2b7357d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:19:43.723450 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f612d-74e1-47e2-9f70-5ffb2b7357d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:43.723721 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f612d-74e1-47e2-9f70-5ffb2b7357d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:43.723993 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f612d-74e1-47e2-9f70-5ffb2b7357d6 admin admin] PATH_INFO: `/v3/projects/9326069e21e54b9a9a46a05ee7ce51bf/users/6edad4fad90949288db345ba73928d83/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:43.725995 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0f612d-74e1-47e2-9f70-5ffb2b7357d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9326069e21e54b9a9a46a05ee7ce51bf, user_id=6edad4fad90949288db345ba73928d83, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:19:43.729626 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0f612d-74e1-47e2-9f70-5ffb2b7357d6 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:19:43.735436 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:19:43.741301 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1126/2267] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:19:43 2022] PUT /identity/v3/projects/9326069e21e54b9a9a46a05ee7ce51bf/users/6edad4fad90949288db345ba73928d83/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:19:43.751626 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5eb06-5374-4690-9c2b-43848a991d2d None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:43.751999 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5eb06-5374-4690-9c2b-43848a991d2d None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:43.752281 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5eb06-5374-4690-9c2b-43848a991d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:43.780330 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-05d5eb06-5374-4690-9c2b-43848a991d2d None None] MFA Rules not processed for user `6edad4fad90949288db345ba73928d83`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:19:43.781629 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-05d5eb06-5374-4690-9c2b-43848a991d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:19:43.862545 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1142/2268] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:19:43 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:19:43.872264 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f612d-74e1-47e2-9f70-5ffb2b7357d6 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:19:43.874061 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-6d0f612d-74e1-47e2-9f70-5ffb2b7357d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:19:43.980723 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f612d-74e1-47e2-9f70-5ffb2b7357d6 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:19:43.986176 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc6c33-73df-4bcf-8f7d-a30310b53b1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:19:43.987815 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc6c33-73df-4bcf-8f7d-a30310b53b1e service cinder] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:43.988327 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc6c33-73df-4bcf-8f7d-a30310b53b1e service cinder] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:43.988805 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc6c33-73df-4bcf-8f7d-a30310b53b1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:44.007146 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcc6c33-73df-4bcf-8f7d-a30310b53b1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:19:44.007146 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcc6c33-73df-4bcf-8f7d-a30310b53b1e service cinder] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:19:44.019953 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1127/2269] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:19:43 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:19:44.113803 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d5eb06-5374-4690-9c2b-43848a991d2d None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:19:44.124168 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d5eb06-5374-4690-9c2b-43848a991d2d None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:19:44.128415 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f9078a-8fbc-4418-b0ee-82faa7e3e2ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:19:44.129103 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9078a-8fbc-4418-b0ee-82faa7e3e2ac service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:44.129386 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9078a-8fbc-4418-b0ee-82faa7e3e2ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:44.129663 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9078a-8fbc-4418-b0ee-82faa7e3e2ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:44.191603 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f9078a-8fbc-4418-b0ee-82faa7e3e2ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:19:44.193091 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f9078a-8fbc-4418-b0ee-82faa7e3e2ac service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:19:44.204481 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1143/2270] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:19:44 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:19:46.673248 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc6c33-73df-4bcf-8f7d-a30310b53b1e service cinder] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:19:46.674677 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-3bcc6c33-73df-4bcf-8f7d-a30310b53b1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:19:46.751771 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc6c33-73df-4bcf-8f7d-a30310b53b1e service cinder] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:19:46.757754 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b315d-7a19-4b2f-bf9d-109270ed7d8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cee106502e54829ad802ee41c9165fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:19:46.759460 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b315d-7a19-4b2f-bf9d-109270ed7d8a service nova] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:46.759750 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b315d-7a19-4b2f-bf9d-109270ed7d8a service nova] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:46.760085 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b315d-7a19-4b2f-bf9d-109270ed7d8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:46.761874 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-144b315d-7a19-4b2f-bf9d-109270ed7d8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:19:46.823330 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144b315d-7a19-4b2f-bf9d-109270ed7d8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:19:46.824967 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144b315d-7a19-4b2f-bf9d-109270ed7d8a service nova] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:19:46.834527 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1128/2271] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:19:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:19:54.199856 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=75 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:19:56.830068 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=83 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:19:59.228978 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f9078a-8fbc-4418-b0ee-82faa7e3e2ac service cinder] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:19:59.295706 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f9078a-8fbc-4418-b0ee-82faa7e3e2ac service cinder] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:19:59.300265 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e680f2f5-a158-4de1-b693-08bc13e78929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:19:59.301162 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e680f2f5-a158-4de1-b693-08bc13e78929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:59.301450 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e680f2f5-a158-4de1-b693-08bc13e78929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:59.301725 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e680f2f5-a158-4de1-b693-08bc13e78929 admin admin] PATH_INFO: `/v3/users/fb7e2b7ba7114bee9a4fd284b9b3fc33` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:59.302927 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e680f2f5-a158-4de1-b693-08bc13e78929 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb7e2b7ba7114bee9a4fd284b9b3fc33)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:19:59.304888 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e680f2f5-a158-4de1-b693-08bc13e78929 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:19:59.350573 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e680f2f5-a158-4de1-b693-08bc13e78929 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb7e2b7ba7114bee9a4fd284b9b3fc33'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:59.358428 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e680f2f5-a158-4de1-b693-08bc13e78929 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb7e2b7ba7114bee9a4fd284b9b3fc33'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:59.365384 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e680f2f5-a158-4de1-b693-08bc13e78929 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb7e2b7ba7114bee9a4fd284b9b3fc33'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:59.377244 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e680f2f5-a158-4de1-b693-08bc13e78929 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb7e2b7ba7114bee9a4fd284b9b3fc33'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:59.377867 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e680f2f5-a158-4de1-b693-08bc13e78929 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb7e2b7ba7114bee9a4fd284b9b3fc33'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:59.383613 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1144/2272] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:19:59 2022] DELETE /identity/v3/users/fb7e2b7ba7114bee9a4fd284b9b3fc33 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:19:59.388067 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e21a1-2a37-40c2-b114-cadfad7720a6 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:59.388531 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e21a1-2a37-40c2-b114-cadfad7720a6 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:59.388643 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e21a1-2a37-40c2-b114-cadfad7720a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:59.405786 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-5c1e21a1-2a37-40c2-b114-cadfad7720a6 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:19:59.406977 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-5c1e21a1-2a37-40c2-b114-cadfad7720a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:19:59.468949 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1129/2273] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:19:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:19:59.478340 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e680f2f5-a158-4de1-b693-08bc13e78929 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:19:59.479764 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-e680f2f5-a158-4de1-b693-08bc13e78929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:19:59.536660 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e680f2f5-a158-4de1-b693-08bc13e78929 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:19:59.540316 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493dac70-e8bb-4604-8500-d6fe6af5b5d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:19:59.540994 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493dac70-e8bb-4604-8500-d6fe6af5b5d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:59.541283 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493dac70-e8bb-4604-8500-d6fe6af5b5d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:59.541563 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493dac70-e8bb-4604-8500-d6fe6af5b5d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:59.550623 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493dac70-e8bb-4604-8500-d6fe6af5b5d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:19:59.552073 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493dac70-e8bb-4604-8500-d6fe6af5b5d3 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:19:59.561527 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1145/2274] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:19:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:19:59.824514 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e21a1-2a37-40c2-b114-cadfad7720a6 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:19:59.825988 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-5c1e21a1-2a37-40c2-b114-cadfad7720a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:19:59.843494 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e21a1-2a37-40c2-b114-cadfad7720a6 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:19:59.848285 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7536a58-c5b1-4dc6-a8f1-16f79203044f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:19:59.849189 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7536a58-c5b1-4dc6-a8f1-16f79203044f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:59.849474 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7536a58-c5b1-4dc6-a8f1-16f79203044f admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:59.849752 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7536a58-c5b1-4dc6-a8f1-16f79203044f admin admin] PATH_INFO: `/v3/projects/bbc3bca8101540718f1ea96e72b0a4a9` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:59.851018 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7536a58-c5b1-4dc6-a8f1-16f79203044f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbc3bca8101540718f1ea96e72b0a4a9)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:19:59.852988 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7536a58-c5b1-4dc6-a8f1-16f79203044f admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:19:59.901719 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-f7536a58-c5b1-4dc6-a8f1-16f79203044f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbc3bca8101540718f1ea96e72b0a4a9', 'request_id': 'req-f7536a58-c5b1-4dc6-a8f1-16f79203044f'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:59.909148 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-f7536a58-c5b1-4dc6-a8f1-16f79203044f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbc3bca8101540718f1ea96e72b0a4a9', 'request_id': 'req-f7536a58-c5b1-4dc6-a8f1-16f79203044f'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:59.914805 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-f7536a58-c5b1-4dc6-a8f1-16f79203044f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbc3bca8101540718f1ea96e72b0a4a9', 'request_id': 'req-f7536a58-c5b1-4dc6-a8f1-16f79203044f'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:59.925737 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-f7536a58-c5b1-4dc6-a8f1-16f79203044f admin admin] The token cache is being invalidate because project bbc3bca8101540718f1ea96e72b0a4a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:19:59.926018 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-f7536a58-c5b1-4dc6-a8f1-16f79203044f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:59.926739 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-f7536a58-c5b1-4dc6-a8f1-16f79203044f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:59.928258 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1130/2275] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:19:59 2022] DELETE /identity/v3/projects/bbc3bca8101540718f1ea96e72b0a4a9 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:19:59.932177 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493dac70-e8bb-4604-8500-d6fe6af5b5d3 service neutron] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:19:59.943104 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493dac70-e8bb-4604-8500-d6fe6af5b5d3 service neutron] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:19:59.962216 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:00.000921 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0713465b-0b6c-4169-8cbc-7111bf1c0205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:00.001717 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713465b-0b6c-4169-8cbc-7111bf1c0205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:00.001998 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713465b-0b6c-4169-8cbc-7111bf1c0205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:00.002273 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713465b-0b6c-4169-8cbc-7111bf1c0205 admin admin] PATH_INFO: `/v3/users/6edad4fad90949288db345ba73928d83` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:00.003445 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0713465b-0b6c-4169-8cbc-7111bf1c0205 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6edad4fad90949288db345ba73928d83)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:00.005385 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0713465b-0b6c-4169-8cbc-7111bf1c0205 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:00.050273 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-0713465b-0b6c-4169-8cbc-7111bf1c0205 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6edad4fad90949288db345ba73928d83'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:00.058580 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-0713465b-0b6c-4169-8cbc-7111bf1c0205 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6edad4fad90949288db345ba73928d83'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:00.065759 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-0713465b-0b6c-4169-8cbc-7111bf1c0205 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6edad4fad90949288db345ba73928d83'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:00.078741 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-0713465b-0b6c-4169-8cbc-7111bf1c0205 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6edad4fad90949288db345ba73928d83'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:00.079416 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-0713465b-0b6c-4169-8cbc-7111bf1c0205 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6edad4fad90949288db345ba73928d83'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:00.085377 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1146/2276] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:19:59 2022] DELETE /identity/v3/users/6edad4fad90949288db345ba73928d83 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:20:00.356491 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7536a58-c5b1-4dc6-a8f1-16f79203044f admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:00.358146 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-f7536a58-c5b1-4dc6-a8f1-16f79203044f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:00.372667 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7536a58-c5b1-4dc6-a8f1-16f79203044f admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:00.430043 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe37872d-b146-420b-a813-900add14d749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:00.430893 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37872d-b146-420b-a813-900add14d749 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:00.431175 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37872d-b146-420b-a813-900add14d749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:00.431443 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37872d-b146-420b-a813-900add14d749 admin admin] PATH_INFO: `/v3/projects/9326069e21e54b9a9a46a05ee7ce51bf` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:00.433430 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe37872d-b146-420b-a813-900add14d749 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9326069e21e54b9a9a46a05ee7ce51bf)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:00.435390 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe37872d-b146-420b-a813-900add14d749 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:00.465386 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:00.483346 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-fe37872d-b146-420b-a813-900add14d749 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9326069e21e54b9a9a46a05ee7ce51bf', 'request_id': 'req-fe37872d-b146-420b-a813-900add14d749'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:00.490451 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-fe37872d-b146-420b-a813-900add14d749 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9326069e21e54b9a9a46a05ee7ce51bf', 'request_id': 'req-fe37872d-b146-420b-a813-900add14d749'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:00.496614 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-fe37872d-b146-420b-a813-900add14d749 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9326069e21e54b9a9a46a05ee7ce51bf', 'request_id': 'req-fe37872d-b146-420b-a813-900add14d749'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:00.507441 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-fe37872d-b146-420b-a813-900add14d749 admin admin] The token cache is being invalidate because project 9326069e21e54b9a9a46a05ee7ce51bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:20:00.507749 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-fe37872d-b146-420b-a813-900add14d749 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:00.508402 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-fe37872d-b146-420b-a813-900add14d749 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:00.509945 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1131/2277] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:20:00 2022] DELETE /identity/v3/projects/9326069e21e54b9a9a46a05ee7ce51bf => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:00.515515 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716578e-f301-4fa9-b89d-1e8eb2329653 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:00.516020 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716578e-f301-4fa9-b89d-1e8eb2329653 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:00.516136 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716578e-f301-4fa9-b89d-1e8eb2329653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:00.533819 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-7716578e-f301-4fa9-b89d-1e8eb2329653 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:00.534941 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-7716578e-f301-4fa9-b89d-1e8eb2329653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:00.595396 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1147/2278] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:20:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:00.603248 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053525f-3da4-482f-9d55-e6a16ba7beff None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:00.603541 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053525f-3da4-482f-9d55-e6a16ba7beff None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:00.603819 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053525f-3da4-482f-9d55-e6a16ba7beff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:00.623833 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-d053525f-3da4-482f-9d55-e6a16ba7beff None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:00.625086 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-d053525f-3da4-482f-9d55-e6a16ba7beff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:00.633313 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1132/2279] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:20:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:00.638056 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7716578e-f301-4fa9-b89d-1e8eb2329653 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:00.647784 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7716578e-f301-4fa9-b89d-1e8eb2329653 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:00.652844 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d65531-5f53-4135-a0d0-996e98c80acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:00.653501 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d65531-5f53-4135-a0d0-996e98c80acd admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:00.653781 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d65531-5f53-4135-a0d0-996e98c80acd admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:00.654056 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d65531-5f53-4135-a0d0-996e98c80acd admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:00.654781 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d65531-5f53-4135-a0d0-996e98c80acd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:20:00.655087 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d65531-5f53-4135-a0d0-996e98c80acd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:00.656668 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d65531-5f53-4135-a0d0-996e98c80acd admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:00.668728 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1148/2280] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:20:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:20:00.672895 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053525f-3da4-482f-9d55-e6a16ba7beff None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:00.682040 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053525f-3da4-482f-9d55-e6a16ba7beff None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:00.686754 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdcd51d-8346-41ff-a769-513a60b61a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:00.687400 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdcd51d-8346-41ff-a769-513a60b61a10 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:00.687691 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdcd51d-8346-41ff-a769-513a60b61a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:00.687970 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdcd51d-8346-41ff-a769-513a60b61a10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:00.688667 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdcd51d-8346-41ff-a769-513a60b61a10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:00.690583 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdcd51d-8346-41ff-a769-513a60b61a10 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:00.716546 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1133/2281] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:20:00 2022] POST /identity/v3/projects => generated 367 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:20:00.720552 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d65531-5f53-4135-a0d0-996e98c80acd admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:00.731521 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d65531-5f53-4135-a0d0-996e98c80acd admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:00.756363 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:00.787976 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8596645-24fc-42ea-baa5-88f07c60de96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:00.788574 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8596645-24fc-42ea-baa5-88f07c60de96 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:00.788903 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8596645-24fc-42ea-baa5-88f07c60de96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:00.789187 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8596645-24fc-42ea-baa5-88f07c60de96 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:00.789891 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8596645-24fc-42ea-baa5-88f07c60de96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:00.792464 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8596645-24fc-42ea-baa5-88f07c60de96 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:00.812931 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1149/2282] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:20:00 2022] POST /identity/v3/users => generated 284 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:20:00.817043 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdcd51d-8346-41ff-a769-513a60b61a10 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:00.827480 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdcd51d-8346-41ff-a769-513a60b61a10 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:00.832022 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91355d5c-410a-4567-9ae3-3e5f0e313ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:00.832676 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91355d5c-410a-4567-9ae3-3e5f0e313ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:00.832990 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91355d5c-410a-4567-9ae3-3e5f0e313ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:00.833264 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91355d5c-410a-4567-9ae3-3e5f0e313ed2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:00.833989 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91355d5c-410a-4567-9ae3-3e5f0e313ed2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:00.835575 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91355d5c-410a-4567-9ae3-3e5f0e313ed2 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:00.846377 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1134/2283] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:20:00.850300 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8596645-24fc-42ea-baa5-88f07c60de96 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:00.861266 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8596645-24fc-42ea-baa5-88f07c60de96 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:00.865889 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38976c33-f72f-4181-a00e-7dcfb36864f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:00.866534 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38976c33-f72f-4181-a00e-7dcfb36864f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:00.866818 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38976c33-f72f-4181-a00e-7dcfb36864f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:00.867092 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38976c33-f72f-4181-a00e-7dcfb36864f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:00.867816 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38976c33-f72f-4181-a00e-7dcfb36864f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:00.869444 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38976c33-f72f-4181-a00e-7dcfb36864f4 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:00.879227 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1150/2284] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:20:00.883187 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91355d5c-410a-4567-9ae3-3e5f0e313ed2 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:00.893301 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91355d5c-410a-4567-9ae3-3e5f0e313ed2 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:00.897978 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19a90a-be9a-4b76-aea5-b9fa297ff883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:00.898842 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19a90a-be9a-4b76-aea5-b9fa297ff883 admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:00.899124 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19a90a-be9a-4b76-aea5-b9fa297ff883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:00.899394 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19a90a-be9a-4b76-aea5-b9fa297ff883 admin admin] PATH_INFO: `/v3/projects/a9710e26fba24bba9f6d47b895574808/users/ffc9923bd3cc443cb5943cd6b6984de1/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:00.914138 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19a90a-be9a-4b76-aea5-b9fa297ff883 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9710e26fba24bba9f6d47b895574808, user_id=ffc9923bd3cc443cb5943cd6b6984de1, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:00.917460 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19a90a-be9a-4b76-aea5-b9fa297ff883 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:00.930475 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1135/2285] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:20:00 2022] PUT /identity/v3/projects/a9710e26fba24bba9f6d47b895574808/users/ffc9923bd3cc443cb5943cd6b6984de1/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:00.942042 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11fcdcc-5f37-4f23-9c5a-e4d6158ceb74 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:00.942334 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11fcdcc-5f37-4f23-9c5a-e4d6158ceb74 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:00.942612 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11fcdcc-5f37-4f23-9c5a-e4d6158ceb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:00.970243 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-a11fcdcc-5f37-4f23-9c5a-e4d6158ceb74 None None] MFA Rules not processed for user `ffc9923bd3cc443cb5943cd6b6984de1`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:00.971449 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-a11fcdcc-5f37-4f23-9c5a-e4d6158ceb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:01.034716 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1151/2286] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:20:00 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:01.039189 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19a90a-be9a-4b76-aea5-b9fa297ff883 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:01.099546 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19a90a-be9a-4b76-aea5-b9fa297ff883 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:01.104151 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cbf150-83b9-4d8a-9d7c-52e3ddc5545a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:01.104849 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbf150-83b9-4d8a-9d7c-52e3ddc5545a admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:01.105129 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbf150-83b9-4d8a-9d7c-52e3ddc5545a admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:01.105400 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbf150-83b9-4d8a-9d7c-52e3ddc5545a admin admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:01.106357 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cbf150-83b9-4d8a-9d7c-52e3ddc5545a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:01.108241 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cbf150-83b9-4d8a-9d7c-52e3ddc5545a admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:01.131934 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1136/2287] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:20:01 2022] POST /identity/v3/projects => generated 367 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:20:01.136524 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11fcdcc-5f37-4f23-9c5a-e4d6158ceb74 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:01.147197 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11fcdcc-5f37-4f23-9c5a-e4d6158ceb74 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:01.201659 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e49e939-69f6-491c-be92-5d0abefa80a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:01.202319 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49e939-69f6-491c-be92-5d0abefa80a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:01.202600 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49e939-69f6-491c-be92-5d0abefa80a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:01.202871 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49e939-69f6-491c-be92-5d0abefa80a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:01.203548 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e49e939-69f6-491c-be92-5d0abefa80a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:01.205475 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e49e939-69f6-491c-be92-5d0abefa80a5 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:01.224709 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1152/2288] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:20:01 2022] POST /identity/v3/users => generated 290 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:20:01.228618 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cbf150-83b9-4d8a-9d7c-52e3ddc5545a admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:01.239267 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cbf150-83b9-4d8a-9d7c-52e3ddc5545a admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:01.243827 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb392bf-093c-42b2-a0f6-9acdb50e5191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:01.244473 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb392bf-093c-42b2-a0f6-9acdb50e5191 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:01.244829 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb392bf-093c-42b2-a0f6-9acdb50e5191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:01.245204 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb392bf-093c-42b2-a0f6-9acdb50e5191 admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:01.246100 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb392bf-093c-42b2-a0f6-9acdb50e5191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:01.247675 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb392bf-093c-42b2-a0f6-9acdb50e5191 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:01.258110 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1137/2289] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:20:01.262703 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e49e939-69f6-491c-be92-5d0abefa80a5 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:01.272458 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e49e939-69f6-491c-be92-5d0abefa80a5 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:01.277803 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed82a776-4a50-4f63-aec4-4ca282849417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:01.278684 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82a776-4a50-4f63-aec4-4ca282849417 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:01.278972 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82a776-4a50-4f63-aec4-4ca282849417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:01.279245 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82a776-4a50-4f63-aec4-4ca282849417 admin admin] PATH_INFO: `/v3/projects/c31a1caed2bd441fa5be561031739635/users/25b4ec780e5b4eac853af8bb1dd55ef4/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:01.294337 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed82a776-4a50-4f63-aec4-4ca282849417 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c31a1caed2bd441fa5be561031739635, user_id=25b4ec780e5b4eac853af8bb1dd55ef4, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:01.296967 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed82a776-4a50-4f63-aec4-4ca282849417 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:01.309839 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1153/2290] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:20:01 2022] PUT /identity/v3/projects/c31a1caed2bd441fa5be561031739635/users/25b4ec780e5b4eac853af8bb1dd55ef4/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:01.313700 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb392bf-093c-42b2-a0f6-9acdb50e5191 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:01.324363 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb392bf-093c-42b2-a0f6-9acdb50e5191 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:01.344003 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:01.381681 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60ed79-96ad-4e8d-9112-18a6788b341b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:01.382347 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60ed79-96ad-4e8d-9112-18a6788b341b admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:01.382633 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60ed79-96ad-4e8d-9112-18a6788b341b admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:01.382907 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60ed79-96ad-4e8d-9112-18a6788b341b admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:01.383629 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a60ed79-96ad-4e8d-9112-18a6788b341b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:01.385239 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a60ed79-96ad-4e8d-9112-18a6788b341b admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:01.395409 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1138/2291] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:20:01.399728 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed82a776-4a50-4f63-aec4-4ca282849417 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:01.405797 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:01.412230 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed82a776-4a50-4f63-aec4-4ca282849417 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:01.417246 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de8340-e152-4495-aa4f-d2c38a1a2edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:01.418129 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de8340-e152-4495-aa4f-d2c38a1a2edc admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:01.418412 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de8340-e152-4495-aa4f-d2c38a1a2edc admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:01.418691 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de8340-e152-4495-aa4f-d2c38a1a2edc admin admin] PATH_INFO: `/v3/projects/c31a1caed2bd441fa5be561031739635/users/25b4ec780e5b4eac853af8bb1dd55ef4/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:01.420666 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7de8340-e152-4495-aa4f-d2c38a1a2edc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c31a1caed2bd441fa5be561031739635, user_id=25b4ec780e5b4eac853af8bb1dd55ef4, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:01.423417 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7de8340-e152-4495-aa4f-d2c38a1a2edc admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:01.434166 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1154/2292] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:20:01 2022] PUT /identity/v3/projects/c31a1caed2bd441fa5be561031739635/users/25b4ec780e5b4eac853af8bb1dd55ef4/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:01.444173 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e093e-d50f-45f5-83de-eb42d6559eb1 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:01.444648 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e093e-d50f-45f5-83de-eb42d6559eb1 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:01.444801 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e093e-d50f-45f5-83de-eb42d6559eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:01.471991 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-c17e093e-d50f-45f5-83de-eb42d6559eb1 None None] MFA Rules not processed for user `25b4ec780e5b4eac853af8bb1dd55ef4`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:01.473264 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-c17e093e-d50f-45f5-83de-eb42d6559eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:01.541014 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1139/2293] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:20:01 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:01.551954 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de8340-e152-4495-aa4f-d2c38a1a2edc admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:01.553646 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-f7de8340-e152-4495-aa4f-d2c38a1a2edc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:01.609454 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de8340-e152-4495-aa4f-d2c38a1a2edc admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:01.613061 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f75718d-785b-44c0-9c8a-b51d540faf32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:01.613690 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75718d-785b-44c0-9c8a-b51d540faf32 service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:01.613973 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75718d-785b-44c0-9c8a-b51d540faf32 service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:01.614249 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75718d-785b-44c0-9c8a-b51d540faf32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:01.623822 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f75718d-785b-44c0-9c8a-b51d540faf32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:01.625623 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f75718d-785b-44c0-9c8a-b51d540faf32 service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:01.635042 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1155/2294] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:20:01 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:20:02.930699 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e093e-d50f-45f5-83de-eb42d6559eb1 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:02.994105 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e093e-d50f-45f5-83de-eb42d6559eb1 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:02.999213 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aed4ce-7969-43a6-9e91-0f69c6751e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:03.000082 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aed4ce-7969-43a6-9e91-0f69c6751e85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:03.000366 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aed4ce-7969-43a6-9e91-0f69c6751e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:03.000645 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aed4ce-7969-43a6-9e91-0f69c6751e85 admin admin] PATH_INFO: `/v3/users/ffc9923bd3cc443cb5943cd6b6984de1` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:03.001886 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aed4ce-7969-43a6-9e91-0f69c6751e85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffc9923bd3cc443cb5943cd6b6984de1)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:03.003808 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aed4ce-7969-43a6-9e91-0f69c6751e85 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:03.050341 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-28aed4ce-7969-43a6-9e91-0f69c6751e85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffc9923bd3cc443cb5943cd6b6984de1'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:03.051975 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:03.058422 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-28aed4ce-7969-43a6-9e91-0f69c6751e85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffc9923bd3cc443cb5943cd6b6984de1'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:03.059823 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-28aed4ce-7969-43a6-9e91-0f69c6751e85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffc9923bd3cc443cb5943cd6b6984de1'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:03.060616 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-28aed4ce-7969-43a6-9e91-0f69c6751e85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffc9923bd3cc443cb5943cd6b6984de1'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:03.072818 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-28aed4ce-7969-43a6-9e91-0f69c6751e85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffc9923bd3cc443cb5943cd6b6984de1'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:03.085489 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1140/2295] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:20:02 2022] DELETE /identity/v3/users/ffc9923bd3cc443cb5943cd6b6984de1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:03.090038 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f626f7-a714-4528-a0d8-d2da3af04e92 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:03.090497 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f626f7-a714-4528-a0d8-d2da3af04e92 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:03.090612 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f626f7-a714-4528-a0d8-d2da3af04e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:03.108174 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-60f626f7-a714-4528-a0d8-d2da3af04e92 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:03.109330 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-60f626f7-a714-4528-a0d8-d2da3af04e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:03.166587 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1156/2296] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:20:03.177670 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aed4ce-7969-43a6-9e91-0f69c6751e85 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:03.179097 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-28aed4ce-7969-43a6-9e91-0f69c6751e85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:03.236871 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aed4ce-7969-43a6-9e91-0f69c6751e85 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:03.240444 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b840f-d78f-4c4e-949d-00dd9be8a39e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:03.241108 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b840f-d78f-4c4e-949d-00dd9be8a39e service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:03.241391 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b840f-d78f-4c4e-949d-00dd9be8a39e service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:03.241669 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b840f-d78f-4c4e-949d-00dd9be8a39e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:03.251195 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b840f-d78f-4c4e-949d-00dd9be8a39e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:03.252609 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b840f-d78f-4c4e-949d-00dd9be8a39e service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:03.262196 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1141/2297] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:20:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:20:03.531870 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f626f7-a714-4528-a0d8-d2da3af04e92 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:03.533330 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-60f626f7-a714-4528-a0d8-d2da3af04e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:03.546529 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f626f7-a714-4528-a0d8-d2da3af04e92 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:03.551256 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf979c3-e002-4819-814f-1973b550a14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:03.552120 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf979c3-e002-4819-814f-1973b550a14b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:03.552400 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf979c3-e002-4819-814f-1973b550a14b admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:03.552673 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf979c3-e002-4819-814f-1973b550a14b admin admin] PATH_INFO: `/v3/projects/a9710e26fba24bba9f6d47b895574808` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:03.553891 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf979c3-e002-4819-814f-1973b550a14b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9710e26fba24bba9f6d47b895574808)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:03.555802 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf979c3-e002-4819-814f-1973b550a14b admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:03.603601 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-ddf979c3-e002-4819-814f-1973b550a14b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9710e26fba24bba9f6d47b895574808', 'request_id': 'req-ddf979c3-e002-4819-814f-1973b550a14b'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:03.609587 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-ddf979c3-e002-4819-814f-1973b550a14b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9710e26fba24bba9f6d47b895574808', 'request_id': 'req-ddf979c3-e002-4819-814f-1973b550a14b'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:03.616338 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-ddf979c3-e002-4819-814f-1973b550a14b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9710e26fba24bba9f6d47b895574808', 'request_id': 'req-ddf979c3-e002-4819-814f-1973b550a14b'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:03.627067 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-ddf979c3-e002-4819-814f-1973b550a14b admin admin] The token cache is being invalidate because project a9710e26fba24bba9f6d47b895574808 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:20:03.627352 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-ddf979c3-e002-4819-814f-1973b550a14b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:03.627969 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-ddf979c3-e002-4819-814f-1973b550a14b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:03.629523 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1157/2298] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:20:03 2022] DELETE /identity/v3/projects/a9710e26fba24bba9f6d47b895574808 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:20:03.633485 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b840f-d78f-4c4e-949d-00dd9be8a39e service neutron] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:03.643040 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b840f-d78f-4c4e-949d-00dd9be8a39e service neutron] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:03.698355 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75104732-75c5-45dc-9fd4-118594531221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:03.699280 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75104732-75c5-45dc-9fd4-118594531221 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:03.699566 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75104732-75c5-45dc-9fd4-118594531221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:03.699845 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75104732-75c5-45dc-9fd4-118594531221 admin admin] PATH_INFO: `/v3/users/25b4ec780e5b4eac853af8bb1dd55ef4` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:03.701115 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75104732-75c5-45dc-9fd4-118594531221 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25b4ec780e5b4eac853af8bb1dd55ef4)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:03.703030 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75104732-75c5-45dc-9fd4-118594531221 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:03.748977 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-75104732-75c5-45dc-9fd4-118594531221 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25b4ec780e5b4eac853af8bb1dd55ef4'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:03.756580 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-75104732-75c5-45dc-9fd4-118594531221 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25b4ec780e5b4eac853af8bb1dd55ef4'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:03.757474 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-75104732-75c5-45dc-9fd4-118594531221 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25b4ec780e5b4eac853af8bb1dd55ef4'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:03.758290 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-75104732-75c5-45dc-9fd4-118594531221 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25b4ec780e5b4eac853af8bb1dd55ef4'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:03.769802 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:03.771149 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-75104732-75c5-45dc-9fd4-118594531221 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25b4ec780e5b4eac853af8bb1dd55ef4'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:03.786794 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1142/2299] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:20:03 2022] DELETE /identity/v3/users/25b4ec780e5b4eac853af8bb1dd55ef4 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:04.064614 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf979c3-e002-4819-814f-1973b550a14b admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:04.066072 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-ddf979c3-e002-4819-814f-1973b550a14b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:04.080770 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf979c3-e002-4819-814f-1973b550a14b admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:04.094515 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:04.143786 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2053a18b-bf35-4453-9306-8d1cbe74c288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:04.144655 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053a18b-bf35-4453-9306-8d1cbe74c288 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:04.144969 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053a18b-bf35-4453-9306-8d1cbe74c288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:04.145244 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053a18b-bf35-4453-9306-8d1cbe74c288 admin admin] PATH_INFO: `/v3/projects/c31a1caed2bd441fa5be561031739635` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:04.146451 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2053a18b-bf35-4453-9306-8d1cbe74c288 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c31a1caed2bd441fa5be561031739635)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:04.148359 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2053a18b-bf35-4453-9306-8d1cbe74c288 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:04.193844 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-2053a18b-bf35-4453-9306-8d1cbe74c288 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c31a1caed2bd441fa5be561031739635', 'request_id': 'req-2053a18b-bf35-4453-9306-8d1cbe74c288'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:04.200438 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-2053a18b-bf35-4453-9306-8d1cbe74c288 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c31a1caed2bd441fa5be561031739635', 'request_id': 'req-2053a18b-bf35-4453-9306-8d1cbe74c288'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:04.207598 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-2053a18b-bf35-4453-9306-8d1cbe74c288 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c31a1caed2bd441fa5be561031739635', 'request_id': 'req-2053a18b-bf35-4453-9306-8d1cbe74c288'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:04.219324 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-2053a18b-bf35-4453-9306-8d1cbe74c288 admin admin] The token cache is being invalidate because project c31a1caed2bd441fa5be561031739635 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:20:04.219614 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-2053a18b-bf35-4453-9306-8d1cbe74c288 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:04.220270 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-2053a18b-bf35-4453-9306-8d1cbe74c288 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:04.221846 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1158/2300] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:20:04 2022] DELETE /identity/v3/projects/c31a1caed2bd441fa5be561031739635 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:20:04.226816 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c79f9-ebdd-41fb-9df3-38b8d7046875 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:04.227314 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c79f9-ebdd-41fb-9df3-38b8d7046875 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:04.227423 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c79f9-ebdd-41fb-9df3-38b8d7046875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:04.245737 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-433c79f9-ebdd-41fb-9df3-38b8d7046875 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:04.247125 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-433c79f9-ebdd-41fb-9df3-38b8d7046875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:04.311846 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1143/2301] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:20:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:04.320550 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a0677-55ec-423c-9d3b-01e8645f6f05 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:04.320868 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a0677-55ec-423c-9d3b-01e8645f6f05 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:04.321144 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a0677-55ec-423c-9d3b-01e8645f6f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:04.341709 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-7d2a0677-55ec-423c-9d3b-01e8645f6f05 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:04.343165 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-7d2a0677-55ec-423c-9d3b-01e8645f6f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:04.351233 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1159/2302] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:20:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:04.355449 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c79f9-ebdd-41fb-9df3-38b8d7046875 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:04.365670 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c79f9-ebdd-41fb-9df3-38b8d7046875 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:04.370320 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b36818-598a-4499-908b-2180f4e3e5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:04.370972 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b36818-598a-4499-908b-2180f4e3e5cf admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:04.371770 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b36818-598a-4499-908b-2180f4e3e5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:04.372047 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b36818-598a-4499-908b-2180f4e3e5cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:04.372816 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b36818-598a-4499-908b-2180f4e3e5cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:20:04.373128 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b36818-598a-4499-908b-2180f4e3e5cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:04.374734 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b36818-598a-4499-908b-2180f4e3e5cf admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:04.386066 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1144/2303] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:20:04.391091 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a0677-55ec-423c-9d3b-01e8645f6f05 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:04.400354 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a0677-55ec-423c-9d3b-01e8645f6f05 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:04.405092 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f1d75-8258-407a-a32f-b95bc82666c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:04.405757 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f1d75-8258-407a-a32f-b95bc82666c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:04.406062 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f1d75-8258-407a-a32f-b95bc82666c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:04.406336 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f1d75-8258-407a-a32f-b95bc82666c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:04.407031 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f1d75-8258-407a-a32f-b95bc82666c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:04.409002 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f1d75-8258-407a-a32f-b95bc82666c6 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:04.434251 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1160/2304] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:20:04 2022] POST /identity/v3/projects => generated 369 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:20:04.438447 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b36818-598a-4499-908b-2180f4e3e5cf admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:04.448566 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b36818-598a-4499-908b-2180f4e3e5cf admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:04.505339 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c03f66-d422-4f82-a2a6-c65cdc4fb711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:04.505933 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c03f66-d422-4f82-a2a6-c65cdc4fb711 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:04.506261 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c03f66-d422-4f82-a2a6-c65cdc4fb711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:04.506536 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c03f66-d422-4f82-a2a6-c65cdc4fb711 admin admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:04.507279 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c03f66-d422-4f82-a2a6-c65cdc4fb711 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:04.509259 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c03f66-d422-4f82-a2a6-c65cdc4fb711 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:04.529565 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1145/2305] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:20:04 2022] POST /identity/v3/users => generated 285 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:20:04.533677 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f1d75-8258-407a-a32f-b95bc82666c6 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:04.544552 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f1d75-8258-407a-a32f-b95bc82666c6 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:04.549178 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd91e861-99f3-4e85-b2d4-5219696e971e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:04.550055 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91e861-99f3-4e85-b2d4-5219696e971e admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:04.550368 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91e861-99f3-4e85-b2d4-5219696e971e admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:04.550627 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91e861-99f3-4e85-b2d4-5219696e971e admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:04.551356 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd91e861-99f3-4e85-b2d4-5219696e971e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:04.554231 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd91e861-99f3-4e85-b2d4-5219696e971e admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:04.568385 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1161/2306] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:20:04.572515 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c03f66-d422-4f82-a2a6-c65cdc4fb711 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:04.583328 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c03f66-d422-4f82-a2a6-c65cdc4fb711 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:04.587883 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849143a5-3289-405e-8ef6-512dc9945f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:04.588537 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849143a5-3289-405e-8ef6-512dc9945f8f admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:04.588865 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849143a5-3289-405e-8ef6-512dc9945f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:04.589147 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849143a5-3289-405e-8ef6-512dc9945f8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:04.589878 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849143a5-3289-405e-8ef6-512dc9945f8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:04.591619 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849143a5-3289-405e-8ef6-512dc9945f8f admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:04.601556 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1146/2307] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:20:04.605845 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd91e861-99f3-4e85-b2d4-5219696e971e admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:04.618417 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd91e861-99f3-4e85-b2d4-5219696e971e admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:04.623970 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1891535-dcd9-4bed-861d-aa3955e6bd7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:04.624882 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1891535-dcd9-4bed-861d-aa3955e6bd7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:04.625161 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1891535-dcd9-4bed-861d-aa3955e6bd7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:04.625431 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1891535-dcd9-4bed-861d-aa3955e6bd7a admin admin] PATH_INFO: `/v3/projects/242f78144e544be7a204fc266c8c3850/users/41ae2c0aa5d7486494d34f6992374e2b/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:04.640660 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1891535-dcd9-4bed-861d-aa3955e6bd7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=242f78144e544be7a204fc266c8c3850, user_id=41ae2c0aa5d7486494d34f6992374e2b, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:04.643321 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1891535-dcd9-4bed-861d-aa3955e6bd7a admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:04.655483 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1162/2308] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:20:04 2022] PUT /identity/v3/projects/242f78144e544be7a204fc266c8c3850/users/41ae2c0aa5d7486494d34f6992374e2b/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:20:04.665583 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede34eb-b2a5-43ad-b598-96658e827147 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:04.665877 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede34eb-b2a5-43ad-b598-96658e827147 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:04.666153 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede34eb-b2a5-43ad-b598-96658e827147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:04.694326 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-eede34eb-b2a5-43ad-b598-96658e827147 None None] MFA Rules not processed for user `41ae2c0aa5d7486494d34f6992374e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:04.695654 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-eede34eb-b2a5-43ad-b598-96658e827147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:04.736978 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:04.761057 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1147/2309] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:20:04 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:04.765624 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1891535-dcd9-4bed-861d-aa3955e6bd7a admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:04.809531 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:04.827654 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1891535-dcd9-4bed-861d-aa3955e6bd7a admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:04.832234 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a788b9c8-f8c2-44af-9bd3-ce12ed67d9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:04.832914 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788b9c8-f8c2-44af-9bd3-ce12ed67d9fa admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:04.833196 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788b9c8-f8c2-44af-9bd3-ce12ed67d9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:04.833470 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788b9c8-f8c2-44af-9bd3-ce12ed67d9fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:04.834159 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a788b9c8-f8c2-44af-9bd3-ce12ed67d9fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:04.836038 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a788b9c8-f8c2-44af-9bd3-ce12ed67d9fa admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:04.863990 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1163/2310] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:20:04 2022] POST /identity/v3/projects => generated 369 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:20:04.868776 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede34eb-b2a5-43ad-b598-96658e827147 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:04.881144 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede34eb-b2a5-43ad-b598-96658e827147 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:04.938376 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8550fcb2-75a3-4e41-ae71-fe5d92885c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:04.939042 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550fcb2-75a3-4e41-ae71-fe5d92885c3a admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:04.939323 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550fcb2-75a3-4e41-ae71-fe5d92885c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:04.939601 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550fcb2-75a3-4e41-ae71-fe5d92885c3a admin admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:04.940300 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8550fcb2-75a3-4e41-ae71-fe5d92885c3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:04.942245 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8550fcb2-75a3-4e41-ae71-fe5d92885c3a admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:04.962585 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1148/2311] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:20:04 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:20:04.964779 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a788b9c8-f8c2-44af-9bd3-ce12ed67d9fa admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:04.975360 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a788b9c8-f8c2-44af-9bd3-ce12ed67d9fa admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:04.979922 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b6280-6d03-48ee-9da1-549095f7559d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:04.981331 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b6280-6d03-48ee-9da1-549095f7559d admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:04.981616 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b6280-6d03-48ee-9da1-549095f7559d admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:04.981892 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b6280-6d03-48ee-9da1-549095f7559d admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:04.982616 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b6280-6d03-48ee-9da1-549095f7559d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:04.984200 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b6280-6d03-48ee-9da1-549095f7559d admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:04.994660 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1164/2312] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:20:04.999365 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8550fcb2-75a3-4e41-ae71-fe5d92885c3a admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:05.009364 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8550fcb2-75a3-4e41-ae71-fe5d92885c3a admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:05.014188 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab03261-208f-40bf-a7b3-ec7bb5281346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:05.014999 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab03261-208f-40bf-a7b3-ec7bb5281346 admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:05.015282 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab03261-208f-40bf-a7b3-ec7bb5281346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:05.015559 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab03261-208f-40bf-a7b3-ec7bb5281346 admin admin] PATH_INFO: `/v3/projects/8f2ace38c79c4b6aa54f8943e52e374e/users/b9e01e058e9e4bfd8087c63367d2371e/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:05.030937 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab03261-208f-40bf-a7b3-ec7bb5281346 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f2ace38c79c4b6aa54f8943e52e374e, user_id=b9e01e058e9e4bfd8087c63367d2371e, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:05.033643 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab03261-208f-40bf-a7b3-ec7bb5281346 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:05.047025 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1149/2313] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:20:04 2022] PUT /identity/v3/projects/8f2ace38c79c4b6aa54f8943e52e374e/users/b9e01e058e9e4bfd8087c63367d2371e/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:05.050831 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b6280-6d03-48ee-9da1-549095f7559d admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:05.061176 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b6280-6d03-48ee-9da1-549095f7559d admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:05.116221 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd25f938-cea8-4e78-ad82-72859f795270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:05.116943 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25f938-cea8-4e78-ad82-72859f795270 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:05.117229 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25f938-cea8-4e78-ad82-72859f795270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:05.117507 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25f938-cea8-4e78-ad82-72859f795270 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:05.118230 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd25f938-cea8-4e78-ad82-72859f795270 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:05.119853 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd25f938-cea8-4e78-ad82-72859f795270 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:05.129757 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1165/2314] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:20:05.133820 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab03261-208f-40bf-a7b3-ec7bb5281346 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:05.144381 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab03261-208f-40bf-a7b3-ec7bb5281346 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:05.149041 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccd47ab-2c37-43aa-8559-da2bb46e9075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:05.149926 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd47ab-2c37-43aa-8559-da2bb46e9075 admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:05.150211 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd47ab-2c37-43aa-8559-da2bb46e9075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:05.150490 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd47ab-2c37-43aa-8559-da2bb46e9075 admin admin] PATH_INFO: `/v3/projects/8f2ace38c79c4b6aa54f8943e52e374e/users/b9e01e058e9e4bfd8087c63367d2371e/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:05.153117 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccd47ab-2c37-43aa-8559-da2bb46e9075 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f2ace38c79c4b6aa54f8943e52e374e, user_id=b9e01e058e9e4bfd8087c63367d2371e, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:05.155843 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccd47ab-2c37-43aa-8559-da2bb46e9075 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:05.166130 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1150/2315] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:20:05 2022] PUT /identity/v3/projects/8f2ace38c79c4b6aa54f8943e52e374e/users/b9e01e058e9e4bfd8087c63367d2371e/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:05.176785 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83388add-e0af-4e63-8236-6a17887e3c93 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:05.177077 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83388add-e0af-4e63-8236-6a17887e3c93 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:05.177353 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83388add-e0af-4e63-8236-6a17887e3c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:05.203329 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-83388add-e0af-4e63-8236-6a17887e3c93 None None] MFA Rules not processed for user `b9e01e058e9e4bfd8087c63367d2371e`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:05.204536 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-83388add-e0af-4e63-8236-6a17887e3c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:05.286194 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1166/2316] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:20:05 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:05.298452 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccd47ab-2c37-43aa-8559-da2bb46e9075 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:05.299848 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-cccd47ab-2c37-43aa-8559-da2bb46e9075 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:05.357591 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccd47ab-2c37-43aa-8559-da2bb46e9075 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:05.361248 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c0cf3-9b43-47fe-b589-bd716a4f2922 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:05.361881 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c0cf3-9b43-47fe-b589-bd716a4f2922 service cinder] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:05.362161 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c0cf3-9b43-47fe-b589-bd716a4f2922 service cinder] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:05.362433 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c0cf3-9b43-47fe-b589-bd716a4f2922 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:05.371293 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c0cf3-9b43-47fe-b589-bd716a4f2922 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:05.372750 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c0cf3-9b43-47fe-b589-bd716a4f2922 service cinder] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:05.382174 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1151/2317] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:20:05 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:20:05.425675 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83388add-e0af-4e63-8236-6a17887e3c93 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:05.427086 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-83388add-e0af-4e63-8236-6a17887e3c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:05.439055 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83388add-e0af-4e63-8236-6a17887e3c93 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:05.442680 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098476c7-ccc2-4328-adda-764c522a30b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:05.443325 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098476c7-ccc2-4328-adda-764c522a30b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:05.443609 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098476c7-ccc2-4328-adda-764c522a30b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:05.443886 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098476c7-ccc2-4328-adda-764c522a30b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:05.478896 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:05.503158 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098476c7-ccc2-4328-adda-764c522a30b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:05.504580 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098476c7-ccc2-4328-adda-764c522a30b9 service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:05.514245 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1167/2318] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:20:05 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:20:08.755425 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c0cf3-9b43-47fe-b589-bd716a4f2922 service cinder] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:08.799390 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:08.822526 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c0cf3-9b43-47fe-b589-bd716a4f2922 service cinder] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:08.827227 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffda653-f1f5-4a9f-a431-5bd52590647a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:08.828027 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffda653-f1f5-4a9f-a431-5bd52590647a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:08.828305 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffda653-f1f5-4a9f-a431-5bd52590647a admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:08.828576 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffda653-f1f5-4a9f-a431-5bd52590647a admin admin] PATH_INFO: `/v3/users/41ae2c0aa5d7486494d34f6992374e2b` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:08.829779 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffda653-f1f5-4a9f-a431-5bd52590647a admin admin] RBAC: Authorizing `identity:delete_user(user_id=41ae2c0aa5d7486494d34f6992374e2b)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:08.831674 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffda653-f1f5-4a9f-a431-5bd52590647a admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:08.878155 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-4ffda653-f1f5-4a9f-a431-5bd52590647a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41ae2c0aa5d7486494d34f6992374e2b'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:08.885229 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-4ffda653-f1f5-4a9f-a431-5bd52590647a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41ae2c0aa5d7486494d34f6992374e2b'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:08.885833 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-4ffda653-f1f5-4a9f-a431-5bd52590647a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41ae2c0aa5d7486494d34f6992374e2b'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:08.886432 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-4ffda653-f1f5-4a9f-a431-5bd52590647a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41ae2c0aa5d7486494d34f6992374e2b'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:08.898236 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-4ffda653-f1f5-4a9f-a431-5bd52590647a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41ae2c0aa5d7486494d34f6992374e2b'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:08.910730 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1152/2319] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:20:08 2022] DELETE /identity/v3/users/41ae2c0aa5d7486494d34f6992374e2b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:08.915263 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50346e91-2fbd-46b7-b027-82bffdb93c6b None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:08.915739 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50346e91-2fbd-46b7-b027-82bffdb93c6b None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:08.915842 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50346e91-2fbd-46b7-b027-82bffdb93c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:08.933382 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-50346e91-2fbd-46b7-b027-82bffdb93c6b None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:08.934754 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-50346e91-2fbd-46b7-b027-82bffdb93c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:08.992563 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1168/2320] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:20:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:09.002194 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffda653-f1f5-4a9f-a431-5bd52590647a admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:09.003586 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-4ffda653-f1f5-4a9f-a431-5bd52590647a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:09.060267 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffda653-f1f5-4a9f-a431-5bd52590647a admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:09.063988 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179b39c-c08a-4e5a-9744-f8a8ab9b815c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:09.064631 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179b39c-c08a-4e5a-9744-f8a8ab9b815c service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:09.064945 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179b39c-c08a-4e5a-9744-f8a8ab9b815c service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:09.065224 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179b39c-c08a-4e5a-9744-f8a8ab9b815c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:09.075617 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179b39c-c08a-4e5a-9744-f8a8ab9b815c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:09.077078 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179b39c-c08a-4e5a-9744-f8a8ab9b815c service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:09.086624 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1153/2321] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:20:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:20:09.351312 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50346e91-2fbd-46b7-b027-82bffdb93c6b None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:09.352780 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-50346e91-2fbd-46b7-b027-82bffdb93c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:09.367834 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50346e91-2fbd-46b7-b027-82bffdb93c6b None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:09.373247 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b4c531-5e40-46fd-a81b-0819a2685760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:09.374097 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4c531-5e40-46fd-a81b-0819a2685760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:09.374478 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4c531-5e40-46fd-a81b-0819a2685760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:09.374642 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4c531-5e40-46fd-a81b-0819a2685760 admin admin] PATH_INFO: `/v3/projects/242f78144e544be7a204fc266c8c3850` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:09.375879 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b4c531-5e40-46fd-a81b-0819a2685760 admin admin] RBAC: Authorizing `identity:delete_project(project_id=242f78144e544be7a204fc266c8c3850)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:09.377900 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b4c531-5e40-46fd-a81b-0819a2685760 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:09.426370 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-00b4c531-5e40-46fd-a81b-0819a2685760 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '242f78144e544be7a204fc266c8c3850', 'request_id': 'req-00b4c531-5e40-46fd-a81b-0819a2685760'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:09.431772 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-00b4c531-5e40-46fd-a81b-0819a2685760 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '242f78144e544be7a204fc266c8c3850', 'request_id': 'req-00b4c531-5e40-46fd-a81b-0819a2685760'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:09.439642 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-00b4c531-5e40-46fd-a81b-0819a2685760 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '242f78144e544be7a204fc266c8c3850', 'request_id': 'req-00b4c531-5e40-46fd-a81b-0819a2685760'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:09.451859 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-00b4c531-5e40-46fd-a81b-0819a2685760 admin admin] The token cache is being invalidate because project 242f78144e544be7a204fc266c8c3850 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:20:09.452172 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-00b4c531-5e40-46fd-a81b-0819a2685760 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:09.452883 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-00b4c531-5e40-46fd-a81b-0819a2685760 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:09.454519 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1169/2322] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:20:09 2022] DELETE /identity/v3/projects/242f78144e544be7a204fc266c8c3850 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:20:09.458659 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179b39c-c08a-4e5a-9744-f8a8ab9b815c service neutron] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:09.469609 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179b39c-c08a-4e5a-9744-f8a8ab9b815c service neutron] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:09.524385 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eca4a2-eda7-4531-a4f8-d885ea8a80ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:09.525270 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eca4a2-eda7-4531-a4f8-d885ea8a80ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:09.525554 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eca4a2-eda7-4531-a4f8-d885ea8a80ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:09.525827 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eca4a2-eda7-4531-a4f8-d885ea8a80ce admin admin] PATH_INFO: `/v3/users/b9e01e058e9e4bfd8087c63367d2371e` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:09.526991 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eca4a2-eda7-4531-a4f8-d885ea8a80ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9e01e058e9e4bfd8087c63367d2371e)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:09.530131 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eca4a2-eda7-4531-a4f8-d885ea8a80ce admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:09.531610 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:09.576551 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-33eca4a2-eda7-4531-a4f8-d885ea8a80ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9e01e058e9e4bfd8087c63367d2371e'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:09.583184 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-33eca4a2-eda7-4531-a4f8-d885ea8a80ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9e01e058e9e4bfd8087c63367d2371e'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:09.583879 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-33eca4a2-eda7-4531-a4f8-d885ea8a80ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9e01e058e9e4bfd8087c63367d2371e'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:09.584477 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-33eca4a2-eda7-4531-a4f8-d885ea8a80ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9e01e058e9e4bfd8087c63367d2371e'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:09.596186 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-33eca4a2-eda7-4531-a4f8-d885ea8a80ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9e01e058e9e4bfd8087c63367d2371e'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:09.608189 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1154/2323] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:20:09 2022] DELETE /identity/v3/users/b9e01e058e9e4bfd8087c63367d2371e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:09.874735 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b4c531-5e40-46fd-a81b-0819a2685760 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:09.876270 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-00b4c531-5e40-46fd-a81b-0819a2685760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:09.891136 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b4c531-5e40-46fd-a81b-0819a2685760 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:09.948758 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a080f73a-2be1-45b9-a034-6393c5f905c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:09.949622 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a080f73a-2be1-45b9-a034-6393c5f905c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:09.949908 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a080f73a-2be1-45b9-a034-6393c5f905c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:09.950188 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a080f73a-2be1-45b9-a034-6393c5f905c8 admin admin] PATH_INFO: `/v3/projects/8f2ace38c79c4b6aa54f8943e52e374e` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:09.951468 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a080f73a-2be1-45b9-a034-6393c5f905c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f2ace38c79c4b6aa54f8943e52e374e)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:09.953417 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a080f73a-2be1-45b9-a034-6393c5f905c8 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:09.954889 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:10.003201 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-a080f73a-2be1-45b9-a034-6393c5f905c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f2ace38c79c4b6aa54f8943e52e374e', 'request_id': 'req-a080f73a-2be1-45b9-a034-6393c5f905c8'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:10.008642 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-a080f73a-2be1-45b9-a034-6393c5f905c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f2ace38c79c4b6aa54f8943e52e374e', 'request_id': 'req-a080f73a-2be1-45b9-a034-6393c5f905c8'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:10.015808 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-a080f73a-2be1-45b9-a034-6393c5f905c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f2ace38c79c4b6aa54f8943e52e374e', 'request_id': 'req-a080f73a-2be1-45b9-a034-6393c5f905c8'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:10.026549 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-a080f73a-2be1-45b9-a034-6393c5f905c8 admin admin] The token cache is being invalidate because project 8f2ace38c79c4b6aa54f8943e52e374e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:20:10.026836 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-a080f73a-2be1-45b9-a034-6393c5f905c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:10.027458 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-a080f73a-2be1-45b9-a034-6393c5f905c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:10.029179 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1170/2324] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:20:09 2022] DELETE /identity/v3/projects/8f2ace38c79c4b6aa54f8943e52e374e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:10.033992 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c58303-948b-4869-b2d3-b13ea0410ea1 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:10.034457 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c58303-948b-4869-b2d3-b13ea0410ea1 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:10.034553 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c58303-948b-4869-b2d3-b13ea0410ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:10.052770 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-93c58303-948b-4869-b2d3-b13ea0410ea1 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:10.053959 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-93c58303-948b-4869-b2d3-b13ea0410ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:10.112503 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1155/2325] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:20:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:10.120233 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af7664d-327c-4a0d-8939-d94e3de7a372 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:10.120462 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af7664d-327c-4a0d-8939-d94e3de7a372 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:10.120761 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af7664d-327c-4a0d-8939-d94e3de7a372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:10.140076 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-9af7664d-327c-4a0d-8939-d94e3de7a372 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:10.141304 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-9af7664d-327c-4a0d-8939-d94e3de7a372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:10.149052 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1171/2326] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:20:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:10.153124 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c58303-948b-4869-b2d3-b13ea0410ea1 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:10.163445 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c58303-948b-4869-b2d3-b13ea0410ea1 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:10.168039 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fead08-ae45-4d25-bf85-bd9f0ee105f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:10.169334 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fead08-ae45-4d25-bf85-bd9f0ee105f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:10.169334 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fead08-ae45-4d25-bf85-bd9f0ee105f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:10.169862 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fead08-ae45-4d25-bf85-bd9f0ee105f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:10.170530 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fead08-ae45-4d25-bf85-bd9f0ee105f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:20:10.170832 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fead08-ae45-4d25-bf85-bd9f0ee105f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:10.173194 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fead08-ae45-4d25-bf85-bd9f0ee105f8 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:10.186906 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1156/2327] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:20:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:20:10.191086 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af7664d-327c-4a0d-8939-d94e3de7a372 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:10.200281 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af7664d-327c-4a0d-8939-d94e3de7a372 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:10.205138 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe35169-adce-42b2-a220-45199df9d6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:10.205781 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe35169-adce-42b2-a220-45199df9d6e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:10.206058 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe35169-adce-42b2-a220-45199df9d6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:10.206328 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe35169-adce-42b2-a220-45199df9d6e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:10.207047 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe35169-adce-42b2-a220-45199df9d6e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:10.208946 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe35169-adce-42b2-a220-45199df9d6e2 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:10.234634 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1172/2328] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:20:10 2022] POST /identity/v3/projects => generated 381 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:20:10.238849 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fead08-ae45-4d25-bf85-bd9f0ee105f8 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:10.249850 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fead08-ae45-4d25-bf85-bd9f0ee105f8 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:10.306035 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22f6e3a-0f35-40b1-9c25-0b94ce089fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:10.306729 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f6e3a-0f35-40b1-9c25-0b94ce089fe6 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:10.307014 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f6e3a-0f35-40b1-9c25-0b94ce089fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:10.307292 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f6e3a-0f35-40b1-9c25-0b94ce089fe6 admin admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:10.307976 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22f6e3a-0f35-40b1-9c25-0b94ce089fe6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:10.309952 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22f6e3a-0f35-40b1-9c25-0b94ce089fe6 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:10.319451 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:10.333744 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1157/2329] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:20:10 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:20:10.334988 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe35169-adce-42b2-a220-45199df9d6e2 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:10.347481 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe35169-adce-42b2-a220-45199df9d6e2 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:10.352082 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f1472d-b77e-43ca-a869-019df9ccf557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:10.352798 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1472d-b77e-43ca-a869-019df9ccf557 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:10.353083 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1472d-b77e-43ca-a869-019df9ccf557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:10.353358 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1472d-b77e-43ca-a869-019df9ccf557 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:10.354081 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f1472d-b77e-43ca-a869-019df9ccf557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:10.355665 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f1472d-b77e-43ca-a869-019df9ccf557 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:10.366751 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1173/2330] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:20:10.370942 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22f6e3a-0f35-40b1-9c25-0b94ce089fe6 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:10.381003 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22f6e3a-0f35-40b1-9c25-0b94ce089fe6 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:10.385525 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2bbfe5-9315-45bc-b1b6-ae6ec17611d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:10.386171 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2bbfe5-9315-45bc-b1b6-ae6ec17611d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:10.386450 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2bbfe5-9315-45bc-b1b6-ae6ec17611d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:10.386721 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2bbfe5-9315-45bc-b1b6-ae6ec17611d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:10.387575 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2bbfe5-9315-45bc-b1b6-ae6ec17611d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:10.389207 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2bbfe5-9315-45bc-b1b6-ae6ec17611d6 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:10.398904 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1158/2331] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:20:10.402787 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f1472d-b77e-43ca-a869-019df9ccf557 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:10.413235 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f1472d-b77e-43ca-a869-019df9ccf557 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:10.417804 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20fe1bb-793d-4dda-95ca-245b6bd964b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:10.419336 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20fe1bb-793d-4dda-95ca-245b6bd964b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:10.419906 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20fe1bb-793d-4dda-95ca-245b6bd964b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:10.419906 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20fe1bb-793d-4dda-95ca-245b6bd964b7 admin admin] PATH_INFO: `/v3/projects/2c1abc7301d54c999928383a15298317/users/44e2c7cbf670427999a7e246a3f20b6b/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:10.434082 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20fe1bb-793d-4dda-95ca-245b6bd964b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c1abc7301d54c999928383a15298317, user_id=44e2c7cbf670427999a7e246a3f20b6b, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:10.436922 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20fe1bb-793d-4dda-95ca-245b6bd964b7 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:10.450183 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1174/2332] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:20:10 2022] PUT /identity/v3/projects/2c1abc7301d54c999928383a15298317/users/44e2c7cbf670427999a7e246a3f20b6b/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:10.460900 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411d3ee1-7c7d-4216-82ab-247cc87a3be2 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:10.461235 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411d3ee1-7c7d-4216-82ab-247cc87a3be2 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:10.461514 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411d3ee1-7c7d-4216-82ab-247cc87a3be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:10.489502 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-411d3ee1-7c7d-4216-82ab-247cc87a3be2 None None] MFA Rules not processed for user `44e2c7cbf670427999a7e246a3f20b6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:10.490711 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-411d3ee1-7c7d-4216-82ab-247cc87a3be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:10.554147 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1159/2333] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:20:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:10.558601 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20fe1bb-793d-4dda-95ca-245b6bd964b7 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:10.618538 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20fe1bb-793d-4dda-95ca-245b6bd964b7 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:10.623674 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4c4d2-38d9-402a-b74e-67b978664dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:10.624250 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4c4d2-38d9-402a-b74e-67b978664dee admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:10.624531 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4c4d2-38d9-402a-b74e-67b978664dee admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:10.624840 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4c4d2-38d9-402a-b74e-67b978664dee admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:10.625532 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb4c4d2-38d9-402a-b74e-67b978664dee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:10.627413 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb4c4d2-38d9-402a-b74e-67b978664dee admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:10.652666 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1175/2334] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:20:10 2022] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:20:10.657192 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411d3ee1-7c7d-4216-82ab-247cc87a3be2 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:10.668343 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411d3ee1-7c7d-4216-82ab-247cc87a3be2 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:10.724225 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b12596-338d-46f9-ac79-d17888363088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:10.724908 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b12596-338d-46f9-ac79-d17888363088 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:10.725192 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b12596-338d-46f9-ac79-d17888363088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:10.725468 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b12596-338d-46f9-ac79-d17888363088 admin admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:10.726145 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b12596-338d-46f9-ac79-d17888363088 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:10.728047 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b12596-338d-46f9-ac79-d17888363088 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:10.750397 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1160/2335] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:20:10 2022] POST /identity/v3/users => generated 296 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:20:10.754551 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4c4d2-38d9-402a-b74e-67b978664dee admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:10.764811 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4c4d2-38d9-402a-b74e-67b978664dee admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:10.769506 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e923aa-ba4e-4a4c-aa87-f7ca18859aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:10.770143 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e923aa-ba4e-4a4c-aa87-f7ca18859aca admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:10.770424 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e923aa-ba4e-4a4c-aa87-f7ca18859aca admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:10.770694 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e923aa-ba4e-4a4c-aa87-f7ca18859aca admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:10.771411 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e923aa-ba4e-4a4c-aa87-f7ca18859aca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:10.773033 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e923aa-ba4e-4a4c-aa87-f7ca18859aca admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:10.778173 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:10.788299 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1176/2336] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:20:10.789493 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b12596-338d-46f9-ac79-d17888363088 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:10.799873 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b12596-338d-46f9-ac79-d17888363088 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:10.804454 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44092e0-2f0e-4744-adee-2b108d285260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:10.805348 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44092e0-2f0e-4744-adee-2b108d285260 admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:10.805632 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44092e0-2f0e-4744-adee-2b108d285260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:10.805908 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44092e0-2f0e-4744-adee-2b108d285260 admin admin] PATH_INFO: `/v3/projects/a493f66f98dd44479dbfb51aca32ea63/users/5282b834afde4fcdb6b877dec324abaf/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:10.820953 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44092e0-2f0e-4744-adee-2b108d285260 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a493f66f98dd44479dbfb51aca32ea63, user_id=5282b834afde4fcdb6b877dec324abaf, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:10.823590 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44092e0-2f0e-4744-adee-2b108d285260 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:10.836247 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1161/2337] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:20:10 2022] PUT /identity/v3/projects/a493f66f98dd44479dbfb51aca32ea63/users/5282b834afde4fcdb6b877dec324abaf/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:10.840110 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e923aa-ba4e-4a4c-aa87-f7ca18859aca admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:10.850079 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e923aa-ba4e-4a4c-aa87-f7ca18859aca admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:10.909970 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f504881-7117-465f-a2c8-eb1d96c13cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:10.910556 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f504881-7117-465f-a2c8-eb1d96c13cb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:10.910838 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f504881-7117-465f-a2c8-eb1d96c13cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:10.911113 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f504881-7117-465f-a2c8-eb1d96c13cb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:10.911829 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f504881-7117-465f-a2c8-eb1d96c13cb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:10.913441 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f504881-7117-465f-a2c8-eb1d96c13cb3 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:10.923768 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1177/2338] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:20:10.927928 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44092e0-2f0e-4744-adee-2b108d285260 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:10.939259 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44092e0-2f0e-4744-adee-2b108d285260 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:10.943827 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e34fb-83ac-4d39-b012-18937ecb7a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:10.944746 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e34fb-83ac-4d39-b012-18937ecb7a8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:10.945030 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e34fb-83ac-4d39-b012-18937ecb7a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:10.945330 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e34fb-83ac-4d39-b012-18937ecb7a8c admin admin] PATH_INFO: `/v3/projects/a493f66f98dd44479dbfb51aca32ea63/users/5282b834afde4fcdb6b877dec324abaf/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:10.947288 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173e34fb-83ac-4d39-b012-18937ecb7a8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a493f66f98dd44479dbfb51aca32ea63, user_id=5282b834afde4fcdb6b877dec324abaf, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:10.950000 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173e34fb-83ac-4d39-b012-18937ecb7a8c admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:10.960253 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1162/2339] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:20:10 2022] PUT /identity/v3/projects/a493f66f98dd44479dbfb51aca32ea63/users/5282b834afde4fcdb6b877dec324abaf/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:10.971168 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241016bb-5c0c-435f-b145-d95af071e815 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:10.971687 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241016bb-5c0c-435f-b145-d95af071e815 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:10.971797 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241016bb-5c0c-435f-b145-d95af071e815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:10.999312 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-241016bb-5c0c-435f-b145-d95af071e815 None None] MFA Rules not processed for user `5282b834afde4fcdb6b877dec324abaf`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:11.000511 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-241016bb-5c0c-435f-b145-d95af071e815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:11.067434 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1178/2340] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:20:10 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:11.079642 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e34fb-83ac-4d39-b012-18937ecb7a8c admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:11.081422 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-173e34fb-83ac-4d39-b012-18937ecb7a8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:11.114217 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:11.140352 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e34fb-83ac-4d39-b012-18937ecb7a8c admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:11.144591 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d3fcf0-1131-4d6c-9f6f-18ef0340a9e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:11.145413 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3fcf0-1131-4d6c-9f6f-18ef0340a9e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:11.145696 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3fcf0-1131-4d6c-9f6f-18ef0340a9e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:11.145968 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3fcf0-1131-4d6c-9f6f-18ef0340a9e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:11.156031 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d3fcf0-1131-4d6c-9f6f-18ef0340a9e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:11.157491 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d3fcf0-1131-4d6c-9f6f-18ef0340a9e9 service cinder] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:11.166986 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1163/2341] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:20:11 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:20:11.471412 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241016bb-5c0c-435f-b145-d95af071e815 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:11.480475 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241016bb-5c0c-435f-b145-d95af071e815 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:11.485534 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe7849-10ea-4210-ba17-dd30435223cc tempest-VolumeQuotaClassesTest-728971951 tempest-VolumeQuotaClassesTest-728971951-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5282b834afde4fcdb6b877dec324abaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a493f66f98dd44479dbfb51aca32ea63', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:11.486188 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe7849-10ea-4210-ba17-dd30435223cc tempest-VolumeQuotaClassesTest-728971951 tempest-VolumeQuotaClassesTest-728971951-project-admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:11.486471 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe7849-10ea-4210-ba17-dd30435223cc tempest-VolumeQuotaClassesTest-728971951 tempest-VolumeQuotaClassesTest-728971951-project-admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:11.486748 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe7849-10ea-4210-ba17-dd30435223cc tempest-VolumeQuotaClassesTest-728971951 tempest-VolumeQuotaClassesTest-728971951-project-admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:11.487481 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fe7849-10ea-4210-ba17-dd30435223cc tempest-VolumeQuotaClassesTest-728971951 tempest-VolumeQuotaClassesTest-728971951-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:20:11.487793 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fe7849-10ea-4210-ba17-dd30435223cc tempest-VolumeQuotaClassesTest-728971951 tempest-VolumeQuotaClassesTest-728971951-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:11.489431 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fe7849-10ea-4210-ba17-dd30435223cc tempest-VolumeQuotaClassesTest-728971951 tempest-VolumeQuotaClassesTest-728971951-project-admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:11.500821 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1179/2342] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:20:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:20:11.504793 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d3fcf0-1131-4d6c-9f6f-18ef0340a9e9 service cinder] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:11.514532 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d3fcf0-1131-4d6c-9f6f-18ef0340a9e9 service cinder] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:11.519075 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a80469-bad6-4f1b-8796-57936b6291db tempest-VolumeQuotaClassesTest-728971951 tempest-VolumeQuotaClassesTest-728971951-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5282b834afde4fcdb6b877dec324abaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a493f66f98dd44479dbfb51aca32ea63', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:11.519720 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a80469-bad6-4f1b-8796-57936b6291db tempest-VolumeQuotaClassesTest-728971951 tempest-VolumeQuotaClassesTest-728971951-project-admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:11.520015 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a80469-bad6-4f1b-8796-57936b6291db tempest-VolumeQuotaClassesTest-728971951 tempest-VolumeQuotaClassesTest-728971951-project-admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:11.520297 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a80469-bad6-4f1b-8796-57936b6291db tempest-VolumeQuotaClassesTest-728971951 tempest-VolumeQuotaClassesTest-728971951-project-admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:11.521017 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a80469-bad6-4f1b-8796-57936b6291db tempest-VolumeQuotaClassesTest-728971951 tempest-VolumeQuotaClassesTest-728971951-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:11.522911 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a80469-bad6-4f1b-8796-57936b6291db tempest-VolumeQuotaClassesTest-728971951 tempest-VolumeQuotaClassesTest-728971951-project-admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:11.548898 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1164/2343] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:20:11 2022] POST /identity/v3/projects => generated 353 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:20:11.552936 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe7849-10ea-4210-ba17-dd30435223cc tempest-VolumeQuotaClassesTest-728971951 tempest-VolumeQuotaClassesTest-728971951-project-admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:11.562693 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe7849-10ea-4210-ba17-dd30435223cc tempest-VolumeQuotaClassesTest-728971951 tempest-VolumeQuotaClassesTest-728971951-project-admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:11.618595 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d29185-74ea-418f-8ac3-1a88a99e0a82 tempest-VolumeQuotaClassesTest-728971951 tempest-VolumeQuotaClassesTest-728971951-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5282b834afde4fcdb6b877dec324abaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a493f66f98dd44479dbfb51aca32ea63', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:11.619256 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d29185-74ea-418f-8ac3-1a88a99e0a82 tempest-VolumeQuotaClassesTest-728971951 tempest-VolumeQuotaClassesTest-728971951-project-admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:11.619552 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d29185-74ea-418f-8ac3-1a88a99e0a82 tempest-VolumeQuotaClassesTest-728971951 tempest-VolumeQuotaClassesTest-728971951-project-admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:11.619837 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d29185-74ea-418f-8ac3-1a88a99e0a82 tempest-VolumeQuotaClassesTest-728971951 tempest-VolumeQuotaClassesTest-728971951-project-admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:11.620567 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d29185-74ea-418f-8ac3-1a88a99e0a82 tempest-VolumeQuotaClassesTest-728971951 tempest-VolumeQuotaClassesTest-728971951-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:20:11.620914 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d29185-74ea-418f-8ac3-1a88a99e0a82 tempest-VolumeQuotaClassesTest-728971951 tempest-VolumeQuotaClassesTest-728971951-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:11.622513 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d29185-74ea-418f-8ac3-1a88a99e0a82 tempest-VolumeQuotaClassesTest-728971951 tempest-VolumeQuotaClassesTest-728971951-project-admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:11.633667 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1180/2344] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:20:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:20:11.669862 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a80469-bad6-4f1b-8796-57936b6291db tempest-VolumeQuotaClassesTest-728971951 tempest-VolumeQuotaClassesTest-728971951-project-admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:11.680032 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a80469-bad6-4f1b-8796-57936b6291db tempest-VolumeQuotaClassesTest-728971951 tempest-VolumeQuotaClassesTest-728971951-project-admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:11.684666 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf0a57-1d09-43e2-8a4b-51b7ad3b7ddb tempest-VolumeQuotaClassesTest-728971951 tempest-VolumeQuotaClassesTest-728971951-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5282b834afde4fcdb6b877dec324abaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a493f66f98dd44479dbfb51aca32ea63', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:11.685496 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf0a57-1d09-43e2-8a4b-51b7ad3b7ddb tempest-VolumeQuotaClassesTest-728971951 tempest-VolumeQuotaClassesTest-728971951-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:11.685787 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf0a57-1d09-43e2-8a4b-51b7ad3b7ddb tempest-VolumeQuotaClassesTest-728971951 tempest-VolumeQuotaClassesTest-728971951-project-admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:11.686111 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf0a57-1d09-43e2-8a4b-51b7ad3b7ddb tempest-VolumeQuotaClassesTest-728971951 tempest-VolumeQuotaClassesTest-728971951-project-admin] PATH_INFO: `/v3/projects/b13b8ef1c3594d0c8f3d0b458b2e41ae` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:11.687278 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccf0a57-1d09-43e2-8a4b-51b7ad3b7ddb tempest-VolumeQuotaClassesTest-728971951 tempest-VolumeQuotaClassesTest-728971951-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b13b8ef1c3594d0c8f3d0b458b2e41ae)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:11.689217 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccf0a57-1d09-43e2-8a4b-51b7ad3b7ddb tempest-VolumeQuotaClassesTest-728971951 tempest-VolumeQuotaClassesTest-728971951-project-admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:11.736123 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-eccf0a57-1d09-43e2-8a4b-51b7ad3b7ddb tempest-VolumeQuotaClassesTest-728971951 tempest-VolumeQuotaClassesTest-728971951-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b13b8ef1c3594d0c8f3d0b458b2e41ae', 'request_id': 'req-eccf0a57-1d09-43e2-8a4b-51b7ad3b7ddb'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:11.744348 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-eccf0a57-1d09-43e2-8a4b-51b7ad3b7ddb tempest-VolumeQuotaClassesTest-728971951 tempest-VolumeQuotaClassesTest-728971951-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b13b8ef1c3594d0c8f3d0b458b2e41ae', 'request_id': 'req-eccf0a57-1d09-43e2-8a4b-51b7ad3b7ddb'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:11.750661 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-eccf0a57-1d09-43e2-8a4b-51b7ad3b7ddb tempest-VolumeQuotaClassesTest-728971951 tempest-VolumeQuotaClassesTest-728971951-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b13b8ef1c3594d0c8f3d0b458b2e41ae', 'request_id': 'req-eccf0a57-1d09-43e2-8a4b-51b7ad3b7ddb'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:11.761967 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-eccf0a57-1d09-43e2-8a4b-51b7ad3b7ddb tempest-VolumeQuotaClassesTest-728971951 tempest-VolumeQuotaClassesTest-728971951-project-admin] The token cache is being invalidate because project b13b8ef1c3594d0c8f3d0b458b2e41ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:20:11.762263 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-eccf0a57-1d09-43e2-8a4b-51b7ad3b7ddb tempest-VolumeQuotaClassesTest-728971951 tempest-VolumeQuotaClassesTest-728971951-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:11.763499 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-eccf0a57-1d09-43e2-8a4b-51b7ad3b7ddb tempest-VolumeQuotaClassesTest-728971951 tempest-VolumeQuotaClassesTest-728971951-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:11.765076 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1165/2345] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:20:11 2022] DELETE /identity/v3/projects/b13b8ef1c3594d0c8f3d0b458b2e41ae => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:20:11.947887 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d29185-74ea-418f-8ac3-1a88a99e0a82 tempest-VolumeQuotaClassesTest-728971951 tempest-VolumeQuotaClassesTest-728971951-project-admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:11.949639 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-97d29185-74ea-418f-8ac3-1a88a99e0a82 tempest-VolumeQuotaClassesTest-728971951 tempest-VolumeQuotaClassesTest-728971951-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:11.955585 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:12.015420 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d29185-74ea-418f-8ac3-1a88a99e0a82 tempest-VolumeQuotaClassesTest-728971951 tempest-VolumeQuotaClassesTest-728971951-project-admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:12.069750 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ce94e-59c0-406d-846f-6daca0bb53d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:12.070635 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ce94e-59c0-406d-846f-6daca0bb53d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:12.070918 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ce94e-59c0-406d-846f-6daca0bb53d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:12.071195 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ce94e-59c0-406d-846f-6daca0bb53d4 admin admin] PATH_INFO: `/v3/users/44e2c7cbf670427999a7e246a3f20b6b` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:12.072387 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518ce94e-59c0-406d-846f-6daca0bb53d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44e2c7cbf670427999a7e246a3f20b6b)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:12.074343 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518ce94e-59c0-406d-846f-6daca0bb53d4 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:12.120631 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-518ce94e-59c0-406d-846f-6daca0bb53d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44e2c7cbf670427999a7e246a3f20b6b'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:12.128960 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-518ce94e-59c0-406d-846f-6daca0bb53d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44e2c7cbf670427999a7e246a3f20b6b'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:12.135751 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-518ce94e-59c0-406d-846f-6daca0bb53d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44e2c7cbf670427999a7e246a3f20b6b'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:12.148105 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-518ce94e-59c0-406d-846f-6daca0bb53d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44e2c7cbf670427999a7e246a3f20b6b'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:12.148828 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-518ce94e-59c0-406d-846f-6daca0bb53d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44e2c7cbf670427999a7e246a3f20b6b'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:12.155567 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1181/2346] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:20:11 2022] DELETE /identity/v3/users/44e2c7cbf670427999a7e246a3f20b6b => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:12.160383 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eee4ec-96a2-40a9-aef2-3a4c3c9775cb None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:12.161271 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eee4ec-96a2-40a9-aef2-3a4c3c9775cb None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:12.161548 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eee4ec-96a2-40a9-aef2-3a4c3c9775cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:12.179979 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-39eee4ec-96a2-40a9-aef2-3a4c3c9775cb None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:12.181212 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-39eee4ec-96a2-40a9-aef2-3a4c3c9775cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:12.240495 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1166/2347] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:20:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:12.251640 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ce94e-59c0-406d-846f-6daca0bb53d4 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:12.253084 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-518ce94e-59c0-406d-846f-6daca0bb53d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:12.284335 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:12.311277 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ce94e-59c0-406d-846f-6daca0bb53d4 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:12.314889 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e8007-bd09-4941-a769-6441df816017 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:12.315533 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e8007-bd09-4941-a769-6441df816017 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:12.315817 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e8007-bd09-4941-a769-6441df816017 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:12.316094 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e8007-bd09-4941-a769-6441df816017 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:12.325302 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334e8007-bd09-4941-a769-6441df816017 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:12.326723 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334e8007-bd09-4941-a769-6441df816017 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:12.336110 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1182/2348] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:20:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:20:12.611239 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eee4ec-96a2-40a9-aef2-3a4c3c9775cb None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:12.612801 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-39eee4ec-96a2-40a9-aef2-3a4c3c9775cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:12.627970 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eee4ec-96a2-40a9-aef2-3a4c3c9775cb None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:12.632572 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785bb7dc-e755-40b0-bc69-c981104ec795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:12.633456 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bb7dc-e755-40b0-bc69-c981104ec795 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:12.633760 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bb7dc-e755-40b0-bc69-c981104ec795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:12.633994 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bb7dc-e755-40b0-bc69-c981104ec795 admin admin] PATH_INFO: `/v3/projects/2c1abc7301d54c999928383a15298317` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:12.635230 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785bb7dc-e755-40b0-bc69-c981104ec795 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c1abc7301d54c999928383a15298317)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:12.637106 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785bb7dc-e755-40b0-bc69-c981104ec795 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:12.668297 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:12.687329 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-785bb7dc-e755-40b0-bc69-c981104ec795 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c1abc7301d54c999928383a15298317', 'request_id': 'req-785bb7dc-e755-40b0-bc69-c981104ec795'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:12.694614 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-785bb7dc-e755-40b0-bc69-c981104ec795 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c1abc7301d54c999928383a15298317', 'request_id': 'req-785bb7dc-e755-40b0-bc69-c981104ec795'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:12.701334 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-785bb7dc-e755-40b0-bc69-c981104ec795 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c1abc7301d54c999928383a15298317', 'request_id': 'req-785bb7dc-e755-40b0-bc69-c981104ec795'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:12.712215 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-785bb7dc-e755-40b0-bc69-c981104ec795 admin admin] The token cache is being invalidate because project 2c1abc7301d54c999928383a15298317 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:20:12.712498 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-785bb7dc-e755-40b0-bc69-c981104ec795 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:12.713147 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-785bb7dc-e755-40b0-bc69-c981104ec795 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:12.714686 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1167/2349] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:20:12 2022] DELETE /identity/v3/projects/2c1abc7301d54c999928383a15298317 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:12.718708 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e8007-bd09-4941-a769-6441df816017 service neutron] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:12.728343 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e8007-bd09-4941-a769-6441df816017 service neutron] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:12.783982 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b34db-8862-41f5-9faf-573c6966d924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:12.784804 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b34db-8862-41f5-9faf-573c6966d924 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:12.785084 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b34db-8862-41f5-9faf-573c6966d924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:12.785358 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b34db-8862-41f5-9faf-573c6966d924 admin admin] PATH_INFO: `/v3/users/5282b834afde4fcdb6b877dec324abaf` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:12.786526 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b34db-8862-41f5-9faf-573c6966d924 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5282b834afde4fcdb6b877dec324abaf)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:12.788423 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b34db-8862-41f5-9faf-573c6966d924 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:12.834410 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-9b0b34db-8862-41f5-9faf-573c6966d924 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5282b834afde4fcdb6b877dec324abaf'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:12.841445 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-9b0b34db-8862-41f5-9faf-573c6966d924 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5282b834afde4fcdb6b877dec324abaf'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:12.853254 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-9b0b34db-8862-41f5-9faf-573c6966d924 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5282b834afde4fcdb6b877dec324abaf'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:12.867332 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-9b0b34db-8862-41f5-9faf-573c6966d924 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5282b834afde4fcdb6b877dec324abaf'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:12.868041 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-9b0b34db-8862-41f5-9faf-573c6966d924 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5282b834afde4fcdb6b877dec324abaf'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:12.874010 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1183/2350] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:20:12 2022] DELETE /identity/v3/users/5282b834afde4fcdb6b877dec324abaf => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:13.132458 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785bb7dc-e755-40b0-bc69-c981104ec795 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:13.133907 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-785bb7dc-e755-40b0-bc69-c981104ec795 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:13.147242 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785bb7dc-e755-40b0-bc69-c981104ec795 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:13.206538 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534879f-4539-4470-8662-0d9eaa8d603a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:13.207389 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534879f-4539-4470-8662-0d9eaa8d603a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:13.207676 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534879f-4539-4470-8662-0d9eaa8d603a admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:13.207953 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534879f-4539-4470-8662-0d9eaa8d603a admin admin] PATH_INFO: `/v3/projects/a493f66f98dd44479dbfb51aca32ea63` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:13.209161 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0534879f-4539-4470-8662-0d9eaa8d603a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a493f66f98dd44479dbfb51aca32ea63)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:13.211065 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0534879f-4539-4470-8662-0d9eaa8d603a admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:13.256791 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-0534879f-4539-4470-8662-0d9eaa8d603a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a493f66f98dd44479dbfb51aca32ea63', 'request_id': 'req-0534879f-4539-4470-8662-0d9eaa8d603a'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:13.266484 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-0534879f-4539-4470-8662-0d9eaa8d603a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a493f66f98dd44479dbfb51aca32ea63', 'request_id': 'req-0534879f-4539-4470-8662-0d9eaa8d603a'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:13.272389 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-0534879f-4539-4470-8662-0d9eaa8d603a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a493f66f98dd44479dbfb51aca32ea63', 'request_id': 'req-0534879f-4539-4470-8662-0d9eaa8d603a'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:13.284343 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-0534879f-4539-4470-8662-0d9eaa8d603a admin admin] The token cache is being invalidate because project a493f66f98dd44479dbfb51aca32ea63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:20:13.284630 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-0534879f-4539-4470-8662-0d9eaa8d603a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:13.285295 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-0534879f-4539-4470-8662-0d9eaa8d603a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:13.286820 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1168/2351] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:20:13 2022] DELETE /identity/v3/projects/a493f66f98dd44479dbfb51aca32ea63 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:13.293349 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef519a62-efa9-4746-ab79-6a2d852ece94 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:13.294410 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef519a62-efa9-4746-ab79-6a2d852ece94 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:13.294410 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef519a62-efa9-4746-ab79-6a2d852ece94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:13.311773 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-ef519a62-efa9-4746-ab79-6a2d852ece94 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:13.312927 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-ef519a62-efa9-4746-ab79-6a2d852ece94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:13.358013 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:13.374277 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1184/2352] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:13.382024 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f9cc4-befa-400a-ab68-22fa06c352c3 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:13.382349 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f9cc4-befa-400a-ab68-22fa06c352c3 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:13.382631 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f9cc4-befa-400a-ab68-22fa06c352c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:13.401448 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-329f9cc4-befa-400a-ab68-22fa06c352c3 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:13.402637 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-329f9cc4-befa-400a-ab68-22fa06c352c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:13.410490 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1169/2353] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:13.414624 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef519a62-efa9-4746-ab79-6a2d852ece94 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:13.424355 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef519a62-efa9-4746-ab79-6a2d852ece94 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:13.428914 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ead28e-8bf1-4837-bbb0-efa826e99ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:13.429563 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ead28e-8bf1-4837-bbb0-efa826e99ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:13.429850 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ead28e-8bf1-4837-bbb0-efa826e99ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:13.430128 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ead28e-8bf1-4837-bbb0-efa826e99ee2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:13.430854 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ead28e-8bf1-4837-bbb0-efa826e99ee2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:20:13.431166 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ead28e-8bf1-4837-bbb0-efa826e99ee2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:13.432782 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ead28e-8bf1-4837-bbb0-efa826e99ee2 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:13.446744 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1185/2354] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:20:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:20:13.449194 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f9cc4-befa-400a-ab68-22fa06c352c3 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:13.459544 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f9cc4-befa-400a-ab68-22fa06c352c3 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:13.464263 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f6181-aedb-4f37-906c-fbedaaee82c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:13.464948 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f6181-aedb-4f37-906c-fbedaaee82c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:13.465230 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f6181-aedb-4f37-906c-fbedaaee82c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:13.465761 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f6181-aedb-4f37-906c-fbedaaee82c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:13.466462 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47f6181-aedb-4f37-906c-fbedaaee82c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:13.468376 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47f6181-aedb-4f37-906c-fbedaaee82c4 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:13.493724 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1170/2355] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:20:13 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:20:13.498422 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ead28e-8bf1-4837-bbb0-efa826e99ee2 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:13.508176 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ead28e-8bf1-4837-bbb0-efa826e99ee2 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:13.564145 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f6bce-c75a-425c-ba8b-6471dad92a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:13.564839 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f6bce-c75a-425c-ba8b-6471dad92a76 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:13.565123 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f6bce-c75a-425c-ba8b-6471dad92a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:13.565396 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f6bce-c75a-425c-ba8b-6471dad92a76 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:13.566076 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f6bce-c75a-425c-ba8b-6471dad92a76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:13.567976 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f6bce-c75a-425c-ba8b-6471dad92a76 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:13.588418 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1186/2356] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:20:13 2022] POST /identity/v3/users => generated 286 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:20:13.592466 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f6181-aedb-4f37-906c-fbedaaee82c4 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:13.602693 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f6181-aedb-4f37-906c-fbedaaee82c4 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:13.608270 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c33cf-73a4-4475-8acc-d924b7440e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:13.608969 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c33cf-73a4-4475-8acc-d924b7440e58 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:13.609270 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c33cf-73a4-4475-8acc-d924b7440e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:13.609548 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c33cf-73a4-4475-8acc-d924b7440e58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:13.610275 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05c33cf-73a4-4475-8acc-d924b7440e58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:13.611871 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05c33cf-73a4-4475-8acc-d924b7440e58 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:13.622946 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1171/2357] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:20:13.626640 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f6bce-c75a-425c-ba8b-6471dad92a76 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:13.636335 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f6bce-c75a-425c-ba8b-6471dad92a76 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:13.642105 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef732c-102e-404a-a29d-1269d34b729f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:13.642753 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef732c-102e-404a-a29d-1269d34b729f admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:13.643038 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef732c-102e-404a-a29d-1269d34b729f admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:13.643318 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef732c-102e-404a-a29d-1269d34b729f admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:13.644051 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef732c-102e-404a-a29d-1269d34b729f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:13.645658 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef732c-102e-404a-a29d-1269d34b729f admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:13.656072 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1187/2358] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:20:13.659735 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c33cf-73a4-4475-8acc-d924b7440e58 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:13.666400 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:13.670855 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c33cf-73a4-4475-8acc-d924b7440e58 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:13.676136 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd69f0f3-9837-4920-a002-04bd26e3d46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:13.677043 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd69f0f3-9837-4920-a002-04bd26e3d46b admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:13.677648 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd69f0f3-9837-4920-a002-04bd26e3d46b admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:13.677971 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd69f0f3-9837-4920-a002-04bd26e3d46b admin admin] PATH_INFO: `/v3/projects/4c7d8d09f3b94090bbb08abbc1842a42/users/d8ff165426d14c09a7221a910ca7febc/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:13.693062 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd69f0f3-9837-4920-a002-04bd26e3d46b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c7d8d09f3b94090bbb08abbc1842a42, user_id=d8ff165426d14c09a7221a910ca7febc, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:13.695681 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd69f0f3-9837-4920-a002-04bd26e3d46b admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:13.708243 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1172/2359] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:20:13 2022] PUT /identity/v3/projects/4c7d8d09f3b94090bbb08abbc1842a42/users/d8ff165426d14c09a7221a910ca7febc/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:13.713351 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f77e4-b0d1-4fa8-af61-5105b12c6655 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:13.713643 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f77e4-b0d1-4fa8-af61-5105b12c6655 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:13.713940 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f77e4-b0d1-4fa8-af61-5105b12c6655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:13.733142 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-ae5f77e4-b0d1-4fa8-af61-5105b12c6655 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:13.734347 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-ae5f77e4-b0d1-4fa8-af61-5105b12c6655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:13.792031 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1188/2360] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:20:13.801676 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd69f0f3-9837-4920-a002-04bd26e3d46b admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:13.803352 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-dd69f0f3-9837-4920-a002-04bd26e3d46b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:13.862261 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd69f0f3-9837-4920-a002-04bd26e3d46b admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:13.865871 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67549532-d166-4272-b05b-d27ec5d890fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:13.866515 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67549532-d166-4272-b05b-d27ec5d890fd service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:13.866794 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67549532-d166-4272-b05b-d27ec5d890fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:13.867067 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67549532-d166-4272-b05b-d27ec5d890fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:13.876105 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67549532-d166-4272-b05b-d27ec5d890fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:13.877557 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67549532-d166-4272-b05b-d27ec5d890fd service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:13.887096 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1173/2361] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:20:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:20:17.798354 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f651cc-7028-402d-8c89-ea03c228169a None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:17.798835 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f651cc-7028-402d-8c89-ea03c228169a None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:17.798934 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f651cc-7028-402d-8c89-ea03c228169a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:17.825154 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-b8f651cc-7028-402d-8c89-ea03c228169a None None] MFA Rules not processed for user `d8ff165426d14c09a7221a910ca7febc`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:17.826373 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-b8f651cc-7028-402d-8c89-ea03c228169a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:17.882085 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:17.904239 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1189/2362] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:20:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:17.908724 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67549532-d166-4272-b05b-d27ec5d890fd service neutron] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:17.919271 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67549532-d166-4272-b05b-d27ec5d890fd service neutron] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:17.927267 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921707ab-17a9-4aeb-a2ba-7926e6d46b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:17.928034 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921707ab-17a9-4aeb-a2ba-7926e6d46b8c admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:17.928228 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921707ab-17a9-4aeb-a2ba-7926e6d46b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:17.928542 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921707ab-17a9-4aeb-a2ba-7926e6d46b8c admin admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:17.929337 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921707ab-17a9-4aeb-a2ba-7926e6d46b8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:17.931247 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921707ab-17a9-4aeb-a2ba-7926e6d46b8c admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:17.959986 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1174/2363] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:20:17 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:20:17.962056 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f651cc-7028-402d-8c89-ea03c228169a None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:17.974275 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f651cc-7028-402d-8c89-ea03c228169a None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:18.032288 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33844361-093b-491e-bc3c-f1d0501423c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:18.033059 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33844361-093b-491e-bc3c-f1d0501423c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:18.033257 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33844361-093b-491e-bc3c-f1d0501423c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:18.033528 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33844361-093b-491e-bc3c-f1d0501423c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:18.034237 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33844361-093b-491e-bc3c-f1d0501423c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:18.036154 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33844361-093b-491e-bc3c-f1d0501423c3 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:18.057085 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1190/2364] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:20:17 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:20:18.061488 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921707ab-17a9-4aeb-a2ba-7926e6d46b8c admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:18.077529 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921707ab-17a9-4aeb-a2ba-7926e6d46b8c admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:18.084855 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ccb841-daa2-46c6-8816-75b8243ccd98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:18.085222 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ccb841-daa2-46c6-8816-75b8243ccd98 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:18.085504 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ccb841-daa2-46c6-8816-75b8243ccd98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:18.085780 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ccb841-daa2-46c6-8816-75b8243ccd98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:18.086515 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ccb841-daa2-46c6-8816-75b8243ccd98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:18.093314 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ccb841-daa2-46c6-8816-75b8243ccd98 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:18.121319 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1175/2365] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:20:18.125642 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33844361-093b-491e-bc3c-f1d0501423c3 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:18.140349 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33844361-093b-491e-bc3c-f1d0501423c3 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:18.145482 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab10de3-8a51-4746-946b-d0c3ff097ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:18.146393 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab10de3-8a51-4746-946b-d0c3ff097ec2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:18.146680 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab10de3-8a51-4746-946b-d0c3ff097ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:18.146958 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab10de3-8a51-4746-946b-d0c3ff097ec2 admin admin] PATH_INFO: `/v3/projects/11a9cb779bcd494f9d6e4b9d98a2d883/users/4e1cacb3d3f24cec84cb6eab9a89a911/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:18.163644 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab10de3-8a51-4746-946b-d0c3ff097ec2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11a9cb779bcd494f9d6e4b9d98a2d883, user_id=4e1cacb3d3f24cec84cb6eab9a89a911, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:18.166323 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab10de3-8a51-4746-946b-d0c3ff097ec2 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:18.180145 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1191/2366] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:20:18 2022] PUT /identity/v3/projects/11a9cb779bcd494f9d6e4b9d98a2d883/users/4e1cacb3d3f24cec84cb6eab9a89a911/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:18.184538 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ccb841-daa2-46c6-8816-75b8243ccd98 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:18.194890 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ccb841-daa2-46c6-8816-75b8243ccd98 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:18.260121 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555c5951-6635-4a03-a64f-ad0b040e5401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:18.260833 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c5951-6635-4a03-a64f-ad0b040e5401 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:18.261115 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c5951-6635-4a03-a64f-ad0b040e5401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:18.261389 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c5951-6635-4a03-a64f-ad0b040e5401 admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:18.262799 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555c5951-6635-4a03-a64f-ad0b040e5401 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:18.264523 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555c5951-6635-4a03-a64f-ad0b040e5401 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:18.275040 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1176/2367] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:20:18.279845 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab10de3-8a51-4746-946b-d0c3ff097ec2 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:18.290995 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab10de3-8a51-4746-946b-d0c3ff097ec2 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:18.295871 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf003ada-0bc0-4c2b-96cb-6132e224b89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:18.296904 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf003ada-0bc0-4c2b-96cb-6132e224b89f admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:18.297185 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf003ada-0bc0-4c2b-96cb-6132e224b89f admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:18.297454 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf003ada-0bc0-4c2b-96cb-6132e224b89f admin admin] PATH_INFO: `/v3/projects/11a9cb779bcd494f9d6e4b9d98a2d883/users/4e1cacb3d3f24cec84cb6eab9a89a911/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:18.299426 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf003ada-0bc0-4c2b-96cb-6132e224b89f admin admin] RBAC: Authorizing `identity:create_grant(project_id=11a9cb779bcd494f9d6e4b9d98a2d883, user_id=4e1cacb3d3f24cec84cb6eab9a89a911, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:18.302124 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf003ada-0bc0-4c2b-96cb-6132e224b89f admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:18.313526 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1192/2368] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:20:18 2022] PUT /identity/v3/projects/11a9cb779bcd494f9d6e4b9d98a2d883/users/4e1cacb3d3f24cec84cb6eab9a89a911/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:20:22.823906 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a117af-7e41-4321-b07c-1b03fb813c0d None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:22.825538 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a117af-7e41-4321-b07c-1b03fb813c0d None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:22.826475 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a117af-7e41-4321-b07c-1b03fb813c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:22.858266 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-55a117af-7e41-4321-b07c-1b03fb813c0d None None] MFA Rules not processed for user `4e1cacb3d3f24cec84cb6eab9a89a911`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:22.859786 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-55a117af-7e41-4321-b07c-1b03fb813c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:22.905591 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:22.959253 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1177/2369] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:20:22 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:22.974115 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf003ada-0bc0-4c2b-96cb-6132e224b89f admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:22.976408 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-cf003ada-0bc0-4c2b-96cb-6132e224b89f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:23.061954 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf003ada-0bc0-4c2b-96cb-6132e224b89f admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:23.067480 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b009a-b5b0-4274-af0f-b504f457f479 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cee106502e54829ad802ee41c9165fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:23.068415 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b009a-b5b0-4274-af0f-b504f457f479 service nova] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:23.068845 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b009a-b5b0-4274-af0f-b504f457f479 service nova] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:23.069039 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b009a-b5b0-4274-af0f-b504f457f479 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:23.113058 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:23.142739 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3b009a-b5b0-4274-af0f-b504f457f479 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:23.144378 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3b009a-b5b0-4274-af0f-b504f457f479 service nova] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:23.155329 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1193/2370] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:20:22 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:20:24.515680 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b59d68-1ba2-4099-b176-9db2e0f76da8 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:24.516129 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b59d68-1ba2-4099-b176-9db2e0f76da8 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:24.516263 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b59d68-1ba2-4099-b176-9db2e0f76da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:24.548325 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-41b59d68-1ba2-4099-b176-9db2e0f76da8 None None] MFA Rules not processed for user `d8ff165426d14c09a7221a910ca7febc`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:24.549565 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-41b59d68-1ba2-4099-b176-9db2e0f76da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:24.556422 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1178/2371] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:20:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:20:33.149444 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=11 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:34.541731 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=16 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:39.106917 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121b657-dd31-4169-b8bb-f91af17b5767 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:39.107501 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121b657-dd31-4169-b8bb-f91af17b5767 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:39.107695 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121b657-dd31-4169-b8bb-f91af17b5767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:39.124943 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-4121b657-dd31-4169-b8bb-f91af17b5767 None None] MFA Rules not processed for user `68c4b81f2f704a9bbe15fd0f3326bb3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:39.126175 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-4121b657-dd31-4169-b8bb-f91af17b5767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:39.184181 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1194/2372] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:20:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:49.177312 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=25 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:49.642166 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0322a3a-55ea-453b-8215-5246150a1f7b None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:49.642665 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0322a3a-55ea-453b-8215-5246150a1f7b None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:49.643086 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0322a3a-55ea-453b-8215-5246150a1f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:49.662112 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-a0322a3a-55ea-453b-8215-5246150a1f7b None None] MFA Rules not processed for user `8c0f131484cb48d289cae1f473ec2fbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:49.663307 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-a0322a3a-55ea-453b-8215-5246150a1f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:49.717124 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1179/2373] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Jun 20 06:20:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:20:49.763263 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121b657-dd31-4169-b8bb-f91af17b5767 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:49.764673 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-4121b657-dd31-4169-b8bb-f91af17b5767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:49.850854 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121b657-dd31-4169-b8bb-f91af17b5767 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:49.859896 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e9492-648e-4e00-b4b6-ef5ae5699c4b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b490cf71bc468da5ea2be04239e33f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:49.861016 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e9492-648e-4e00-b4b6-ef5ae5699c4b service swift] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:49.861519 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e9492-648e-4e00-b4b6-ef5ae5699c4b service swift] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:49.861932 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e9492-648e-4e00-b4b6-ef5ae5699c4b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:49.877084 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844e9492-648e-4e00-b4b6-ef5ae5699c4b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:49.881078 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844e9492-648e-4e00-b4b6-ef5ae5699c4b service swift] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:49.893592 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1195/2374] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Jun 20 06:20:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 06:20:59.710558 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=25 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:59.890219 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=32 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:05.025505 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0322a3a-55ea-453b-8215-5246150a1f7b None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:05.080142 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0322a3a-55ea-453b-8215-5246150a1f7b None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:05.083669 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff4e87-f4df-4d3c-bf5e-b107fb5a16d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:05.084308 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff4e87-f4df-4d3c-bf5e-b107fb5a16d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:05.084587 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff4e87-f4df-4d3c-bf5e-b107fb5a16d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:05.084889 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff4e87-f4df-4d3c-bf5e-b107fb5a16d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:05.086679 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-beff4e87-f4df-4d3c-bf5e-b107fb5a16d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:05.100233 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beff4e87-f4df-4d3c-bf5e-b107fb5a16d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:05.101443 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beff4e87-f4df-4d3c-bf5e-b107fb5a16d7 service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:05.113288 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1180/2375] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:21:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:21:09.207191 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81f5f0-6acb-4605-b90a-3e0974528b85 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:09.207658 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81f5f0-6acb-4605-b90a-3e0974528b85 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:09.207762 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81f5f0-6acb-4605-b90a-3e0974528b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:09.226690 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-8c81f5f0-6acb-4605-b90a-3e0974528b85 None None] MFA Rules not processed for user `8c0f131484cb48d289cae1f473ec2fbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:21:09.227898 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-8c81f5f0-6acb-4605-b90a-3e0974528b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:09.235506 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1196/2376] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Jun 20 06:21:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:21:09.251508 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff4e87-f4df-4d3c-bf5e-b107fb5a16d7 service neutron] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:09.262684 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff4e87-f4df-4d3c-bf5e-b107fb5a16d7 service neutron] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:09.268441 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420dc5b-2595-4d68-a074-5cfb14b6e202 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b490cf71bc468da5ea2be04239e33f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:09.269132 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420dc5b-2595-4d68-a074-5cfb14b6e202 service swift] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:09.269411 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420dc5b-2595-4d68-a074-5cfb14b6e202 service swift] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:09.269680 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420dc5b-2595-4d68-a074-5cfb14b6e202 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:09.278115 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3420dc5b-2595-4d68-a074-5cfb14b6e202 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:09.280330 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3420dc5b-2595-4d68-a074-5cfb14b6e202 service swift] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:09.288819 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1181/2377] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Jun 20 06:21:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 06:21:19.221328 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:19.285306 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=32 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:20.414187 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c81f5f0-6acb-4605-b90a-3e0974528b85 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:20.427746 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c81f5f0-6acb-4605-b90a-3e0974528b85 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:20.434869 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d641e4-7d85-4ac9-b850-80d8324ff616 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cee106502e54829ad802ee41c9165fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:20.434869 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d641e4-7d85-4ac9-b850-80d8324ff616 service nova] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:20.434869 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d641e4-7d85-4ac9-b850-80d8324ff616 service nova] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:20.435251 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d641e4-7d85-4ac9-b850-80d8324ff616 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:20.437772 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-99d641e4-7d85-4ac9-b850-80d8324ff616 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:20.520511 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d641e4-7d85-4ac9-b850-80d8324ff616 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:20.522074 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d641e4-7d85-4ac9-b850-80d8324ff616 service nova] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:20.540668 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1197/2378] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:21:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:21:21.324237 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420dc5b-2595-4d68-a074-5cfb14b6e202 service swift] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:21.339905 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420dc5b-2595-4d68-a074-5cfb14b6e202 service swift] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:21.346649 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2985dc-dfd1-44f8-952d-071e12b14657 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cee106502e54829ad802ee41c9165fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:21.347291 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2985dc-dfd1-44f8-952d-071e12b14657 service nova] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:21.347573 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2985dc-dfd1-44f8-952d-071e12b14657 service nova] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:21.347848 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2985dc-dfd1-44f8-952d-071e12b14657 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:21.349635 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-4a2985dc-dfd1-44f8-952d-071e12b14657 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:21.429472 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2985dc-dfd1-44f8-952d-071e12b14657 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:21.431016 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2985dc-dfd1-44f8-952d-071e12b14657 service nova] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:21.449759 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1182/2379] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:21:21 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:21:27.871362 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d641e4-7d85-4ac9-b850-80d8324ff616 service nova] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:27.881353 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d641e4-7d85-4ac9-b850-80d8324ff616 service nova] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:27.885658 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4776755-8578-4850-841b-529d773111ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:27.886208 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4776755-8578-4850-841b-529d773111ce service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:27.886487 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4776755-8578-4850-841b-529d773111ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:27.886767 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4776755-8578-4850-841b-529d773111ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:27.899314 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4776755-8578-4850-841b-529d773111ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:27.901088 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4776755-8578-4850-841b-529d773111ce service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:27.912032 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1198/2380] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:21:27 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:21:30.093940 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2985dc-dfd1-44f8-952d-071e12b14657 service nova] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:30.103724 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2985dc-dfd1-44f8-952d-071e12b14657 service nova] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:30.108278 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db8ed8-5a07-4c83-b297-1a82bea05846 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:30.109109 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db8ed8-5a07-4c83-b297-1a82bea05846 service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:30.109388 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db8ed8-5a07-4c83-b297-1a82bea05846 service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:30.109667 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db8ed8-5a07-4c83-b297-1a82bea05846 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:30.111515 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-e4db8ed8-5a07-4c83-b297-1a82bea05846 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:30.121983 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4db8ed8-5a07-4c83-b297-1a82bea05846 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:30.124454 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4db8ed8-5a07-4c83-b297-1a82bea05846 service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:30.133949 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1183/2381] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:21:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:21:32.863381 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360c15a-97de-43fe-a284-94b767cfe27e None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:32.863875 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360c15a-97de-43fe-a284-94b767cfe27e None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:32.863875 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360c15a-97de-43fe-a284-94b767cfe27e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:32.883647 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-e360c15a-97de-43fe-a284-94b767cfe27e None None] MFA Rules not processed for user `8c0f131484cb48d289cae1f473ec2fbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:21:32.885022 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-e360c15a-97de-43fe-a284-94b767cfe27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:32.893841 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1199/2382] 10.222.0.39 () {58 vars in 967 bytes} [Mon Jun 20 06:21:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:21:32.906148 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db8ed8-5a07-4c83-b297-1a82bea05846 service neutron] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:32.918691 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db8ed8-5a07-4c83-b297-1a82bea05846 service neutron] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:32.923862 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088fb111-1221-4485-a009-4062928ffd18 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b490cf71bc468da5ea2be04239e33f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:32.924505 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088fb111-1221-4485-a009-4062928ffd18 service swift] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:32.924825 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088fb111-1221-4485-a009-4062928ffd18 service swift] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:32.925108 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088fb111-1221-4485-a009-4062928ffd18 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:32.933444 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088fb111-1221-4485-a009-4062928ffd18 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:32.935018 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088fb111-1221-4485-a009-4062928ffd18 service swift] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:32.943963 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1184/2383] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Jun 20 06:21:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 06:21:42.878363 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=50 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:42.940672 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=53 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:56.781410 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e360c15a-97de-43fe-a284-94b767cfe27e None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:56.790865 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e360c15a-97de-43fe-a284-94b767cfe27e None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:56.794507 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cff74f-c624-4fb7-85fd-18b2adf80eee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:56.795143 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cff74f-c624-4fb7-85fd-18b2adf80eee service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:56.795455 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cff74f-c624-4fb7-85fd-18b2adf80eee service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:56.795733 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cff74f-c624-4fb7-85fd-18b2adf80eee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:56.797762 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-c8cff74f-c624-4fb7-85fd-18b2adf80eee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:56.861977 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cff74f-c624-4fb7-85fd-18b2adf80eee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:56.863405 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cff74f-c624-4fb7-85fd-18b2adf80eee service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:56.872990 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1200/2384] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:21:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:22:00.175979 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088fb111-1221-4485-a009-4062928ffd18 service swift] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:00.178949 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-088fb111-1221-4485-a009-4062928ffd18 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:00.195232 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088fb111-1221-4485-a009-4062928ffd18 service swift] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:00.199926 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0a225-5643-4f14-9a97-df9523c43a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:00.201072 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0a225-5643-4f14-9a97-df9523c43a07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:00.201363 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0a225-5643-4f14-9a97-df9523c43a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:00.201642 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0a225-5643-4f14-9a97-df9523c43a07 admin admin] PATH_INFO: `/v3/users/b511b8f2ba394fa9b276f76a52247184` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:00.203422 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca0a225-5643-4f14-9a97-df9523c43a07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b511b8f2ba394fa9b276f76a52247184)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:00.205410 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca0a225-5643-4f14-9a97-df9523c43a07 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:00.261769 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-2ca0a225-5643-4f14-9a97-df9523c43a07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b511b8f2ba394fa9b276f76a52247184'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:00.269220 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-2ca0a225-5643-4f14-9a97-df9523c43a07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b511b8f2ba394fa9b276f76a52247184'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:00.269825 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-2ca0a225-5643-4f14-9a97-df9523c43a07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b511b8f2ba394fa9b276f76a52247184'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:00.270412 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-2ca0a225-5643-4f14-9a97-df9523c43a07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b511b8f2ba394fa9b276f76a52247184'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:00.282787 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-2ca0a225-5643-4f14-9a97-df9523c43a07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b511b8f2ba394fa9b276f76a52247184'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:00.295193 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1185/2385] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:22:00 2022] DELETE /identity/v3/users/b511b8f2ba394fa9b276f76a52247184 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:00.478842 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cff74f-c624-4fb7-85fd-18b2adf80eee service neutron] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:00.489952 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cff74f-c624-4fb7-85fd-18b2adf80eee service neutron] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:00.549421 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e973b45e-c178-4d6a-ba8c-7f9dede31200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:00.550294 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973b45e-c178-4d6a-ba8c-7f9dede31200 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:00.550584 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973b45e-c178-4d6a-ba8c-7f9dede31200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:00.550862 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973b45e-c178-4d6a-ba8c-7f9dede31200 admin admin] PATH_INFO: `/v3/projects/873857d11992429d8f3a064665c1fc3e` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:00.552079 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e973b45e-c178-4d6a-ba8c-7f9dede31200 admin admin] RBAC: Authorizing `identity:delete_project(project_id=873857d11992429d8f3a064665c1fc3e)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:00.554028 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e973b45e-c178-4d6a-ba8c-7f9dede31200 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:00.600201 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e973b45e-c178-4d6a-ba8c-7f9dede31200 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '873857d11992429d8f3a064665c1fc3e', 'request_id': 'req-e973b45e-c178-4d6a-ba8c-7f9dede31200'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:00.606087 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e973b45e-c178-4d6a-ba8c-7f9dede31200 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '873857d11992429d8f3a064665c1fc3e', 'request_id': 'req-e973b45e-c178-4d6a-ba8c-7f9dede31200'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:00.613259 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e973b45e-c178-4d6a-ba8c-7f9dede31200 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '873857d11992429d8f3a064665c1fc3e', 'request_id': 'req-e973b45e-c178-4d6a-ba8c-7f9dede31200'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:00.623975 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e973b45e-c178-4d6a-ba8c-7f9dede31200 admin admin] The token cache is being invalidate because project 873857d11992429d8f3a064665c1fc3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:22:00.624831 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e973b45e-c178-4d6a-ba8c-7f9dede31200 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:00.625463 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e973b45e-c178-4d6a-ba8c-7f9dede31200 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:00.626993 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1201/2386] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:22:00 2022] DELETE /identity/v3/projects/873857d11992429d8f3a064665c1fc3e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:00.631916 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e977d-377c-4a3f-b9f4-c7c0b50cecbc None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:00.632228 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e977d-377c-4a3f-b9f4-c7c0b50cecbc None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:00.632506 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e977d-377c-4a3f-b9f4-c7c0b50cecbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:00.650988 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-0b9e977d-377c-4a3f-b9f4-c7c0b50cecbc None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:00.652171 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-0b9e977d-377c-4a3f-b9f4-c7c0b50cecbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:00.709925 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1186/2387] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:22:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:22:00.717778 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb2564-4367-4ad8-ba73-009c57375654 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:00.718197 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb2564-4367-4ad8-ba73-009c57375654 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:00.718527 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb2564-4367-4ad8-ba73-009c57375654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:00.737211 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-7dfb2564-4367-4ad8-ba73-009c57375654 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:00.738438 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-7dfb2564-4367-4ad8-ba73-009c57375654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:00.755494 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1202/2388] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:22:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:22:00.760476 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e977d-377c-4a3f-b9f4-c7c0b50cecbc None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:00.770802 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e977d-377c-4a3f-b9f4-c7c0b50cecbc None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:00.775354 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d33963-e5a2-45e8-8c2a-05569b11573d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:00.776008 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d33963-e5a2-45e8-8c2a-05569b11573d admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:00.776292 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d33963-e5a2-45e8-8c2a-05569b11573d admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:00.776569 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d33963-e5a2-45e8-8c2a-05569b11573d admin admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:00.777338 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d33963-e5a2-45e8-8c2a-05569b11573d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:22:00.777647 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d33963-e5a2-45e8-8c2a-05569b11573d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:00.779290 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d33963-e5a2-45e8-8c2a-05569b11573d admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:00.790964 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1187/2389] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:22:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:22:00.795172 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb2564-4367-4ad8-ba73-009c57375654 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:00.805094 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb2564-4367-4ad8-ba73-009c57375654 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:00.809785 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a42a18-3a67-4511-9022-74728693cfcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:00.810436 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a42a18-3a67-4511-9022-74728693cfcf admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:00.810722 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a42a18-3a67-4511-9022-74728693cfcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:00.811005 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a42a18-3a67-4511-9022-74728693cfcf admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:00.812343 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a42a18-3a67-4511-9022-74728693cfcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:00.814616 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a42a18-3a67-4511-9022-74728693cfcf admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:00.828905 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:00.842794 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1203/2390] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:22:00 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:22:00.846840 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d33963-e5a2-45e8-8c2a-05569b11573d admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:00.857424 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d33963-e5a2-45e8-8c2a-05569b11573d admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:00.916200 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a799e2dd-8a40-4e5a-b3c2-927e55a4843b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:00.916898 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799e2dd-8a40-4e5a-b3c2-927e55a4843b admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:00.917209 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799e2dd-8a40-4e5a-b3c2-927e55a4843b admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:00.917485 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799e2dd-8a40-4e5a-b3c2-927e55a4843b admin admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:00.918181 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a799e2dd-8a40-4e5a-b3c2-927e55a4843b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:00.920103 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a799e2dd-8a40-4e5a-b3c2-927e55a4843b admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:00.927762 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:00.942592 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1188/2391] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:22:00 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:22:00.946696 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a42a18-3a67-4511-9022-74728693cfcf admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:00.958721 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a42a18-3a67-4511-9022-74728693cfcf admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:00.963358 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b6d50-e224-4b51-857d-1be5720b012b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:00.964014 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b6d50-e224-4b51-857d-1be5720b012b admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:00.964293 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b6d50-e224-4b51-857d-1be5720b012b admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:00.964564 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b6d50-e224-4b51-857d-1be5720b012b admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:00.965321 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1b6d50-e224-4b51-857d-1be5720b012b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:00.966897 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1b6d50-e224-4b51-857d-1be5720b012b admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:00.977524 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1204/2392] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:22:00.981832 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a799e2dd-8a40-4e5a-b3c2-927e55a4843b admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:00.992507 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a799e2dd-8a40-4e5a-b3c2-927e55a4843b admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:00.997122 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4998d06e-ec35-45f9-b07f-a461b398e454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:00.997773 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998d06e-ec35-45f9-b07f-a461b398e454 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:00.998055 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998d06e-ec35-45f9-b07f-a461b398e454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:00.998331 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998d06e-ec35-45f9-b07f-a461b398e454 admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:00.999059 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4998d06e-ec35-45f9-b07f-a461b398e454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:01.001287 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4998d06e-ec35-45f9-b07f-a461b398e454 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:01.011123 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1189/2393] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:22:01.015447 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b6d50-e224-4b51-857d-1be5720b012b admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:01.025277 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b6d50-e224-4b51-857d-1be5720b012b admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:01.030026 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7defb87-7592-4adc-a037-2d1803cde43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:01.030931 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7defb87-7592-4adc-a037-2d1803cde43a admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:01.031206 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7defb87-7592-4adc-a037-2d1803cde43a admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:01.031482 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7defb87-7592-4adc-a037-2d1803cde43a admin admin] PATH_INFO: `/v3/projects/52e3579772e64b209ed7a6dfae27e9a3/users/4bfe042445a640eb9259b532d1a6c6a0/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:01.049067 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7defb87-7592-4adc-a037-2d1803cde43a admin admin] RBAC: Authorizing `identity:create_grant(project_id=52e3579772e64b209ed7a6dfae27e9a3, user_id=4bfe042445a640eb9259b532d1a6c6a0, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:01.051693 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7defb87-7592-4adc-a037-2d1803cde43a admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:01.065697 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1205/2394] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:22:01 2022] PUT /identity/v3/projects/52e3579772e64b209ed7a6dfae27e9a3/users/4bfe042445a640eb9259b532d1a6c6a0/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:22:01.076655 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5217be-f58e-426a-8190-e7e603e37101 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:01.076992 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5217be-f58e-426a-8190-e7e603e37101 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:01.077275 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5217be-f58e-426a-8190-e7e603e37101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:01.103995 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-2f5217be-f58e-426a-8190-e7e603e37101 None None] MFA Rules not processed for user `4bfe042445a640eb9259b532d1a6c6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:01.105601 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-2f5217be-f58e-426a-8190-e7e603e37101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:01.174210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1190/2395] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:22:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:22:01.187773 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7defb87-7592-4adc-a037-2d1803cde43a admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:01.190999 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-a7defb87-7592-4adc-a037-2d1803cde43a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:01.267020 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7defb87-7592-4adc-a037-2d1803cde43a admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:01.272690 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e9557-060e-4993-85f9-56c0f7673f23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cee106502e54829ad802ee41c9165fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:01.273355 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e9557-060e-4993-85f9-56c0f7673f23 service nova] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:01.273634 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e9557-060e-4993-85f9-56c0f7673f23 service nova] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:01.273906 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e9557-060e-4993-85f9-56c0f7673f23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:01.282395 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2e9557-060e-4993-85f9-56c0f7673f23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:01.283959 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2e9557-060e-4993-85f9-56c0f7673f23 service nova] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:01.292628 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1206/2396] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:22:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:22:08.192151 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5217be-f58e-426a-8190-e7e603e37101 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:08.252335 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5217be-f58e-426a-8190-e7e603e37101 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:08.257019 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d3ea5-2133-4065-af59-c773fb902a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:08.257873 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d3ea5-2133-4065-af59-c773fb902a57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:08.258257 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d3ea5-2133-4065-af59-c773fb902a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:08.258539 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d3ea5-2133-4065-af59-c773fb902a57 admin admin] PATH_INFO: `/v3/users/4bfe042445a640eb9259b532d1a6c6a0` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:08.259791 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d3ea5-2133-4065-af59-c773fb902a57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bfe042445a640eb9259b532d1a6c6a0)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:08.261808 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d3ea5-2133-4065-af59-c773fb902a57 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:08.307352 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-067d3ea5-2133-4065-af59-c773fb902a57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bfe042445a640eb9259b532d1a6c6a0'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:08.314013 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-067d3ea5-2133-4065-af59-c773fb902a57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bfe042445a640eb9259b532d1a6c6a0'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:08.314780 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-067d3ea5-2133-4065-af59-c773fb902a57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bfe042445a640eb9259b532d1a6c6a0'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:08.315417 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-067d3ea5-2133-4065-af59-c773fb902a57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bfe042445a640eb9259b532d1a6c6a0'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:08.326190 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:08.327328 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-067d3ea5-2133-4065-af59-c773fb902a57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bfe042445a640eb9259b532d1a6c6a0'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:08.341896 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1191/2397] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:22:08 2022] DELETE /identity/v3/users/4bfe042445a640eb9259b532d1a6c6a0 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:08.346398 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653edb37-cba9-4075-89f9-409e62e8fb71 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:08.346871 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653edb37-cba9-4075-89f9-409e62e8fb71 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:08.346991 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653edb37-cba9-4075-89f9-409e62e8fb71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:08.365520 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-653edb37-cba9-4075-89f9-409e62e8fb71 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:08.366728 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-653edb37-cba9-4075-89f9-409e62e8fb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:08.433716 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1207/2398] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:22:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:22:08.444908 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d3ea5-2133-4065-af59-c773fb902a57 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:08.446414 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-067d3ea5-2133-4065-af59-c773fb902a57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:08.510547 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d3ea5-2133-4065-af59-c773fb902a57 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:08.514260 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a591554-bdcb-47d6-b47f-0dc7138a7223 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:08.514913 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a591554-bdcb-47d6-b47f-0dc7138a7223 service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:08.515198 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a591554-bdcb-47d6-b47f-0dc7138a7223 service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:08.515477 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a591554-bdcb-47d6-b47f-0dc7138a7223 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:08.525617 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a591554-bdcb-47d6-b47f-0dc7138a7223 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:08.527038 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a591554-bdcb-47d6-b47f-0dc7138a7223 service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:08.536670 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1192/2399] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:22:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:22:08.560189 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0cc04f-6590-4798-9d50-ce17a21b7238 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:08.560480 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0cc04f-6590-4798-9d50-ce17a21b7238 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:08.560795 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0cc04f-6590-4798-9d50-ce17a21b7238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:08.578901 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-7f0cc04f-6590-4798-9d50-ce17a21b7238 None None] MFA Rules not processed for user `b19967e2b09342e9ac006151002bf71a`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:08.580071 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-7f0cc04f-6590-4798-9d50-ce17a21b7238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:08.624124 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:08.639703 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1208/2400] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:22:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:22:08.821434 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a591554-bdcb-47d6-b47f-0dc7138a7223 service neutron] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:08.822928 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-9a591554-bdcb-47d6-b47f-0dc7138a7223 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:08.837749 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a591554-bdcb-47d6-b47f-0dc7138a7223 service neutron] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:08.848314 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c7b7d-8965-480e-9362-ea86ce7b5e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:08.850692 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c7b7d-8965-480e-9362-ea86ce7b5e4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:08.850984 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c7b7d-8965-480e-9362-ea86ce7b5e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:08.851280 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c7b7d-8965-480e-9362-ea86ce7b5e4a admin admin] PATH_INFO: `/v3/projects/52e3579772e64b209ed7a6dfae27e9a3` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:08.852525 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c7b7d-8965-480e-9362-ea86ce7b5e4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=52e3579772e64b209ed7a6dfae27e9a3)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:08.854541 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c7b7d-8965-480e-9362-ea86ce7b5e4a admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:08.909788 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-f77c7b7d-8965-480e-9362-ea86ce7b5e4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52e3579772e64b209ed7a6dfae27e9a3', 'request_id': 'req-f77c7b7d-8965-480e-9362-ea86ce7b5e4a'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:08.917889 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-f77c7b7d-8965-480e-9362-ea86ce7b5e4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52e3579772e64b209ed7a6dfae27e9a3', 'request_id': 'req-f77c7b7d-8965-480e-9362-ea86ce7b5e4a'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:08.923557 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-f77c7b7d-8965-480e-9362-ea86ce7b5e4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52e3579772e64b209ed7a6dfae27e9a3', 'request_id': 'req-f77c7b7d-8965-480e-9362-ea86ce7b5e4a'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:08.935303 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-f77c7b7d-8965-480e-9362-ea86ce7b5e4a admin admin] The token cache is being invalidate because project 52e3579772e64b209ed7a6dfae27e9a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:22:08.935591 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-f77c7b7d-8965-480e-9362-ea86ce7b5e4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:08.936983 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-f77c7b7d-8965-480e-9362-ea86ce7b5e4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:08.938540 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1193/2401] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:22:08 2022] DELETE /identity/v3/projects/52e3579772e64b209ed7a6dfae27e9a3 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:08.943584 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac816e8b-3dac-470c-a31c-f083d256cb2b None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:08.943869 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac816e8b-3dac-470c-a31c-f083d256cb2b None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:08.944145 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac816e8b-3dac-470c-a31c-f083d256cb2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:08.963264 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-ac816e8b-3dac-470c-a31c-f083d256cb2b None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:08.964470 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-ac816e8b-3dac-470c-a31c-f083d256cb2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:08.973111 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c7b7d-8965-480e-9362-ea86ce7b5e4a admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:08.975673 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-f77c7b7d-8965-480e-9362-ea86ce7b5e4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:09.028581 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1209/2402] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:22:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:22:09.035053 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c7b7d-8965-480e-9362-ea86ce7b5e4a admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:09.037009 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15955b-bae0-40b1-b4e1-f3b84ea096bc None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:09.037299 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15955b-bae0-40b1-b4e1-f3b84ea096bc None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:09.037582 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15955b-bae0-40b1-b4e1-f3b84ea096bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:09.040063 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e1e56-4ca5-4d2e-bfff-0ec3e1bf52ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:09.040720 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e1e56-4ca5-4d2e-bfff-0ec3e1bf52ec service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:09.041025 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e1e56-4ca5-4d2e-bfff-0ec3e1bf52ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:09.041303 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e1e56-4ca5-4d2e-bfff-0ec3e1bf52ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:09.043094 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-d49e1e56-4ca5-4d2e-bfff-0ec3e1bf52ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:09.053964 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49e1e56-4ca5-4d2e-bfff-0ec3e1bf52ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:09.055153 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-0d15955b-bae0-40b1-b4e1-f3b84ea096bc None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:09.055385 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49e1e56-4ca5-4d2e-bfff-0ec3e1bf52ec service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:09.056327 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-0d15955b-bae0-40b1-b4e1-f3b84ea096bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:09.063713 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1194/2403] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:22:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:22:09.064729 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1210/2404] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:22:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:22:09.068619 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e1e56-4ca5-4d2e-bfff-0ec3e1bf52ec service neutron] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:09.080118 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e1e56-4ca5-4d2e-bfff-0ec3e1bf52ec service neutron] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:09.085831 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f47930-6972-4a27-bc69-7c1e685e590a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:09.086506 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f47930-6972-4a27-bc69-7c1e685e590a admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:09.086791 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f47930-6972-4a27-bc69-7c1e685e590a admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:09.087048 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f47930-6972-4a27-bc69-7c1e685e590a admin admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:09.087773 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f47930-6972-4a27-bc69-7c1e685e590a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:22:09.088081 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f47930-6972-4a27-bc69-7c1e685e590a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:09.089702 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f47930-6972-4a27-bc69-7c1e685e590a admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:09.110937 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1195/2405] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:22:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:22:09.112417 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d15955b-bae0-40b1-b4e1-f3b84ea096bc None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:09.123035 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d15955b-bae0-40b1-b4e1-f3b84ea096bc None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:09.127760 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75edaa1-e530-4470-92e9-51c1ba9ef47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:09.128423 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75edaa1-e530-4470-92e9-51c1ba9ef47d admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:09.128723 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75edaa1-e530-4470-92e9-51c1ba9ef47d admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:09.129009 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75edaa1-e530-4470-92e9-51c1ba9ef47d admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:09.129739 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75edaa1-e530-4470-92e9-51c1ba9ef47d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:09.131660 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75edaa1-e530-4470-92e9-51c1ba9ef47d admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:09.161198 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1211/2406] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:22:09 2022] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:22:09.166276 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f47930-6972-4a27-bc69-7c1e685e590a admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:09.171612 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:09.177483 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f47930-6972-4a27-bc69-7c1e685e590a admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:09.237036 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786284aa-00b3-4c2b-acca-9d142bd2a2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:09.237737 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786284aa-00b3-4c2b-acca-9d142bd2a2b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:09.237971 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786284aa-00b3-4c2b-acca-9d142bd2a2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:09.238243 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786284aa-00b3-4c2b-acca-9d142bd2a2b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:09.238944 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786284aa-00b3-4c2b-acca-9d142bd2a2b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:09.241140 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786284aa-00b3-4c2b-acca-9d142bd2a2b1 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:09.261524 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1196/2407] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:22:09 2022] POST /identity/v3/users => generated 284 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:22:09.265327 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75edaa1-e530-4470-92e9-51c1ba9ef47d admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:09.277246 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75edaa1-e530-4470-92e9-51c1ba9ef47d admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:09.291882 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4242971-114c-400d-8348-8a7d435e7c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:09.292594 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4242971-114c-400d-8348-8a7d435e7c93 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:09.292916 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4242971-114c-400d-8348-8a7d435e7c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:09.293194 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4242971-114c-400d-8348-8a7d435e7c93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:09.293928 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4242971-114c-400d-8348-8a7d435e7c93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:09.295534 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4242971-114c-400d-8348-8a7d435e7c93 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:09.307038 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1212/2408] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:22:09 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:22:09.311234 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786284aa-00b3-4c2b-acca-9d142bd2a2b1 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:09.322807 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786284aa-00b3-4c2b-acca-9d142bd2a2b1 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:09.327523 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db881d-7edb-468b-aeb8-7776fc232bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:09.328184 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db881d-7edb-468b-aeb8-7776fc232bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:09.328467 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db881d-7edb-468b-aeb8-7776fc232bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:09.328769 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db881d-7edb-468b-aeb8-7776fc232bf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:09.329499 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1db881d-7edb-468b-aeb8-7776fc232bf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:09.331155 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1db881d-7edb-468b-aeb8-7776fc232bf0 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:09.342178 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1197/2409] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:22:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:22:09.346060 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4242971-114c-400d-8348-8a7d435e7c93 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:09.357354 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4242971-114c-400d-8348-8a7d435e7c93 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:09.362580 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488bea4-7402-43b0-a5c2-dd56fad81790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:09.363467 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488bea4-7402-43b0-a5c2-dd56fad81790 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:09.363750 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488bea4-7402-43b0-a5c2-dd56fad81790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:09.364030 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488bea4-7402-43b0-a5c2-dd56fad81790 admin admin] PATH_INFO: `/v3/projects/4f404c28f48140928d0dcfc36f40bbd2/users/109300f9d3934849995424385964f78b/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:09.380106 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4488bea4-7402-43b0-a5c2-dd56fad81790 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f404c28f48140928d0dcfc36f40bbd2, user_id=109300f9d3934849995424385964f78b, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:09.383405 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4488bea4-7402-43b0-a5c2-dd56fad81790 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:09.397110 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1213/2410] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:22:09 2022] PUT /identity/v3/projects/4f404c28f48140928d0dcfc36f40bbd2/users/109300f9d3934849995424385964f78b/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:09.407271 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0011d-a08a-4253-895a-a0b46a004e68 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:09.407693 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0011d-a08a-4253-895a-a0b46a004e68 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:09.408000 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0011d-a08a-4253-895a-a0b46a004e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:09.441579 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-bda0011d-a08a-4253-895a-a0b46a004e68 None None] MFA Rules not processed for user `109300f9d3934849995424385964f78b`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:09.443899 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-bda0011d-a08a-4253-895a-a0b46a004e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:09.522921 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1198/2411] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:22:09 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:22:09.539962 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488bea4-7402-43b0-a5c2-dd56fad81790 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:09.539962 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-4488bea4-7402-43b0-a5c2-dd56fad81790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:09.573519 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0011d-a08a-4253-895a-a0b46a004e68 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:09.574930 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-bda0011d-a08a-4253-895a-a0b46a004e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:09.608693 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488bea4-7402-43b0-a5c2-dd56fad81790 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:09.612433 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c55770-9840-4d3a-b2a0-856040047add service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:09.613110 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c55770-9840-4d3a-b2a0-856040047add service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:09.613494 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c55770-9840-4d3a-b2a0-856040047add service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:09.613774 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c55770-9840-4d3a-b2a0-856040047add service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:09.623802 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c55770-9840-4d3a-b2a0-856040047add service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:09.625341 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c55770-9840-4d3a-b2a0-856040047add service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:09.635118 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1214/2412] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:22:09 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:22:09.652456 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0011d-a08a-4253-895a-a0b46a004e68 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:09.657611 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00de0cc-39b7-4edd-aa8b-1395e2693915 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f0f9248178049cda6571fa365a21225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:09.658265 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00de0cc-39b7-4edd-aa8b-1395e2693915 service placement] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:09.658551 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00de0cc-39b7-4edd-aa8b-1395e2693915 service placement] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:09.658832 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00de0cc-39b7-4edd-aa8b-1395e2693915 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:09.660647 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-b00de0cc-39b7-4edd-aa8b-1395e2693915 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:09.672768 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00de0cc-39b7-4edd-aa8b-1395e2693915 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:09.674354 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00de0cc-39b7-4edd-aa8b-1395e2693915 service placement] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:09.680732 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:09.686779 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1199/2413] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:22:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:22:12.264332 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c55770-9840-4d3a-b2a0-856040047add service cinder] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:12.265975 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-00c55770-9840-4d3a-b2a0-856040047add service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:12.307492 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:12.353492 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c55770-9840-4d3a-b2a0-856040047add service cinder] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:12.362864 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc7c9a-3727-4879-9f82-f0734685e5a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cee106502e54829ad802ee41c9165fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:12.363742 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc7c9a-3727-4879-9f82-f0734685e5a5 service nova] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:12.364088 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc7c9a-3727-4879-9f82-f0734685e5a5 service nova] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:12.365025 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc7c9a-3727-4879-9f82-f0734685e5a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:12.366802 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-b1cc7c9a-3727-4879-9f82-f0734685e5a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:12.381651 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cc7c9a-3727-4879-9f82-f0734685e5a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:12.385471 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cc7c9a-3727-4879-9f82-f0734685e5a5 service nova] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:12.399277 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1215/2414] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:22:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:22:18.655094 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00de0cc-39b7-4edd-aa8b-1395e2693915 service placement] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:18.717116 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00de0cc-39b7-4edd-aa8b-1395e2693915 service placement] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:18.721590 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a920343-fe53-4c55-88c5-f8329d5774cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:18.722454 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a920343-fe53-4c55-88c5-f8329d5774cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:18.722739 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a920343-fe53-4c55-88c5-f8329d5774cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:18.723014 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a920343-fe53-4c55-88c5-f8329d5774cc admin admin] PATH_INFO: `/v3/users/109300f9d3934849995424385964f78b` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:18.724233 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a920343-fe53-4c55-88c5-f8329d5774cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=109300f9d3934849995424385964f78b)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:18.726850 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a920343-fe53-4c55-88c5-f8329d5774cc admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:18.774526 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-1a920343-fe53-4c55-88c5-f8329d5774cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '109300f9d3934849995424385964f78b'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:18.781647 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-1a920343-fe53-4c55-88c5-f8329d5774cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '109300f9d3934849995424385964f78b'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:18.782254 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-1a920343-fe53-4c55-88c5-f8329d5774cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '109300f9d3934849995424385964f78b'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:18.782878 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-1a920343-fe53-4c55-88c5-f8329d5774cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '109300f9d3934849995424385964f78b'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:18.795248 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-1a920343-fe53-4c55-88c5-f8329d5774cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '109300f9d3934849995424385964f78b'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:18.807203 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1200/2415] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:22:18 2022] DELETE /identity/v3/users/109300f9d3934849995424385964f78b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:18.811679 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca3f8b-a636-40c0-aeac-1a453c785197 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:18.812143 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca3f8b-a636-40c0-aeac-1a453c785197 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:18.812241 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca3f8b-a636-40c0-aeac-1a453c785197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:18.830037 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-ccca3f8b-a636-40c0-aeac-1a453c785197 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:18.831350 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-ccca3f8b-a636-40c0-aeac-1a453c785197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:18.891258 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1216/2416] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:22:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:22:18.901407 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a920343-fe53-4c55-88c5-f8329d5774cc admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:18.902795 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-1a920343-fe53-4c55-88c5-f8329d5774cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:18.960118 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a920343-fe53-4c55-88c5-f8329d5774cc admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:18.963843 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc255ef9-09e5-4b69-a7fe-914d52183660 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:18.964563 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc255ef9-09e5-4b69-a7fe-914d52183660 service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:18.964878 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc255ef9-09e5-4b69-a7fe-914d52183660 service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:18.965153 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc255ef9-09e5-4b69-a7fe-914d52183660 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:18.974684 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc255ef9-09e5-4b69-a7fe-914d52183660 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:18.976054 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc255ef9-09e5-4b69-a7fe-914d52183660 service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:18.985888 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1201/2417] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:22:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:22:19.247787 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca3f8b-a636-40c0-aeac-1a453c785197 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:19.250183 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-ccca3f8b-a636-40c0-aeac-1a453c785197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:19.270483 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca3f8b-a636-40c0-aeac-1a453c785197 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:19.283873 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e736e-8576-4418-93da-01ddf4bf6cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:19.284779 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e736e-8576-4418-93da-01ddf4bf6cf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:19.285069 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e736e-8576-4418-93da-01ddf4bf6cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:19.285377 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e736e-8576-4418-93da-01ddf4bf6cf5 admin admin] PATH_INFO: `/v3/projects/4f404c28f48140928d0dcfc36f40bbd2` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:19.286574 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e736e-8576-4418-93da-01ddf4bf6cf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f404c28f48140928d0dcfc36f40bbd2)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:19.289308 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e736e-8576-4418-93da-01ddf4bf6cf5 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:19.343534 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-2d0e736e-8576-4418-93da-01ddf4bf6cf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f404c28f48140928d0dcfc36f40bbd2', 'request_id': 'req-2d0e736e-8576-4418-93da-01ddf4bf6cf5'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:19.349373 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-2d0e736e-8576-4418-93da-01ddf4bf6cf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f404c28f48140928d0dcfc36f40bbd2', 'request_id': 'req-2d0e736e-8576-4418-93da-01ddf4bf6cf5'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:19.357390 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-2d0e736e-8576-4418-93da-01ddf4bf6cf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f404c28f48140928d0dcfc36f40bbd2', 'request_id': 'req-2d0e736e-8576-4418-93da-01ddf4bf6cf5'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:19.369772 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-2d0e736e-8576-4418-93da-01ddf4bf6cf5 admin admin] The token cache is being invalidate because project 4f404c28f48140928d0dcfc36f40bbd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:22:19.370060 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-2d0e736e-8576-4418-93da-01ddf4bf6cf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:19.370693 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-2d0e736e-8576-4418-93da-01ddf4bf6cf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:19.372267 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1217/2418] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:22:19 2022] DELETE /identity/v3/projects/4f404c28f48140928d0dcfc36f40bbd2 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:19.377161 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2bc04-04ec-4fa1-8a2d-e68cfa630096 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:19.377467 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2bc04-04ec-4fa1-8a2d-e68cfa630096 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:19.377739 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2bc04-04ec-4fa1-8a2d-e68cfa630096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:19.395888 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-4af2bc04-04ec-4fa1-8a2d-e68cfa630096 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:19.397324 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-4af2bc04-04ec-4fa1-8a2d-e68cfa630096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:19.414211 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:19.459849 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1202/2419] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:22:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:22:19.467745 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4a88d-3046-4a45-8d49-18e61687cefe None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:19.468065 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4a88d-3046-4a45-8d49-18e61687cefe None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:19.468348 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4a88d-3046-4a45-8d49-18e61687cefe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:19.486724 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-c6e4a88d-3046-4a45-8d49-18e61687cefe None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:19.487940 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-c6e4a88d-3046-4a45-8d49-18e61687cefe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:19.496505 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1218/2420] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:22:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:22:19.500432 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af2bc04-04ec-4fa1-8a2d-e68cfa630096 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:19.510690 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af2bc04-04ec-4fa1-8a2d-e68cfa630096 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:19.515229 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea2897-35a1-43b0-9215-0558ccb54dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:19.515877 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea2897-35a1-43b0-9215-0558ccb54dab admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:19.516169 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea2897-35a1-43b0-9215-0558ccb54dab admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:19.516446 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea2897-35a1-43b0-9215-0558ccb54dab admin admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:19.517206 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fea2897-35a1-43b0-9215-0558ccb54dab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:22:19.517517 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fea2897-35a1-43b0-9215-0558ccb54dab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:19.519117 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fea2897-35a1-43b0-9215-0558ccb54dab admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:19.530826 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1203/2421] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:22:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:22:19.535078 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e4a88d-3046-4a45-8d49-18e61687cefe None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:19.544673 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e4a88d-3046-4a45-8d49-18e61687cefe None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:19.549378 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf05d91-760a-400f-99e6-5b3a52321f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:19.550024 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf05d91-760a-400f-99e6-5b3a52321f22 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:19.550308 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf05d91-760a-400f-99e6-5b3a52321f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:19.550584 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf05d91-760a-400f-99e6-5b3a52321f22 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:19.551274 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf05d91-760a-400f-99e6-5b3a52321f22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:19.553709 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf05d91-760a-400f-99e6-5b3a52321f22 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:19.579576 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1219/2422] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:22:19 2022] POST /identity/v3/projects => generated 405 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:22:19.583793 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea2897-35a1-43b0-9215-0558ccb54dab admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:19.593576 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea2897-35a1-43b0-9215-0558ccb54dab admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:19.649891 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c93860-c6c4-4a45-a188-eecaac63b214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:19.650552 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c93860-c6c4-4a45-a188-eecaac63b214 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:19.650835 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c93860-c6c4-4a45-a188-eecaac63b214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:19.651110 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c93860-c6c4-4a45-a188-eecaac63b214 admin admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:19.651793 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c93860-c6c4-4a45-a188-eecaac63b214 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:19.653735 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c93860-c6c4-4a45-a188-eecaac63b214 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:19.673530 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1204/2423] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:22:19 2022] POST /identity/v3/users => generated 303 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:22:19.677757 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf05d91-760a-400f-99e6-5b3a52321f22 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:19.688508 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf05d91-760a-400f-99e6-5b3a52321f22 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:19.693333 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf44ea30-5a4c-4658-a1d1-9df0b89d3edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:19.694240 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44ea30-5a4c-4658-a1d1-9df0b89d3edf admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:19.694524 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44ea30-5a4c-4658-a1d1-9df0b89d3edf admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:19.694800 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44ea30-5a4c-4658-a1d1-9df0b89d3edf admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:19.695523 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf44ea30-5a4c-4658-a1d1-9df0b89d3edf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:19.697181 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf44ea30-5a4c-4658-a1d1-9df0b89d3edf admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:19.702370 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:19.708058 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1220/2424] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:22:19.712018 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c93860-c6c4-4a45-a188-eecaac63b214 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:19.722201 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c93860-c6c4-4a45-a188-eecaac63b214 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:19.728066 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c40a02-d1ef-4927-b702-af7a456dd25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:19.728757 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c40a02-d1ef-4927-b702-af7a456dd25f admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:19.729044 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c40a02-d1ef-4927-b702-af7a456dd25f admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:19.729322 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c40a02-d1ef-4927-b702-af7a456dd25f admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:19.730109 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c40a02-d1ef-4927-b702-af7a456dd25f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:19.732022 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c40a02-d1ef-4927-b702-af7a456dd25f admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:19.743126 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1205/2425] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:22:19.752291 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf44ea30-5a4c-4658-a1d1-9df0b89d3edf admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:19.762275 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf44ea30-5a4c-4658-a1d1-9df0b89d3edf admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:19.766802 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a74fe7-27d0-47b6-bcd6-b9cd652f7e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:19.767673 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a74fe7-27d0-47b6-bcd6-b9cd652f7e36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:19.767953 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a74fe7-27d0-47b6-bcd6-b9cd652f7e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:19.768223 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a74fe7-27d0-47b6-bcd6-b9cd652f7e36 admin admin] PATH_INFO: `/v3/projects/0be22d82f1a44b3bb621ba10cd865b2f/users/2b6fff13bc1e41b18a97f8c4528a953b/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:19.782922 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a74fe7-27d0-47b6-bcd6-b9cd652f7e36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0be22d82f1a44b3bb621ba10cd865b2f, user_id=2b6fff13bc1e41b18a97f8c4528a953b, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:19.785594 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a74fe7-27d0-47b6-bcd6-b9cd652f7e36 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:19.799182 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1221/2426] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:22:19 2022] PUT /identity/v3/projects/0be22d82f1a44b3bb621ba10cd865b2f/users/2b6fff13bc1e41b18a97f8c4528a953b/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:19.810205 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417d3cb-0ac0-4e04-a98a-0205ffca913b None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:19.810580 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417d3cb-0ac0-4e04-a98a-0205ffca913b None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:19.810925 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417d3cb-0ac0-4e04-a98a-0205ffca913b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:19.837199 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-2417d3cb-0ac0-4e04-a98a-0205ffca913b None None] MFA Rules not processed for user `2b6fff13bc1e41b18a97f8c4528a953b`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:19.838397 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-2417d3cb-0ac0-4e04-a98a-0205ffca913b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:19.901139 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1206/2427] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:22:19 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:22:19.905570 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a74fe7-27d0-47b6-bcd6-b9cd652f7e36 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:19.966926 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a74fe7-27d0-47b6-bcd6-b9cd652f7e36 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:19.972470 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a795b6-ce70-4032-a9ac-2dde1e7d6a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:19.973183 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a795b6-ce70-4032-a9ac-2dde1e7d6a86 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:19.973467 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a795b6-ce70-4032-a9ac-2dde1e7d6a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:19.973745 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a795b6-ce70-4032-a9ac-2dde1e7d6a86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:19.974438 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a795b6-ce70-4032-a9ac-2dde1e7d6a86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:19.976880 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a795b6-ce70-4032-a9ac-2dde1e7d6a86 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:20.005323 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1222/2428] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:22:19 2022] POST /identity/v3/projects => generated 403 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:22:20.006974 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2417d3cb-0ac0-4e04-a98a-0205ffca913b None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:20.018828 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2417d3cb-0ac0-4e04-a98a-0205ffca913b None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:20.032059 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:20.077786 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e08f3c-12df-499c-8abd-4a9a78d4233d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:20.078453 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e08f3c-12df-499c-8abd-4a9a78d4233d admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:20.078736 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e08f3c-12df-499c-8abd-4a9a78d4233d admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:20.079037 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e08f3c-12df-499c-8abd-4a9a78d4233d admin admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:20.079716 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e08f3c-12df-499c-8abd-4a9a78d4233d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:20.081690 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e08f3c-12df-499c-8abd-4a9a78d4233d admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:20.100983 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1207/2429] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:22:20 2022] POST /identity/v3/users => generated 308 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:22:20.105123 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a795b6-ce70-4032-a9ac-2dde1e7d6a86 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:20.116218 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a795b6-ce70-4032-a9ac-2dde1e7d6a86 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:20.121667 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2271c270-1aaf-4d96-9679-0fcae2f70176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:20.122336 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271c270-1aaf-4d96-9679-0fcae2f70176 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:20.122623 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271c270-1aaf-4d96-9679-0fcae2f70176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:20.122902 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271c270-1aaf-4d96-9679-0fcae2f70176 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:20.123637 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2271c270-1aaf-4d96-9679-0fcae2f70176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:20.125300 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2271c270-1aaf-4d96-9679-0fcae2f70176 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:20.136668 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1223/2430] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:22:20.140778 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e08f3c-12df-499c-8abd-4a9a78d4233d admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:20.150930 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e08f3c-12df-499c-8abd-4a9a78d4233d admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:20.155722 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfbd89d-96e3-47cb-a541-649abbaa55c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:20.156522 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfbd89d-96e3-47cb-a541-649abbaa55c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:20.156862 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfbd89d-96e3-47cb-a541-649abbaa55c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:20.157179 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfbd89d-96e3-47cb-a541-649abbaa55c2 admin admin] PATH_INFO: `/v3/projects/302c7e2d53d540458ddf009031c5a5a7/users/978ecaf24a64468b94c605db56fd3f35/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:20.173028 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfbd89d-96e3-47cb-a541-649abbaa55c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=302c7e2d53d540458ddf009031c5a5a7, user_id=978ecaf24a64468b94c605db56fd3f35, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:20.175675 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfbd89d-96e3-47cb-a541-649abbaa55c2 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:20.190675 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1208/2431] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:22:20 2022] PUT /identity/v3/projects/302c7e2d53d540458ddf009031c5a5a7/users/978ecaf24a64468b94c605db56fd3f35/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:20.197050 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2271c270-1aaf-4d96-9679-0fcae2f70176 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:20.207505 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2271c270-1aaf-4d96-9679-0fcae2f70176 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:20.265192 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed8f7b-469a-445b-a6be-99c800b9f813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:20.265770 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed8f7b-469a-445b-a6be-99c800b9f813 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:20.266052 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed8f7b-469a-445b-a6be-99c800b9f813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:20.266325 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed8f7b-469a-445b-a6be-99c800b9f813 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:20.267052 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ed8f7b-469a-445b-a6be-99c800b9f813 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:20.268636 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ed8f7b-469a-445b-a6be-99c800b9f813 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:20.282164 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1224/2432] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:22:20.283403 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfbd89d-96e3-47cb-a541-649abbaa55c2 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:20.294322 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfbd89d-96e3-47cb-a541-649abbaa55c2 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:20.299223 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc492d-0f78-4ea8-a77c-effc1fb44e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:20.300080 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc492d-0f78-4ea8-a77c-effc1fb44e06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:20.300447 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc492d-0f78-4ea8-a77c-effc1fb44e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:20.300766 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc492d-0f78-4ea8-a77c-effc1fb44e06 admin admin] PATH_INFO: `/v3/projects/302c7e2d53d540458ddf009031c5a5a7/users/978ecaf24a64468b94c605db56fd3f35/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:20.303422 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc492d-0f78-4ea8-a77c-effc1fb44e06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=302c7e2d53d540458ddf009031c5a5a7, user_id=978ecaf24a64468b94c605db56fd3f35, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:20.306249 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc492d-0f78-4ea8-a77c-effc1fb44e06 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:20.317393 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1209/2433] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:22:20 2022] PUT /identity/v3/projects/302c7e2d53d540458ddf009031c5a5a7/users/978ecaf24a64468b94c605db56fd3f35/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:20.329296 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f234a6e-edbc-420b-b52f-2ff356244a9d None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:20.329841 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f234a6e-edbc-420b-b52f-2ff356244a9d None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:20.330543 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f234a6e-edbc-420b-b52f-2ff356244a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:20.359621 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-0f234a6e-edbc-420b-b52f-2ff356244a9d None None] MFA Rules not processed for user `978ecaf24a64468b94c605db56fd3f35`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:20.361016 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-0f234a6e-edbc-420b-b52f-2ff356244a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:20.404639 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:20.442998 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1225/2434] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:22:20 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:22:20.453964 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc492d-0f78-4ea8-a77c-effc1fb44e06 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:20.455854 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-4fbc492d-0f78-4ea8-a77c-effc1fb44e06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:20.516405 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc492d-0f78-4ea8-a77c-effc1fb44e06 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:20.520231 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceebcd63-a560-4fa3-9164-59b5bdd1afa9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:20.520920 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebcd63-a560-4fa3-9164-59b5bdd1afa9 service cinder] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:20.521208 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebcd63-a560-4fa3-9164-59b5bdd1afa9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:20.522243 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebcd63-a560-4fa3-9164-59b5bdd1afa9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:20.532106 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceebcd63-a560-4fa3-9164-59b5bdd1afa9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:20.533475 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceebcd63-a560-4fa3-9164-59b5bdd1afa9 service cinder] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:20.544570 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1210/2435] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:22:20 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:22:20.696868 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f234a6e-edbc-420b-b52f-2ff356244a9d None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:20.759911 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f234a6e-edbc-420b-b52f-2ff356244a9d None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:20.764587 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5623a2-1f78-4b6b-bca4-10323e8cfbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:20.765513 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5623a2-1f78-4b6b-bca4-10323e8cfbf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:20.765790 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5623a2-1f78-4b6b-bca4-10323e8cfbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:20.766075 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5623a2-1f78-4b6b-bca4-10323e8cfbf0 admin admin] PATH_INFO: `/v3/users/2b6fff13bc1e41b18a97f8c4528a953b` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:20.767329 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5623a2-1f78-4b6b-bca4-10323e8cfbf0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b6fff13bc1e41b18a97f8c4528a953b)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:20.769208 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5623a2-1f78-4b6b-bca4-10323e8cfbf0 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:20.817861 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-ca5623a2-1f78-4b6b-bca4-10323e8cfbf0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b6fff13bc1e41b18a97f8c4528a953b'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:20.825513 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-ca5623a2-1f78-4b6b-bca4-10323e8cfbf0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b6fff13bc1e41b18a97f8c4528a953b'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:20.832519 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-ca5623a2-1f78-4b6b-bca4-10323e8cfbf0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b6fff13bc1e41b18a97f8c4528a953b'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:20.845100 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-ca5623a2-1f78-4b6b-bca4-10323e8cfbf0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b6fff13bc1e41b18a97f8c4528a953b'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:20.845768 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-ca5623a2-1f78-4b6b-bca4-10323e8cfbf0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b6fff13bc1e41b18a97f8c4528a953b'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:20.852222 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1226/2436] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:22:20 2022] DELETE /identity/v3/users/2b6fff13bc1e41b18a97f8c4528a953b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:20.857034 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9eaca-d5c2-4d75-8674-6fc7e505f16b None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:20.857545 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9eaca-d5c2-4d75-8674-6fc7e505f16b None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:20.857664 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9eaca-d5c2-4d75-8674-6fc7e505f16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:20.876288 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-52d9eaca-d5c2-4d75-8674-6fc7e505f16b None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:20.877573 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-52d9eaca-d5c2-4d75-8674-6fc7e505f16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:20.937780 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1211/2437] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:22:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:22:20.947305 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5623a2-1f78-4b6b-bca4-10323e8cfbf0 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:20.948682 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-ca5623a2-1f78-4b6b-bca4-10323e8cfbf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:21.006319 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5623a2-1f78-4b6b-bca4-10323e8cfbf0 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:21.009801 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5ed60-8664-4022-bb3a-36c14e9c117f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:21.010438 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5ed60-8664-4022-bb3a-36c14e9c117f service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:21.010719 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5ed60-8664-4022-bb3a-36c14e9c117f service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:21.010990 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5ed60-8664-4022-bb3a-36c14e9c117f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:21.016804 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:21.021855 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a5ed60-8664-4022-bb3a-36c14e9c117f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:21.023427 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a5ed60-8664-4022-bb3a-36c14e9c117f service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:21.033807 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1227/2438] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:22:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:22:21.297968 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d9eaca-d5c2-4d75-8674-6fc7e505f16b None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:21.299531 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-52d9eaca-d5c2-4d75-8674-6fc7e505f16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:21.312759 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d9eaca-d5c2-4d75-8674-6fc7e505f16b None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:21.317707 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc334ce6-d423-4f90-9de7-639d5eba0d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:21.319871 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc334ce6-d423-4f90-9de7-639d5eba0d00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:21.320237 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc334ce6-d423-4f90-9de7-639d5eba0d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:21.320584 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc334ce6-d423-4f90-9de7-639d5eba0d00 admin admin] PATH_INFO: `/v3/projects/0be22d82f1a44b3bb621ba10cd865b2f` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:21.321918 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc334ce6-d423-4f90-9de7-639d5eba0d00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0be22d82f1a44b3bb621ba10cd865b2f)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:21.323950 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc334ce6-d423-4f90-9de7-639d5eba0d00 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:21.333230 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:21.382523 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-dc334ce6-d423-4f90-9de7-639d5eba0d00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0be22d82f1a44b3bb621ba10cd865b2f', 'request_id': 'req-dc334ce6-d423-4f90-9de7-639d5eba0d00'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:21.389763 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-dc334ce6-d423-4f90-9de7-639d5eba0d00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0be22d82f1a44b3bb621ba10cd865b2f', 'request_id': 'req-dc334ce6-d423-4f90-9de7-639d5eba0d00'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:21.395896 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-dc334ce6-d423-4f90-9de7-639d5eba0d00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0be22d82f1a44b3bb621ba10cd865b2f', 'request_id': 'req-dc334ce6-d423-4f90-9de7-639d5eba0d00'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:21.407576 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-dc334ce6-d423-4f90-9de7-639d5eba0d00 admin admin] The token cache is being invalidate because project 0be22d82f1a44b3bb621ba10cd865b2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:22:21.407863 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-dc334ce6-d423-4f90-9de7-639d5eba0d00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:21.408492 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-dc334ce6-d423-4f90-9de7-639d5eba0d00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:21.410065 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1212/2439] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:22:21 2022] DELETE /identity/v3/projects/0be22d82f1a44b3bb621ba10cd865b2f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:21.414884 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5ed60-8664-4022-bb3a-36c14e9c117f service neutron] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:21.425998 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5ed60-8664-4022-bb3a-36c14e9c117f service neutron] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:21.483369 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a361cc-4afb-4992-8310-ee5639cccb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:21.484232 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a361cc-4afb-4992-8310-ee5639cccb98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:21.484512 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a361cc-4afb-4992-8310-ee5639cccb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:21.484815 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a361cc-4afb-4992-8310-ee5639cccb98 admin admin] PATH_INFO: `/v3/users/978ecaf24a64468b94c605db56fd3f35` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:21.485988 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a361cc-4afb-4992-8310-ee5639cccb98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=978ecaf24a64468b94c605db56fd3f35)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:21.487890 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a361cc-4afb-4992-8310-ee5639cccb98 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:21.533940 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-14a361cc-4afb-4992-8310-ee5639cccb98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '978ecaf24a64468b94c605db56fd3f35'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:21.541547 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-14a361cc-4afb-4992-8310-ee5639cccb98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '978ecaf24a64468b94c605db56fd3f35'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:21.548323 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-14a361cc-4afb-4992-8310-ee5639cccb98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '978ecaf24a64468b94c605db56fd3f35'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:21.560851 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-14a361cc-4afb-4992-8310-ee5639cccb98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '978ecaf24a64468b94c605db56fd3f35'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:21.561468 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-14a361cc-4afb-4992-8310-ee5639cccb98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '978ecaf24a64468b94c605db56fd3f35'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:21.567420 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1228/2440] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:22:21 2022] DELETE /identity/v3/users/978ecaf24a64468b94c605db56fd3f35 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:22:21.892198 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc334ce6-d423-4f90-9de7-639d5eba0d00 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:21.894096 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-dc334ce6-d423-4f90-9de7-639d5eba0d00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:21.907350 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc334ce6-d423-4f90-9de7-639d5eba0d00 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:21.967175 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d8308-7cec-4e94-87ad-90493fd568cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:21.968039 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d8308-7cec-4e94-87ad-90493fd568cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:21.968320 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d8308-7cec-4e94-87ad-90493fd568cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:21.968591 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d8308-7cec-4e94-87ad-90493fd568cf admin admin] PATH_INFO: `/v3/projects/302c7e2d53d540458ddf009031c5a5a7` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:21.969786 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46d8308-7cec-4e94-87ad-90493fd568cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=302c7e2d53d540458ddf009031c5a5a7)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:21.971675 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46d8308-7cec-4e94-87ad-90493fd568cf admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:22.016543 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-d46d8308-7cec-4e94-87ad-90493fd568cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '302c7e2d53d540458ddf009031c5a5a7', 'request_id': 'req-d46d8308-7cec-4e94-87ad-90493fd568cf'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:22.023155 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-d46d8308-7cec-4e94-87ad-90493fd568cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '302c7e2d53d540458ddf009031c5a5a7', 'request_id': 'req-d46d8308-7cec-4e94-87ad-90493fd568cf'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:22.028693 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-d46d8308-7cec-4e94-87ad-90493fd568cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '302c7e2d53d540458ddf009031c5a5a7', 'request_id': 'req-d46d8308-7cec-4e94-87ad-90493fd568cf'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:22.041001 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-d46d8308-7cec-4e94-87ad-90493fd568cf admin admin] The token cache is being invalidate because project 302c7e2d53d540458ddf009031c5a5a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:22:22.041284 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-d46d8308-7cec-4e94-87ad-90493fd568cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:22.041902 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-d46d8308-7cec-4e94-87ad-90493fd568cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:22.043430 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1213/2441] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:22:21 2022] DELETE /identity/v3/projects/302c7e2d53d540458ddf009031c5a5a7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:22.048549 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7e237-3a5e-40f8-836f-4ce704331115 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:22.049078 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7e237-3a5e-40f8-836f-4ce704331115 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:22.049078 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7e237-3a5e-40f8-836f-4ce704331115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:22.067376 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-b4d7e237-3a5e-40f8-836f-4ce704331115 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:22.068613 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-b4d7e237-3a5e-40f8-836f-4ce704331115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:22.126896 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1229/2442] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:22:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:22:22.134586 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7076a55-5b2d-4ca4-82a7-8524446ea0ad None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:22.134874 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7076a55-5b2d-4ca4-82a7-8524446ea0ad None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:22.135149 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7076a55-5b2d-4ca4-82a7-8524446ea0ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:22.152529 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-a7076a55-5b2d-4ca4-82a7-8524446ea0ad None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:22.153793 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-a7076a55-5b2d-4ca4-82a7-8524446ea0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:22.161526 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1214/2443] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:22:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:22:22.166318 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d7e237-3a5e-40f8-836f-4ce704331115 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:22.175912 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d7e237-3a5e-40f8-836f-4ce704331115 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:22.181278 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be65a6b-f747-443f-bd46-f74f0e82df6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:22.181924 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be65a6b-f747-443f-bd46-f74f0e82df6c admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:22.182207 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be65a6b-f747-443f-bd46-f74f0e82df6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:22.182485 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be65a6b-f747-443f-bd46-f74f0e82df6c admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:22.183207 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be65a6b-f747-443f-bd46-f74f0e82df6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:22:22.183518 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be65a6b-f747-443f-bd46-f74f0e82df6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:22.185147 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be65a6b-f747-443f-bd46-f74f0e82df6c admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:22.193928 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:22.197652 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1230/2444] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:22:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:22:22.208981 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7076a55-5b2d-4ca4-82a7-8524446ea0ad None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:22.218533 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7076a55-5b2d-4ca4-82a7-8524446ea0ad None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:22.223315 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9aa17-5b02-4ca1-a484-7896a706139b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:22.223997 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9aa17-5b02-4ca1-a484-7896a706139b admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:22.224283 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9aa17-5b02-4ca1-a484-7896a706139b admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:22.225099 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9aa17-5b02-4ca1-a484-7896a706139b admin admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:22.225862 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a9aa17-5b02-4ca1-a484-7896a706139b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:22.227798 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a9aa17-5b02-4ca1-a484-7896a706139b admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:22.248402 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:22.257238 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1215/2445] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:22:22 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:22:22.261337 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be65a6b-f747-443f-bd46-f74f0e82df6c admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:22.271237 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be65a6b-f747-443f-bd46-f74f0e82df6c admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:22.329301 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bdb165-bde6-4a68-ba0f-6eb77fa514fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:22.329567 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bdb165-bde6-4a68-ba0f-6eb77fa514fc admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:22.329856 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bdb165-bde6-4a68-ba0f-6eb77fa514fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:22.330133 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bdb165-bde6-4a68-ba0f-6eb77fa514fc admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:22.331132 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bdb165-bde6-4a68-ba0f-6eb77fa514fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:22.334586 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bdb165-bde6-4a68-ba0f-6eb77fa514fc admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:22.357316 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1231/2446] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:22:22 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:22:22.362113 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9aa17-5b02-4ca1-a484-7896a706139b admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:22.373701 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9aa17-5b02-4ca1-a484-7896a706139b admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:22.378435 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa9648-b9c8-4f3a-87b1-569ba5d1c120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:22.379094 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa9648-b9c8-4f3a-87b1-569ba5d1c120 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:22.379374 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa9648-b9c8-4f3a-87b1-569ba5d1c120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:22.379646 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa9648-b9c8-4f3a-87b1-569ba5d1c120 admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:22.380371 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaa9648-b9c8-4f3a-87b1-569ba5d1c120 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:22.382218 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaa9648-b9c8-4f3a-87b1-569ba5d1c120 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:22.393104 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1216/2447] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:22:22.397733 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bdb165-bde6-4a68-ba0f-6eb77fa514fc admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:22.408083 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bdb165-bde6-4a68-ba0f-6eb77fa514fc admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:22.414434 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83b845f-9c06-466d-abe7-b4c7646436d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:22.415166 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b845f-9c06-466d-abe7-b4c7646436d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:22.415454 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b845f-9c06-466d-abe7-b4c7646436d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:22.415740 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b845f-9c06-466d-abe7-b4c7646436d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:22.416604 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83b845f-9c06-466d-abe7-b4c7646436d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:22.418247 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83b845f-9c06-466d-abe7-b4c7646436d0 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:22.429284 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1232/2448] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:22:22.433376 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa9648-b9c8-4f3a-87b1-569ba5d1c120 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:22.443242 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa9648-b9c8-4f3a-87b1-569ba5d1c120 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:22.448875 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6629a9-6eac-402b-b1c3-8ee1c7326e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:22.449756 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6629a9-6eac-402b-b1c3-8ee1c7326e52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:22.450032 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6629a9-6eac-402b-b1c3-8ee1c7326e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:22.450302 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6629a9-6eac-402b-b1c3-8ee1c7326e52 admin admin] PATH_INFO: `/v3/projects/28d109befb714aa79e271cfd907cff2b/users/03ad875277a9473596a6f6aeaf546f01/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:22.465581 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6629a9-6eac-402b-b1c3-8ee1c7326e52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28d109befb714aa79e271cfd907cff2b, user_id=03ad875277a9473596a6f6aeaf546f01, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:22.468221 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6629a9-6eac-402b-b1c3-8ee1c7326e52 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:22.482304 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1217/2449] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:22:22 2022] PUT /identity/v3/projects/28d109befb714aa79e271cfd907cff2b/users/03ad875277a9473596a6f6aeaf546f01/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:22.492860 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca8820-32ef-4f12-be3b-7b267810bb3c None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:22.493154 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca8820-32ef-4f12-be3b-7b267810bb3c None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:22.493439 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca8820-32ef-4f12-be3b-7b267810bb3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:22.519492 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-2dca8820-32ef-4f12-be3b-7b267810bb3c None None] MFA Rules not processed for user `03ad875277a9473596a6f6aeaf546f01`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:22.520847 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-2dca8820-32ef-4f12-be3b-7b267810bb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:22.583285 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1233/2450] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:22:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:22:22.588308 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6629a9-6eac-402b-b1c3-8ee1c7326e52 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:22.658125 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6629a9-6eac-402b-b1c3-8ee1c7326e52 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:22.663258 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12bb683-71e7-4528-982a-505c44515742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:22.663902 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12bb683-71e7-4528-982a-505c44515742 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:22.664181 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12bb683-71e7-4528-982a-505c44515742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:22.664454 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12bb683-71e7-4528-982a-505c44515742 admin admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:22.665164 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12bb683-71e7-4528-982a-505c44515742 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:22.667048 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12bb683-71e7-4528-982a-505c44515742 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:22.691670 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1218/2451] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:22:22 2022] POST /identity/v3/projects => generated 379 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:22:22.695877 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca8820-32ef-4f12-be3b-7b267810bb3c None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:22.706375 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca8820-32ef-4f12-be3b-7b267810bb3c None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:22.761723 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7b68b-36a0-474f-a482-7ac510297221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:22.762379 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7b68b-36a0-474f-a482-7ac510297221 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:22.762657 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7b68b-36a0-474f-a482-7ac510297221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:22.762931 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7b68b-36a0-474f-a482-7ac510297221 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:22.763623 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f7b68b-36a0-474f-a482-7ac510297221 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:22.765548 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f7b68b-36a0-474f-a482-7ac510297221 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:22.778855 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:22.786122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1234/2452] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:22:22 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:22:22.790426 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12bb683-71e7-4528-982a-505c44515742 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:22.800427 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12bb683-71e7-4528-982a-505c44515742 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:22.805804 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f3ca5-f5e2-4732-b864-8a179fa958e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:22.806432 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f3ca5-f5e2-4732-b864-8a179fa958e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:22.806713 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f3ca5-f5e2-4732-b864-8a179fa958e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:22.806986 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f3ca5-f5e2-4732-b864-8a179fa958e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:22.807700 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f3ca5-f5e2-4732-b864-8a179fa958e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:22.809317 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f3ca5-f5e2-4732-b864-8a179fa958e1 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:22.819979 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1219/2453] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:22:22.824079 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7b68b-36a0-474f-a482-7ac510297221 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:22.834583 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7b68b-36a0-474f-a482-7ac510297221 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:22.839145 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b1af4b-75ae-4350-bbdc-f1155191a69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:22.839991 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1af4b-75ae-4350-bbdc-f1155191a69c admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:22.840277 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1af4b-75ae-4350-bbdc-f1155191a69c admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:22.840557 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1af4b-75ae-4350-bbdc-f1155191a69c admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:22.842769 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b1af4b-75ae-4350-bbdc-f1155191a69c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:22.844367 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b1af4b-75ae-4350-bbdc-f1155191a69c admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:22.855708 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1235/2454] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:22:22.859999 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f3ca5-f5e2-4732-b864-8a179fa958e1 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:22.870652 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f3ca5-f5e2-4732-b864-8a179fa958e1 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:22.875292 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4912c4-cc43-4c34-88e3-7a624e473269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:22.876173 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4912c4-cc43-4c34-88e3-7a624e473269 admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:22.876451 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4912c4-cc43-4c34-88e3-7a624e473269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:22.876750 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4912c4-cc43-4c34-88e3-7a624e473269 admin admin] PATH_INFO: `/v3/projects/021ea3413e024386beefd8bc08c4b911/users/038370cb54e84a77a5e26bf75a839004/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:22.891631 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4912c4-cc43-4c34-88e3-7a624e473269 admin admin] RBAC: Authorizing `identity:create_grant(project_id=021ea3413e024386beefd8bc08c4b911, user_id=038370cb54e84a77a5e26bf75a839004, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:22.894317 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4912c4-cc43-4c34-88e3-7a624e473269 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:22.909679 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1220/2455] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:22:22 2022] PUT /identity/v3/projects/021ea3413e024386beefd8bc08c4b911/users/038370cb54e84a77a5e26bf75a839004/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:22:22.921777 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0142706-19fb-4cc5-90c8-25d6cc36d68b None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:22.922054 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0142706-19fb-4cc5-90c8-25d6cc36d68b None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:22.922405 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0142706-19fb-4cc5-90c8-25d6cc36d68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:22.951675 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-b0142706-19fb-4cc5-90c8-25d6cc36d68b None None] MFA Rules not processed for user `038370cb54e84a77a5e26bf75a839004`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:22.952946 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-b0142706-19fb-4cc5-90c8-25d6cc36d68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:23.022309 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1236/2456] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:22:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:22:23.026912 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4912c4-cc43-4c34-88e3-7a624e473269 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:23.090313 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4912c4-cc43-4c34-88e3-7a624e473269 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:23.095386 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2592c05-b0ae-4391-8335-5aa77f8efd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:23.096050 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2592c05-b0ae-4391-8335-5aa77f8efd77 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:23.096332 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2592c05-b0ae-4391-8335-5aa77f8efd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:23.096609 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2592c05-b0ae-4391-8335-5aa77f8efd77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:23.097339 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2592c05-b0ae-4391-8335-5aa77f8efd77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:23.099245 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2592c05-b0ae-4391-8335-5aa77f8efd77 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:23.120108 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:23.132004 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1221/2457] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:22:23 2022] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:22:23.133163 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0142706-19fb-4cc5-90c8-25d6cc36d68b None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:23.144003 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0142706-19fb-4cc5-90c8-25d6cc36d68b None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:23.203797 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40029fb-0abf-4c42-ad01-bae735346a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:23.204474 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40029fb-0abf-4c42-ad01-bae735346a23 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:23.204783 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40029fb-0abf-4c42-ad01-bae735346a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:23.205060 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40029fb-0abf-4c42-ad01-bae735346a23 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:23.205776 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40029fb-0abf-4c42-ad01-bae735346a23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:23.207674 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40029fb-0abf-4c42-ad01-bae735346a23 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:23.229553 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1237/2458] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:22:23 2022] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:22:23.233716 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2592c05-b0ae-4391-8335-5aa77f8efd77 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:23.246891 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2592c05-b0ae-4391-8335-5aa77f8efd77 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:23.251660 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ee71f-1f63-4cd2-953a-66bc5207644f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:23.252326 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ee71f-1f63-4cd2-953a-66bc5207644f admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:23.252615 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ee71f-1f63-4cd2-953a-66bc5207644f admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:23.252926 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ee71f-1f63-4cd2-953a-66bc5207644f admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:23.253669 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5ee71f-1f63-4cd2-953a-66bc5207644f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:23.255311 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5ee71f-1f63-4cd2-953a-66bc5207644f admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:23.266865 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1222/2459] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:22:23.271156 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40029fb-0abf-4c42-ad01-bae735346a23 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:23.281126 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40029fb-0abf-4c42-ad01-bae735346a23 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:23.285675 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f9ce3d-f0e9-48c1-802b-ae8ba026ed2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:23.286545 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9ce3d-f0e9-48c1-802b-ae8ba026ed2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:23.286821 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9ce3d-f0e9-48c1-802b-ae8ba026ed2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:23.287133 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9ce3d-f0e9-48c1-802b-ae8ba026ed2c admin admin] PATH_INFO: `/v3/projects/e3df722a57284270b3e22f90b53751ca/users/1122c683ee764274a14a0f260a3507d9/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:23.301334 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f9ce3d-f0e9-48c1-802b-ae8ba026ed2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3df722a57284270b3e22f90b53751ca, user_id=1122c683ee764274a14a0f260a3507d9, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:23.304790 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f9ce3d-f0e9-48c1-802b-ae8ba026ed2c admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:23.317109 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1238/2460] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:22:23 2022] PUT /identity/v3/projects/e3df722a57284270b3e22f90b53751ca/users/1122c683ee764274a14a0f260a3507d9/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:23.322389 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ee71f-1f63-4cd2-953a-66bc5207644f admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:23.334843 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ee71f-1f63-4cd2-953a-66bc5207644f admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:23.392224 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afedb493-5d61-45f6-8bad-be478ab2dd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:23.392843 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afedb493-5d61-45f6-8bad-be478ab2dd1b admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:23.393133 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afedb493-5d61-45f6-8bad-be478ab2dd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:23.393408 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afedb493-5d61-45f6-8bad-be478ab2dd1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:23.394126 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afedb493-5d61-45f6-8bad-be478ab2dd1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:23.395714 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afedb493-5d61-45f6-8bad-be478ab2dd1b admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:23.405665 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1223/2461] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:22:23.409727 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f9ce3d-f0e9-48c1-802b-ae8ba026ed2c admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:23.420349 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f9ce3d-f0e9-48c1-802b-ae8ba026ed2c admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:23.424819 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1938e543-a732-4d76-ac0e-81f65d66c61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:23.425687 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938e543-a732-4d76-ac0e-81f65d66c61f admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:23.425967 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938e543-a732-4d76-ac0e-81f65d66c61f admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:23.426236 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938e543-a732-4d76-ac0e-81f65d66c61f admin admin] PATH_INFO: `/v3/projects/e3df722a57284270b3e22f90b53751ca/users/1122c683ee764274a14a0f260a3507d9/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:23.428893 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1938e543-a732-4d76-ac0e-81f65d66c61f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3df722a57284270b3e22f90b53751ca, user_id=1122c683ee764274a14a0f260a3507d9, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:23.431492 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1938e543-a732-4d76-ac0e-81f65d66c61f admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:23.441745 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1239/2462] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:22:23 2022] PUT /identity/v3/projects/e3df722a57284270b3e22f90b53751ca/users/1122c683ee764274a14a0f260a3507d9/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:23.452381 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2532c-8b6b-4d39-bc1c-e5bf79ccfffa None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:23.452679 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2532c-8b6b-4d39-bc1c-e5bf79ccfffa None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:23.453136 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2532c-8b6b-4d39-bc1c-e5bf79ccfffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:23.482373 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-2ef2532c-8b6b-4d39-bc1c-e5bf79ccfffa None None] MFA Rules not processed for user `1122c683ee764274a14a0f260a3507d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:23.483580 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-2ef2532c-8b6b-4d39-bc1c-e5bf79ccfffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:23.551405 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1224/2463] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:22:23 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:22:23.563095 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1938e543-a732-4d76-ac0e-81f65d66c61f admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:23.564813 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-1938e543-a732-4d76-ac0e-81f65d66c61f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:23.597874 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:23.622699 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1938e543-a732-4d76-ac0e-81f65d66c61f admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:23.626271 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef7e0a-eeb6-4031-953b-860a32b33bbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:23.626907 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef7e0a-eeb6-4031-953b-860a32b33bbd service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:23.627187 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef7e0a-eeb6-4031-953b-860a32b33bbd service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:23.627460 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef7e0a-eeb6-4031-953b-860a32b33bbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:23.637215 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cef7e0a-eeb6-4031-953b-860a32b33bbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:23.638645 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cef7e0a-eeb6-4031-953b-860a32b33bbd service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:23.648693 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1240/2464] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:22:23 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:22:23.689523 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef2532c-8b6b-4d39-bc1c-e5bf79ccfffa None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:23.690932 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-2ef2532c-8b6b-4d39-bc1c-e5bf79ccfffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:23.704098 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef2532c-8b6b-4d39-bc1c-e5bf79ccfffa None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:23.707875 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e767c7cd-7905-4f88-a8ea-a457f9b112c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:23.708439 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767c7cd-7905-4f88-a8ea-a457f9b112c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:23.708865 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767c7cd-7905-4f88-a8ea-a457f9b112c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:23.709850 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767c7cd-7905-4f88-a8ea-a457f9b112c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:23.769699 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e767c7cd-7905-4f88-a8ea-a457f9b112c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:23.771142 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e767c7cd-7905-4f88-a8ea-a457f9b112c1 service cinder] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:23.781704 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1225/2465] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:22:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:22:25.098512 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef7e0a-eeb6-4031-953b-860a32b33bbd service cinder] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:25.100141 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-0cef7e0a-eeb6-4031-953b-860a32b33bbd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:25.179243 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef7e0a-eeb6-4031-953b-860a32b33bbd service cinder] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:25.184856 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4389020-8509-4450-b435-63294f413024 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cee106502e54829ad802ee41c9165fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:25.185501 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4389020-8509-4450-b435-63294f413024 service nova] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:25.185782 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4389020-8509-4450-b435-63294f413024 service nova] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:25.186056 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4389020-8509-4450-b435-63294f413024 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:25.187861 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-d4389020-8509-4450-b435-63294f413024 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:25.200946 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4389020-8509-4450-b435-63294f413024 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:25.202551 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4389020-8509-4450-b435-63294f413024 service nova] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:25.213921 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1241/2466] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:22:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:22:26.698506 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e767c7cd-7905-4f88-a8ea-a457f9b112c1 service cinder] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:26.707086 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:26.763068 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e767c7cd-7905-4f88-a8ea-a457f9b112c1 service cinder] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:26.767590 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83367ae1-b4ae-4757-bc96-8ba90f8b2e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:26.768450 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83367ae1-b4ae-4757-bc96-8ba90f8b2e1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:26.768757 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83367ae1-b4ae-4757-bc96-8ba90f8b2e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:26.769040 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83367ae1-b4ae-4757-bc96-8ba90f8b2e1e admin admin] PATH_INFO: `/v3/users/03ad875277a9473596a6f6aeaf546f01` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:26.770216 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83367ae1-b4ae-4757-bc96-8ba90f8b2e1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=03ad875277a9473596a6f6aeaf546f01)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:26.772829 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83367ae1-b4ae-4757-bc96-8ba90f8b2e1e admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:26.816882 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-83367ae1-b4ae-4757-bc96-8ba90f8b2e1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03ad875277a9473596a6f6aeaf546f01'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:26.824316 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-83367ae1-b4ae-4757-bc96-8ba90f8b2e1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03ad875277a9473596a6f6aeaf546f01'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:26.825045 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-83367ae1-b4ae-4757-bc96-8ba90f8b2e1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03ad875277a9473596a6f6aeaf546f01'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:26.825648 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-83367ae1-b4ae-4757-bc96-8ba90f8b2e1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03ad875277a9473596a6f6aeaf546f01'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:26.837610 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-83367ae1-b4ae-4757-bc96-8ba90f8b2e1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03ad875277a9473596a6f6aeaf546f01'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:26.849627 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1226/2467] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:22:26 2022] DELETE /identity/v3/users/03ad875277a9473596a6f6aeaf546f01 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:26.854283 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ddccb-0e3f-46af-a798-a67b0778e1b2 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:26.854772 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ddccb-0e3f-46af-a798-a67b0778e1b2 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:26.854884 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ddccb-0e3f-46af-a798-a67b0778e1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:26.871886 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-846ddccb-0e3f-46af-a798-a67b0778e1b2 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:26.873118 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-846ddccb-0e3f-46af-a798-a67b0778e1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:26.930374 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1242/2468] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:22:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:22:26.940210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83367ae1-b4ae-4757-bc96-8ba90f8b2e1e admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:26.941652 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-83367ae1-b4ae-4757-bc96-8ba90f8b2e1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:26.998689 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83367ae1-b4ae-4757-bc96-8ba90f8b2e1e admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:27.002287 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b439b1-a10a-4c55-b3bf-0d168fc9679a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:27.002927 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b439b1-a10a-4c55-b3bf-0d168fc9679a service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:27.003213 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b439b1-a10a-4c55-b3bf-0d168fc9679a service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:27.003489 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b439b1-a10a-4c55-b3bf-0d168fc9679a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:27.013362 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b439b1-a10a-4c55-b3bf-0d168fc9679a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:27.014785 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b439b1-a10a-4c55-b3bf-0d168fc9679a service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:27.024497 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1227/2469] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:22:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:22:27.299804 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ddccb-0e3f-46af-a798-a67b0778e1b2 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:27.301384 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-846ddccb-0e3f-46af-a798-a67b0778e1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:27.321279 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ddccb-0e3f-46af-a798-a67b0778e1b2 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:27.326719 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af02e761-5d0a-46d2-babc-9a12ebbc11eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:27.327955 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02e761-5d0a-46d2-babc-9a12ebbc11eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:27.328492 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02e761-5d0a-46d2-babc-9a12ebbc11eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:27.328971 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02e761-5d0a-46d2-babc-9a12ebbc11eb admin admin] PATH_INFO: `/v3/projects/28d109befb714aa79e271cfd907cff2b` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:27.331191 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af02e761-5d0a-46d2-babc-9a12ebbc11eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=28d109befb714aa79e271cfd907cff2b)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:27.333303 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af02e761-5d0a-46d2-babc-9a12ebbc11eb admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:27.387490 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-af02e761-5d0a-46d2-babc-9a12ebbc11eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28d109befb714aa79e271cfd907cff2b', 'request_id': 'req-af02e761-5d0a-46d2-babc-9a12ebbc11eb'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:27.389411 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:27.393742 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-af02e761-5d0a-46d2-babc-9a12ebbc11eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28d109befb714aa79e271cfd907cff2b', 'request_id': 'req-af02e761-5d0a-46d2-babc-9a12ebbc11eb'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:27.401354 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-af02e761-5d0a-46d2-babc-9a12ebbc11eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28d109befb714aa79e271cfd907cff2b', 'request_id': 'req-af02e761-5d0a-46d2-babc-9a12ebbc11eb'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:27.412796 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-af02e761-5d0a-46d2-babc-9a12ebbc11eb admin admin] The token cache is being invalidate because project 28d109befb714aa79e271cfd907cff2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:22:27.413092 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-af02e761-5d0a-46d2-babc-9a12ebbc11eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:27.413904 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-af02e761-5d0a-46d2-babc-9a12ebbc11eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:27.415666 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1243/2470] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:22:27 2022] DELETE /identity/v3/projects/28d109befb714aa79e271cfd907cff2b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:27.419681 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b439b1-a10a-4c55-b3bf-0d168fc9679a service neutron] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:27.430014 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b439b1-a10a-4c55-b3bf-0d168fc9679a service neutron] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:27.460927 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:27.499991 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951cf7e2-848a-49c3-84a9-c510704c75a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:27.500961 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951cf7e2-848a-49c3-84a9-c510704c75a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:27.501188 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951cf7e2-848a-49c3-84a9-c510704c75a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:27.501463 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951cf7e2-848a-49c3-84a9-c510704c75a0 admin admin] PATH_INFO: `/v3/users/038370cb54e84a77a5e26bf75a839004` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:27.502647 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951cf7e2-848a-49c3-84a9-c510704c75a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=038370cb54e84a77a5e26bf75a839004)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:27.504549 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951cf7e2-848a-49c3-84a9-c510704c75a0 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:27.550864 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-951cf7e2-848a-49c3-84a9-c510704c75a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '038370cb54e84a77a5e26bf75a839004'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:27.558505 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-951cf7e2-848a-49c3-84a9-c510704c75a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '038370cb54e84a77a5e26bf75a839004'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:27.559119 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-951cf7e2-848a-49c3-84a9-c510704c75a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '038370cb54e84a77a5e26bf75a839004'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:27.559714 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-951cf7e2-848a-49c3-84a9-c510704c75a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '038370cb54e84a77a5e26bf75a839004'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:27.572267 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-951cf7e2-848a-49c3-84a9-c510704c75a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '038370cb54e84a77a5e26bf75a839004'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:27.589813 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1228/2471] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:22:27 2022] DELETE /identity/v3/users/038370cb54e84a77a5e26bf75a839004 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:27.867171 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af02e761-5d0a-46d2-babc-9a12ebbc11eb admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:27.868619 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-af02e761-5d0a-46d2-babc-9a12ebbc11eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:27.882139 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af02e761-5d0a-46d2-babc-9a12ebbc11eb admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:27.946704 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf94abf-5534-466a-b591-0b2613e83fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:27.947575 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf94abf-5534-466a-b591-0b2613e83fe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:27.947870 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf94abf-5534-466a-b591-0b2613e83fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:27.948174 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf94abf-5534-466a-b591-0b2613e83fe4 admin admin] PATH_INFO: `/v3/projects/021ea3413e024386beefd8bc08c4b911` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:27.949722 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf94abf-5534-466a-b591-0b2613e83fe4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=021ea3413e024386beefd8bc08c4b911)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:27.951448 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf94abf-5534-466a-b591-0b2613e83fe4 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:28.008573 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-ddf94abf-5534-466a-b591-0b2613e83fe4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '021ea3413e024386beefd8bc08c4b911', 'request_id': 'req-ddf94abf-5534-466a-b591-0b2613e83fe4'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:28.014591 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-ddf94abf-5534-466a-b591-0b2613e83fe4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '021ea3413e024386beefd8bc08c4b911', 'request_id': 'req-ddf94abf-5534-466a-b591-0b2613e83fe4'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:28.029046 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-ddf94abf-5534-466a-b591-0b2613e83fe4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '021ea3413e024386beefd8bc08c4b911', 'request_id': 'req-ddf94abf-5534-466a-b591-0b2613e83fe4'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:28.041012 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-ddf94abf-5534-466a-b591-0b2613e83fe4 admin admin] The token cache is being invalidate because project 021ea3413e024386beefd8bc08c4b911 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:22:28.041248 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-ddf94abf-5534-466a-b591-0b2613e83fe4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:28.041911 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-ddf94abf-5534-466a-b591-0b2613e83fe4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:28.043624 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1244/2472] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:22:27 2022] DELETE /identity/v3/projects/021ea3413e024386beefd8bc08c4b911 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:28.047411 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951cf7e2-848a-49c3-84a9-c510704c75a0 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:28.048826 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-951cf7e2-848a-49c3-84a9-c510704c75a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:28.061271 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951cf7e2-848a-49c3-84a9-c510704c75a0 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:28.126019 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5448172d-8fc7-4519-8bb9-887ee686602b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:28.126905 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448172d-8fc7-4519-8bb9-887ee686602b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:28.127189 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448172d-8fc7-4519-8bb9-887ee686602b admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:28.127467 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448172d-8fc7-4519-8bb9-887ee686602b admin admin] PATH_INFO: `/v3/users/1122c683ee764274a14a0f260a3507d9` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:28.129062 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5448172d-8fc7-4519-8bb9-887ee686602b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1122c683ee764274a14a0f260a3507d9)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:28.131930 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5448172d-8fc7-4519-8bb9-887ee686602b admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:28.200673 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-5448172d-8fc7-4519-8bb9-887ee686602b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1122c683ee764274a14a0f260a3507d9'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:28.204938 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:28.214967 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-5448172d-8fc7-4519-8bb9-887ee686602b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1122c683ee764274a14a0f260a3507d9'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:28.219477 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-5448172d-8fc7-4519-8bb9-887ee686602b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1122c683ee764274a14a0f260a3507d9'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:28.219477 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-5448172d-8fc7-4519-8bb9-887ee686602b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1122c683ee764274a14a0f260a3507d9'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:28.238510 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-5448172d-8fc7-4519-8bb9-887ee686602b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1122c683ee764274a14a0f260a3507d9'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:28.252612 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1229/2473] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:22:28 2022] DELETE /identity/v3/users/1122c683ee764274a14a0f260a3507d9 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:28.541955 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf94abf-5534-466a-b591-0b2613e83fe4 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:28.543758 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-ddf94abf-5534-466a-b591-0b2613e83fe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:28.547195 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5448172d-8fc7-4519-8bb9-887ee686602b admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:28.548568 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-5448172d-8fc7-4519-8bb9-887ee686602b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:28.558506 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf94abf-5534-466a-b591-0b2613e83fe4 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:28.609245 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5448172d-8fc7-4519-8bb9-887ee686602b admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:28.613313 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb32c00e-4c42-4c8f-83a8-bbe81bdbac4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:28.614069 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32c00e-4c42-4c8f-83a8-bbe81bdbac4e service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:28.614353 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32c00e-4c42-4c8f-83a8-bbe81bdbac4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:28.614646 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32c00e-4c42-4c8f-83a8-bbe81bdbac4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:28.617012 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-fb32c00e-4c42-4c8f-83a8-bbe81bdbac4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:28.618290 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88baf97d-da18-49e2-90ce-245cc7ec70fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:28.619264 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88baf97d-da18-49e2-90ce-245cc7ec70fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:28.619644 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88baf97d-da18-49e2-90ce-245cc7ec70fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:28.619983 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88baf97d-da18-49e2-90ce-245cc7ec70fa admin admin] PATH_INFO: `/v3/projects/e3df722a57284270b3e22f90b53751ca` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:28.621238 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88baf97d-da18-49e2-90ce-245cc7ec70fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3df722a57284270b3e22f90b53751ca)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:28.623144 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88baf97d-da18-49e2-90ce-245cc7ec70fa admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:28.635874 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:28.673564 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-88baf97d-da18-49e2-90ce-245cc7ec70fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3df722a57284270b3e22f90b53751ca', 'request_id': 'req-88baf97d-da18-49e2-90ce-245cc7ec70fa'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:28.680268 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-88baf97d-da18-49e2-90ce-245cc7ec70fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3df722a57284270b3e22f90b53751ca', 'request_id': 'req-88baf97d-da18-49e2-90ce-245cc7ec70fa'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:28.684628 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb32c00e-4c42-4c8f-83a8-bbe81bdbac4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:28.686179 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb32c00e-4c42-4c8f-83a8-bbe81bdbac4e service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:28.687862 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-88baf97d-da18-49e2-90ce-245cc7ec70fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3df722a57284270b3e22f90b53751ca', 'request_id': 'req-88baf97d-da18-49e2-90ce-245cc7ec70fa'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:28.697398 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1230/2474] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:22:28 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:22:28.699766 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-88baf97d-da18-49e2-90ce-245cc7ec70fa admin admin] The token cache is being invalidate because project e3df722a57284270b3e22f90b53751ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:22:28.700065 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-88baf97d-da18-49e2-90ce-245cc7ec70fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:28.700687 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-88baf97d-da18-49e2-90ce-245cc7ec70fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:28.702232 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1245/2475] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:22:28 2022] DELETE /identity/v3/projects/e3df722a57284270b3e22f90b53751ca => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:28.708111 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f81d0a-8147-44ee-8f7e-c55201507af7 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:28.708562 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f81d0a-8147-44ee-8f7e-c55201507af7 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:28.709050 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f81d0a-8147-44ee-8f7e-c55201507af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:28.730056 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-05f81d0a-8147-44ee-8f7e-c55201507af7 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:28.731528 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-05f81d0a-8147-44ee-8f7e-c55201507af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:28.793975 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1231/2476] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:22:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:22:28.802385 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8d56f-294d-44eb-896b-f43dae5522c0 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:28.803423 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8d56f-294d-44eb-896b-f43dae5522c0 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:28.803713 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8d56f-294d-44eb-896b-f43dae5522c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:28.823274 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-eca8d56f-294d-44eb-896b-f43dae5522c0 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:28.824767 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-eca8d56f-294d-44eb-896b-f43dae5522c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:28.834179 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1246/2477] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:22:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:22:28.838664 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f81d0a-8147-44ee-8f7e-c55201507af7 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:28.848499 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f81d0a-8147-44ee-8f7e-c55201507af7 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:28.853963 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e045b4-6dbd-442d-b977-f4ed70974011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:28.854713 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e045b4-6dbd-442d-b977-f4ed70974011 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:28.854991 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e045b4-6dbd-442d-b977-f4ed70974011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:28.855506 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e045b4-6dbd-442d-b977-f4ed70974011 admin admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:28.856238 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e045b4-6dbd-442d-b977-f4ed70974011 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:22:28.856543 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e045b4-6dbd-442d-b977-f4ed70974011 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:28.858208 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e045b4-6dbd-442d-b977-f4ed70974011 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:28.870668 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1232/2478] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:22:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:22:28.875313 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca8d56f-294d-44eb-896b-f43dae5522c0 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:28.886881 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca8d56f-294d-44eb-896b-f43dae5522c0 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:28.892682 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272b18f-f6e6-43c7-98e3-51d4b9ae18c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:28.893386 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272b18f-f6e6-43c7-98e3-51d4b9ae18c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:28.893669 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272b18f-f6e6-43c7-98e3-51d4b9ae18c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:28.893945 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272b18f-f6e6-43c7-98e3-51d4b9ae18c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:28.894654 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d272b18f-f6e6-43c7-98e3-51d4b9ae18c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:28.896591 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d272b18f-f6e6-43c7-98e3-51d4b9ae18c8 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:28.924737 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1247/2479] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:22:28 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:22:28.928499 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e045b4-6dbd-442d-b977-f4ed70974011 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:28.935049 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:28.939581 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e045b4-6dbd-442d-b977-f4ed70974011 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:29.001934 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d32c97-cc83-4e59-a8ea-34d3e37b0038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:29.002614 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d32c97-cc83-4e59-a8ea-34d3e37b0038 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:29.002900 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d32c97-cc83-4e59-a8ea-34d3e37b0038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:29.003171 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d32c97-cc83-4e59-a8ea-34d3e37b0038 admin admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:29.003950 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d32c97-cc83-4e59-a8ea-34d3e37b0038 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:29.006292 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d32c97-cc83-4e59-a8ea-34d3e37b0038 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:29.026357 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1233/2480] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:22:28 2022] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:22:29.030399 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272b18f-f6e6-43c7-98e3-51d4b9ae18c8 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:29.041631 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272b18f-f6e6-43c7-98e3-51d4b9ae18c8 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:29.046584 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f624a-868e-4f06-b4a9-2cd6efffe623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:29.047318 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f624a-868e-4f06-b4a9-2cd6efffe623 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:29.047670 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f624a-868e-4f06-b4a9-2cd6efffe623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:29.048013 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f624a-868e-4f06-b4a9-2cd6efffe623 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:29.048934 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0f624a-868e-4f06-b4a9-2cd6efffe623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:29.050604 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0f624a-868e-4f06-b4a9-2cd6efffe623 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:29.061961 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1248/2481] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:22:29.066006 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d32c97-cc83-4e59-a8ea-34d3e37b0038 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:29.076270 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d32c97-cc83-4e59-a8ea-34d3e37b0038 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:29.081083 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f922a-3c53-47e0-ba2e-806ac422b55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:29.081753 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f922a-3c53-47e0-ba2e-806ac422b55d admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:29.082037 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f922a-3c53-47e0-ba2e-806ac422b55d admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:29.082311 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f922a-3c53-47e0-ba2e-806ac422b55d admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:29.083045 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810f922a-3c53-47e0-ba2e-806ac422b55d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:29.085237 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810f922a-3c53-47e0-ba2e-806ac422b55d admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:29.095370 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1234/2482] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:22:29.100424 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f624a-868e-4f06-b4a9-2cd6efffe623 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:29.111624 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f624a-868e-4f06-b4a9-2cd6efffe623 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:29.116524 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c042b1-43a2-401b-8206-5079894beb9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:29.117454 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c042b1-43a2-401b-8206-5079894beb9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:29.117740 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c042b1-43a2-401b-8206-5079894beb9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:29.118021 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c042b1-43a2-401b-8206-5079894beb9b admin admin] PATH_INFO: `/v3/projects/9195e38b08a044d5b346f737164ca651/users/4c5ec195c8d640958a0a6da57a3106de/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:29.133171 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c042b1-43a2-401b-8206-5079894beb9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9195e38b08a044d5b346f737164ca651, user_id=4c5ec195c8d640958a0a6da57a3106de, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:29.136169 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c042b1-43a2-401b-8206-5079894beb9b admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:29.153908 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1249/2483] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:22:29 2022] PUT /identity/v3/projects/9195e38b08a044d5b346f737164ca651/users/4c5ec195c8d640958a0a6da57a3106de/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:29.167224 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca9d4e-5a14-4a0a-895e-695bc4bdf253 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:29.167579 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca9d4e-5a14-4a0a-895e-695bc4bdf253 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:29.167892 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca9d4e-5a14-4a0a-895e-695bc4bdf253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:29.194657 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-92ca9d4e-5a14-4a0a-895e-695bc4bdf253 None None] MFA Rules not processed for user `4c5ec195c8d640958a0a6da57a3106de`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:29.195883 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-92ca9d4e-5a14-4a0a-895e-695bc4bdf253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:29.277526 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1235/2484] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:22:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:22:29.281924 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c042b1-43a2-401b-8206-5079894beb9b admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:29.348643 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c042b1-43a2-401b-8206-5079894beb9b admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:29.354353 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fa3870-2605-438e-b89e-3a46f22aaecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:29.355031 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa3870-2605-438e-b89e-3a46f22aaecb admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:29.355570 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa3870-2605-438e-b89e-3a46f22aaecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:29.355845 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa3870-2605-438e-b89e-3a46f22aaecb admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:29.356556 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fa3870-2605-438e-b89e-3a46f22aaecb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:29.358558 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fa3870-2605-438e-b89e-3a46f22aaecb admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:29.386190 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1250/2485] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:22:29 2022] POST /identity/v3/projects => generated 387 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:22:29.390195 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca9d4e-5a14-4a0a-895e-695bc4bdf253 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:29.402421 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca9d4e-5a14-4a0a-895e-695bc4bdf253 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:29.465296 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b951cd-5f76-4034-ae19-42bc478829b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:29.465977 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b951cd-5f76-4034-ae19-42bc478829b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:29.466259 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b951cd-5f76-4034-ae19-42bc478829b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:29.466532 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b951cd-5f76-4034-ae19-42bc478829b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:29.467239 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b951cd-5f76-4034-ae19-42bc478829b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:29.469277 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b951cd-5f76-4034-ae19-42bc478829b7 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:29.495271 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1236/2486] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:22:29 2022] POST /identity/v3/users => generated 300 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:22:29.496607 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fa3870-2605-438e-b89e-3a46f22aaecb admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:29.507347 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fa3870-2605-438e-b89e-3a46f22aaecb admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:29.512103 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8647b2-67af-427a-a97c-22a1ddfde3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:29.512817 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8647b2-67af-427a-a97c-22a1ddfde3eb admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:29.513098 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8647b2-67af-427a-a97c-22a1ddfde3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:29.513372 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8647b2-67af-427a-a97c-22a1ddfde3eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:29.514100 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8647b2-67af-427a-a97c-22a1ddfde3eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:29.515686 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8647b2-67af-427a-a97c-22a1ddfde3eb admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:29.528977 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1251/2487] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:22:29.533202 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b951cd-5f76-4034-ae19-42bc478829b7 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:29.542923 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:29.549879 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b951cd-5f76-4034-ae19-42bc478829b7 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:29.556478 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823aa84e-2135-43e3-b6bc-bbf795b027c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:29.558068 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823aa84e-2135-43e3-b6bc-bbf795b027c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:29.558353 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823aa84e-2135-43e3-b6bc-bbf795b027c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:29.559119 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823aa84e-2135-43e3-b6bc-bbf795b027c9 admin admin] PATH_INFO: `/v3/projects/76f6eaf1d0884f539d430a81aec29409/users/b87109af0b604abda488a0ed891205a9/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:29.574292 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823aa84e-2135-43e3-b6bc-bbf795b027c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76f6eaf1d0884f539d430a81aec29409, user_id=b87109af0b604abda488a0ed891205a9, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:29.577017 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823aa84e-2135-43e3-b6bc-bbf795b027c9 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:29.590226 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1237/2488] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:22:29 2022] PUT /identity/v3/projects/76f6eaf1d0884f539d430a81aec29409/users/b87109af0b604abda488a0ed891205a9/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:29.594368 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8647b2-67af-427a-a97c-22a1ddfde3eb admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:29.605091 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8647b2-67af-427a-a97c-22a1ddfde3eb admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:29.613496 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:29.665952 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ac63e-dcab-4bf6-96e1-f21083f3c573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:29.666534 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ac63e-dcab-4bf6-96e1-f21083f3c573 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:29.666817 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ac63e-dcab-4bf6-96e1-f21083f3c573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:29.667205 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ac63e-dcab-4bf6-96e1-f21083f3c573 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:29.668045 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2ac63e-dcab-4bf6-96e1-f21083f3c573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:29.669677 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2ac63e-dcab-4bf6-96e1-f21083f3c573 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:29.680434 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1252/2489] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:22:29.684573 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823aa84e-2135-43e3-b6bc-bbf795b027c9 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:29.695144 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823aa84e-2135-43e3-b6bc-bbf795b027c9 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:29.699711 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a158f3e5-973d-4210-9515-571d9ccbaca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:29.700592 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158f3e5-973d-4210-9515-571d9ccbaca2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:29.700902 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158f3e5-973d-4210-9515-571d9ccbaca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:29.701177 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158f3e5-973d-4210-9515-571d9ccbaca2 admin admin] PATH_INFO: `/v3/projects/76f6eaf1d0884f539d430a81aec29409/users/b87109af0b604abda488a0ed891205a9/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:29.703143 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a158f3e5-973d-4210-9515-571d9ccbaca2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76f6eaf1d0884f539d430a81aec29409, user_id=b87109af0b604abda488a0ed891205a9, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:29.705831 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a158f3e5-973d-4210-9515-571d9ccbaca2 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:29.716965 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1238/2490] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:22:29 2022] PUT /identity/v3/projects/76f6eaf1d0884f539d430a81aec29409/users/b87109af0b604abda488a0ed891205a9/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:29.727496 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60b475-f72a-417e-afe4-064e5bb1f2dc None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:29.727786 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60b475-f72a-417e-afe4-064e5bb1f2dc None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:29.728060 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60b475-f72a-417e-afe4-064e5bb1f2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:29.756691 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-2e60b475-f72a-417e-afe4-064e5bb1f2dc None None] MFA Rules not processed for user `b87109af0b604abda488a0ed891205a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:29.758051 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-2e60b475-f72a-417e-afe4-064e5bb1f2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:29.828070 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1253/2491] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:22:29 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:22:29.840151 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a158f3e5-973d-4210-9515-571d9ccbaca2 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:29.842034 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-a158f3e5-973d-4210-9515-571d9ccbaca2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:29.900310 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a158f3e5-973d-4210-9515-571d9ccbaca2 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:29.903965 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2547f0e-aae7-4c1e-8561-bfcf54f80acd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:29.904611 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2547f0e-aae7-4c1e-8561-bfcf54f80acd service cinder] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:29.904919 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2547f0e-aae7-4c1e-8561-bfcf54f80acd service cinder] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:29.905193 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2547f0e-aae7-4c1e-8561-bfcf54f80acd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:29.914734 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2547f0e-aae7-4c1e-8561-bfcf54f80acd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:29.916214 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2547f0e-aae7-4c1e-8561-bfcf54f80acd service cinder] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:29.925691 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1239/2492] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:22:29 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:22:30.524214 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60b475-f72a-417e-afe4-064e5bb1f2dc None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:30.602647 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60b475-f72a-417e-afe4-064e5bb1f2dc None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:30.607582 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc36484-0f39-4248-b7f4-a7fbab016651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:30.608455 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc36484-0f39-4248-b7f4-a7fbab016651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:30.608758 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc36484-0f39-4248-b7f4-a7fbab016651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:30.609033 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc36484-0f39-4248-b7f4-a7fbab016651 admin admin] PATH_INFO: `/v3/users/4c5ec195c8d640958a0a6da57a3106de` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:30.610246 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc36484-0f39-4248-b7f4-a7fbab016651 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c5ec195c8d640958a0a6da57a3106de)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:30.612150 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc36484-0f39-4248-b7f4-a7fbab016651 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:30.660273 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:30.676171 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-bbc36484-0f39-4248-b7f4-a7fbab016651 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c5ec195c8d640958a0a6da57a3106de'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:30.685346 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-bbc36484-0f39-4248-b7f4-a7fbab016651 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c5ec195c8d640958a0a6da57a3106de'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:30.695700 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-bbc36484-0f39-4248-b7f4-a7fbab016651 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c5ec195c8d640958a0a6da57a3106de'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:30.712103 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-bbc36484-0f39-4248-b7f4-a7fbab016651 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c5ec195c8d640958a0a6da57a3106de'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:30.713163 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-bbc36484-0f39-4248-b7f4-a7fbab016651 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c5ec195c8d640958a0a6da57a3106de'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:30.721820 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1254/2493] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:22:30 2022] DELETE /identity/v3/users/4c5ec195c8d640958a0a6da57a3106de => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:30.726646 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a9370-67bd-48a4-9457-2e6e24d43c87 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:30.726646 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a9370-67bd-48a4-9457-2e6e24d43c87 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:30.726646 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a9370-67bd-48a4-9457-2e6e24d43c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:30.749613 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-073a9370-67bd-48a4-9457-2e6e24d43c87 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:30.750948 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-073a9370-67bd-48a4-9457-2e6e24d43c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:30.825351 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1240/2494] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:22:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:22:30.835798 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc36484-0f39-4248-b7f4-a7fbab016651 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:30.837700 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-bbc36484-0f39-4248-b7f4-a7fbab016651 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:30.903362 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc36484-0f39-4248-b7f4-a7fbab016651 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:30.907137 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01400da5-f8cf-48f4-bc28-5106615b22c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:30.907788 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01400da5-f8cf-48f4-bc28-5106615b22c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:30.908074 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01400da5-f8cf-48f4-bc28-5106615b22c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:30.908350 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01400da5-f8cf-48f4-bc28-5106615b22c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:30.920821 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01400da5-f8cf-48f4-bc28-5106615b22c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:30.922358 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01400da5-f8cf-48f4-bc28-5106615b22c5 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:30.933648 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1255/2495] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:22:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:22:31.282357 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a9370-67bd-48a4-9457-2e6e24d43c87 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:31.284023 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-073a9370-67bd-48a4-9457-2e6e24d43c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:31.297884 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a9370-67bd-48a4-9457-2e6e24d43c87 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:31.304276 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d3d07-9f1d-4f23-868a-7b77b8defe24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:31.305363 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d3d07-9f1d-4f23-868a-7b77b8defe24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:31.305779 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d3d07-9f1d-4f23-868a-7b77b8defe24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:31.306153 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d3d07-9f1d-4f23-868a-7b77b8defe24 admin admin] PATH_INFO: `/v3/projects/9195e38b08a044d5b346f737164ca651` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:31.307530 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08d3d07-9f1d-4f23-868a-7b77b8defe24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9195e38b08a044d5b346f737164ca651)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:31.309719 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08d3d07-9f1d-4f23-868a-7b77b8defe24 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:31.373329 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-c08d3d07-9f1d-4f23-868a-7b77b8defe24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9195e38b08a044d5b346f737164ca651', 'request_id': 'req-c08d3d07-9f1d-4f23-868a-7b77b8defe24'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:31.382117 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-c08d3d07-9f1d-4f23-868a-7b77b8defe24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9195e38b08a044d5b346f737164ca651', 'request_id': 'req-c08d3d07-9f1d-4f23-868a-7b77b8defe24'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:31.388033 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:31.390141 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-c08d3d07-9f1d-4f23-868a-7b77b8defe24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9195e38b08a044d5b346f737164ca651', 'request_id': 'req-c08d3d07-9f1d-4f23-868a-7b77b8defe24'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:31.406404 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-c08d3d07-9f1d-4f23-868a-7b77b8defe24 admin admin] The token cache is being invalidate because project 9195e38b08a044d5b346f737164ca651 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:22:31.406695 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-c08d3d07-9f1d-4f23-868a-7b77b8defe24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:31.407506 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-c08d3d07-9f1d-4f23-868a-7b77b8defe24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:31.409092 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1241/2496] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:22:31 2022] DELETE /identity/v3/projects/9195e38b08a044d5b346f737164ca651 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:31.414337 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01400da5-f8cf-48f4-bc28-5106615b22c5 service neutron] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:31.429100 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01400da5-f8cf-48f4-bc28-5106615b22c5 service neutron] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:31.488794 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b8d53-3983-4e35-91c1-0278399ac4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:31.489744 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b8d53-3983-4e35-91c1-0278399ac4a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:31.490258 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b8d53-3983-4e35-91c1-0278399ac4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:31.490554 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b8d53-3983-4e35-91c1-0278399ac4a0 admin admin] PATH_INFO: `/v3/users/b87109af0b604abda488a0ed891205a9` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:31.491829 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20b8d53-3983-4e35-91c1-0278399ac4a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b87109af0b604abda488a0ed891205a9)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:31.493707 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20b8d53-3983-4e35-91c1-0278399ac4a0 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:31.543309 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e20b8d53-3983-4e35-91c1-0278399ac4a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b87109af0b604abda488a0ed891205a9'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:31.551025 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e20b8d53-3983-4e35-91c1-0278399ac4a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b87109af0b604abda488a0ed891205a9'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:31.553332 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:31.560526 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e20b8d53-3983-4e35-91c1-0278399ac4a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b87109af0b604abda488a0ed891205a9'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:31.574376 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e20b8d53-3983-4e35-91c1-0278399ac4a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b87109af0b604abda488a0ed891205a9'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:31.575358 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e20b8d53-3983-4e35-91c1-0278399ac4a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b87109af0b604abda488a0ed891205a9'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:31.581664 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1256/2497] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:22:31 2022] DELETE /identity/v3/users/b87109af0b604abda488a0ed891205a9 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:31.864065 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d3d07-9f1d-4f23-868a-7b77b8defe24 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:31.866170 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-c08d3d07-9f1d-4f23-868a-7b77b8defe24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:31.879489 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d3d07-9f1d-4f23-868a-7b77b8defe24 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:31.938783 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6a2e3-91f2-4476-80fd-4af7fcf80e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:31.939651 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6a2e3-91f2-4476-80fd-4af7fcf80e86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:31.939936 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6a2e3-91f2-4476-80fd-4af7fcf80e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:31.940213 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6a2e3-91f2-4476-80fd-4af7fcf80e86 admin admin] PATH_INFO: `/v3/projects/76f6eaf1d0884f539d430a81aec29409` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:31.941413 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a6a2e3-91f2-4476-80fd-4af7fcf80e86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76f6eaf1d0884f539d430a81aec29409)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:31.943943 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a6a2e3-91f2-4476-80fd-4af7fcf80e86 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:31.991096 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-38a6a2e3-91f2-4476-80fd-4af7fcf80e86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76f6eaf1d0884f539d430a81aec29409', 'request_id': 'req-38a6a2e3-91f2-4476-80fd-4af7fcf80e86'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:31.998855 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-38a6a2e3-91f2-4476-80fd-4af7fcf80e86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76f6eaf1d0884f539d430a81aec29409', 'request_id': 'req-38a6a2e3-91f2-4476-80fd-4af7fcf80e86'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:32.004541 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-38a6a2e3-91f2-4476-80fd-4af7fcf80e86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76f6eaf1d0884f539d430a81aec29409', 'request_id': 'req-38a6a2e3-91f2-4476-80fd-4af7fcf80e86'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:32.015950 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-38a6a2e3-91f2-4476-80fd-4af7fcf80e86 admin admin] The token cache is being invalidate because project 76f6eaf1d0884f539d430a81aec29409 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:22:32.016233 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-38a6a2e3-91f2-4476-80fd-4af7fcf80e86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:32.016877 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-38a6a2e3-91f2-4476-80fd-4af7fcf80e86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:32.018392 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1242/2498] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:22:31 2022] DELETE /identity/v3/projects/76f6eaf1d0884f539d430a81aec29409 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:32.024041 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2668038-a427-409e-b9cb-78bc5d33f7ae None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:32.024327 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2668038-a427-409e-b9cb-78bc5d33f7ae None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:32.024603 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2668038-a427-409e-b9cb-78bc5d33f7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:32.042633 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-f2668038-a427-409e-b9cb-78bc5d33f7ae None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:32.044028 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-f2668038-a427-409e-b9cb-78bc5d33f7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:32.103026 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1257/2499] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:22:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:22:32.111198 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001648a-a97f-4132-9214-f01c7b8158c2 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:32.111487 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001648a-a97f-4132-9214-f01c7b8158c2 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:32.111764 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001648a-a97f-4132-9214-f01c7b8158c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:32.130436 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-3001648a-a97f-4132-9214-f01c7b8158c2 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:32.131461 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-3001648a-a97f-4132-9214-f01c7b8158c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:32.139461 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1243/2500] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:22:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:22:32.143351 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2668038-a427-409e-b9cb-78bc5d33f7ae None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:32.153494 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2668038-a427-409e-b9cb-78bc5d33f7ae None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:32.157937 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2863f1b8-dbcb-442b-9f5c-a2e3c780f196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:32.158576 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2863f1b8-dbcb-442b-9f5c-a2e3c780f196 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:32.158855 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2863f1b8-dbcb-442b-9f5c-a2e3c780f196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:32.159127 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2863f1b8-dbcb-442b-9f5c-a2e3c780f196 admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:32.159842 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2863f1b8-dbcb-442b-9f5c-a2e3c780f196 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:22:32.160149 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2863f1b8-dbcb-442b-9f5c-a2e3c780f196 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:32.162306 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2863f1b8-dbcb-442b-9f5c-a2e3c780f196 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:32.174179 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1258/2501] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:22:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:22:32.178444 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001648a-a97f-4132-9214-f01c7b8158c2 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:32.187495 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001648a-a97f-4132-9214-f01c7b8158c2 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:32.192036 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e2a342-5338-4c8f-9950-956abc664b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:32.192712 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e2a342-5338-4c8f-9950-956abc664b8b admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:32.193002 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e2a342-5338-4c8f-9950-956abc664b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:32.193274 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e2a342-5338-4c8f-9950-956abc664b8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:32.193952 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e2a342-5338-4c8f-9950-956abc664b8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:32.195830 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e2a342-5338-4c8f-9950-956abc664b8b admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:32.220432 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1244/2502] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:22:32 2022] POST /identity/v3/projects => generated 363 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:22:32.224949 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2863f1b8-dbcb-442b-9f5c-a2e3c780f196 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:32.234887 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2863f1b8-dbcb-442b-9f5c-a2e3c780f196 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:32.290363 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107a5f6-681f-4e10-93c5-65debf51a6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:32.290972 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107a5f6-681f-4e10-93c5-65debf51a6a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:32.291249 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107a5f6-681f-4e10-93c5-65debf51a6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:32.291520 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107a5f6-681f-4e10-93c5-65debf51a6a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:32.292199 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b107a5f6-681f-4e10-93c5-65debf51a6a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:32.294128 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b107a5f6-681f-4e10-93c5-65debf51a6a2 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:32.315892 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1259/2503] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:22:32 2022] POST /identity/v3/users => generated 282 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:22:32.317336 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e2a342-5338-4c8f-9950-956abc664b8b admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:32.327562 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e2a342-5338-4c8f-9950-956abc664b8b admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:32.332075 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a252d1-59ef-452f-9783-f7972288f28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:32.332748 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a252d1-59ef-452f-9783-f7972288f28e admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:32.333032 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a252d1-59ef-452f-9783-f7972288f28e admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:32.333304 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a252d1-59ef-452f-9783-f7972288f28e admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:32.334812 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a252d1-59ef-452f-9783-f7972288f28e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:32.336394 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a252d1-59ef-452f-9783-f7972288f28e admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:32.346704 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1245/2504] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:22:32.351351 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107a5f6-681f-4e10-93c5-65debf51a6a2 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:32.362275 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107a5f6-681f-4e10-93c5-65debf51a6a2 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:32.367069 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4180a7fd-99e9-4a9b-8423-6147386399da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:32.367722 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180a7fd-99e9-4a9b-8423-6147386399da admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:32.368007 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180a7fd-99e9-4a9b-8423-6147386399da admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:32.368287 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180a7fd-99e9-4a9b-8423-6147386399da admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:32.369052 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4180a7fd-99e9-4a9b-8423-6147386399da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:32.370640 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4180a7fd-99e9-4a9b-8423-6147386399da admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:32.382661 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1260/2505] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:22:32.386728 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a252d1-59ef-452f-9783-f7972288f28e admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:32.398165 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a252d1-59ef-452f-9783-f7972288f28e admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:32.402800 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d603c-8d37-4ec0-8e27-55b71ce5e09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:32.403678 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d603c-8d37-4ec0-8e27-55b71ce5e09c admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:32.403955 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d603c-8d37-4ec0-8e27-55b71ce5e09c admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:32.404227 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d603c-8d37-4ec0-8e27-55b71ce5e09c admin admin] PATH_INFO: `/v3/projects/cc39d799725048868f4448f94e18318d/users/521de1a6cf4e471e824bbccf82ba9ec6/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:32.421099 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3d603c-8d37-4ec0-8e27-55b71ce5e09c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc39d799725048868f4448f94e18318d, user_id=521de1a6cf4e471e824bbccf82ba9ec6, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:32.423744 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3d603c-8d37-4ec0-8e27-55b71ce5e09c admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:32.436955 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1246/2506] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:22:32 2022] PUT /identity/v3/projects/cc39d799725048868f4448f94e18318d/users/521de1a6cf4e471e824bbccf82ba9ec6/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:32.448835 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42501841-a5a0-4346-bcbf-6fbb385cf711 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:32.449314 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42501841-a5a0-4346-bcbf-6fbb385cf711 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:32.449666 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42501841-a5a0-4346-bcbf-6fbb385cf711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:32.477355 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-42501841-a5a0-4346-bcbf-6fbb385cf711 None None] MFA Rules not processed for user `521de1a6cf4e471e824bbccf82ba9ec6`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:32.478565 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-42501841-a5a0-4346-bcbf-6fbb385cf711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:32.506914 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:32.543926 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1261/2507] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:22:32 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:22:32.555177 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d603c-8d37-4ec0-8e27-55b71ce5e09c admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:32.556870 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-9e3d603c-8d37-4ec0-8e27-55b71ce5e09c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:32.577269 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:32.616187 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d603c-8d37-4ec0-8e27-55b71ce5e09c admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:32.619754 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f6d74-2955-4240-9d0b-c6420c1f7572 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:32.620395 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f6d74-2955-4240-9d0b-c6420c1f7572 service cinder] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:32.621137 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f6d74-2955-4240-9d0b-c6420c1f7572 service cinder] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:32.621137 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f6d74-2955-4240-9d0b-c6420c1f7572 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:32.629587 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f6d74-2955-4240-9d0b-c6420c1f7572 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:32.631659 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f6d74-2955-4240-9d0b-c6420c1f7572 service cinder] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:32.640646 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1247/2508] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:22:32 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:22:42.540999 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=14 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:42.636528 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=18 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:51.075929 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42501841-a5a0-4346-bcbf-6fbb385cf711 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:51.077359 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-42501841-a5a0-4346-bcbf-6fbb385cf711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:51.139654 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42501841-a5a0-4346-bcbf-6fbb385cf711 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:51.143094 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5b0dbb-2bc4-465a-a907-fad9cd7cb37c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:51.143735 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b0dbb-2bc4-465a-a907-fad9cd7cb37c service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:51.144020 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b0dbb-2bc4-465a-a907-fad9cd7cb37c service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:51.144294 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b0dbb-2bc4-465a-a907-fad9cd7cb37c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:51.147092 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-ef5b0dbb-2bc4-465a-a907-fad9cd7cb37c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:51.213728 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5b0dbb-2bc4-465a-a907-fad9cd7cb37c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:51.215168 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5b0dbb-2bc4-465a-a907-fad9cd7cb37c service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:51.225381 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1262/2509] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:22:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:22:54.357873 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f6d74-2955-4240-9d0b-c6420c1f7572 service cinder] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:54.359424 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-968f6d74-2955-4240-9d0b-c6420c1f7572 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:54.375541 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f6d74-2955-4240-9d0b-c6420c1f7572 service cinder] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:54.380283 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33075dd0-b20e-425c-be8a-66f2734c3d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:54.381362 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33075dd0-b20e-425c-be8a-66f2734c3d72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:54.381653 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33075dd0-b20e-425c-be8a-66f2734c3d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:54.381931 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33075dd0-b20e-425c-be8a-66f2734c3d72 admin admin] PATH_INFO: `/v3/users/68c4b81f2f704a9bbe15fd0f3326bb3e` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:54.398046 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33075dd0-b20e-425c-be8a-66f2734c3d72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68c4b81f2f704a9bbe15fd0f3326bb3e)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:54.399996 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33075dd0-b20e-425c-be8a-66f2734c3d72 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:54.467113 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-33075dd0-b20e-425c-be8a-66f2734c3d72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68c4b81f2f704a9bbe15fd0f3326bb3e'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:54.479651 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-33075dd0-b20e-425c-be8a-66f2734c3d72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68c4b81f2f704a9bbe15fd0f3326bb3e'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:54.480594 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-33075dd0-b20e-425c-be8a-66f2734c3d72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68c4b81f2f704a9bbe15fd0f3326bb3e'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:54.481307 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-33075dd0-b20e-425c-be8a-66f2734c3d72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68c4b81f2f704a9bbe15fd0f3326bb3e'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:54.496608 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-33075dd0-b20e-425c-be8a-66f2734c3d72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68c4b81f2f704a9bbe15fd0f3326bb3e'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:54.508941 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1248/2510] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:22:54 2022] DELETE /identity/v3/users/68c4b81f2f704a9bbe15fd0f3326bb3e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:54.680437 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5b0dbb-2bc4-465a-a907-fad9cd7cb37c service neutron] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:54.690893 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5b0dbb-2bc4-465a-a907-fad9cd7cb37c service neutron] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:54.752846 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3bf661-ba8d-4897-a4d6-2bef67156d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:54.753642 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3bf661-ba8d-4897-a4d6-2bef67156d33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:54.753928 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3bf661-ba8d-4897-a4d6-2bef67156d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:54.754205 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3bf661-ba8d-4897-a4d6-2bef67156d33 admin admin] PATH_INFO: `/v3/projects/adba1d74cb2441a9a238dc0e6a47c112` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:54.765729 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3bf661-ba8d-4897-a4d6-2bef67156d33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adba1d74cb2441a9a238dc0e6a47c112)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:54.768080 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3bf661-ba8d-4897-a4d6-2bef67156d33 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:54.817297 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:54.821774 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-6e3bf661-ba8d-4897-a4d6-2bef67156d33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adba1d74cb2441a9a238dc0e6a47c112', 'request_id': 'req-6e3bf661-ba8d-4897-a4d6-2bef67156d33'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:54.827923 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-6e3bf661-ba8d-4897-a4d6-2bef67156d33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adba1d74cb2441a9a238dc0e6a47c112', 'request_id': 'req-6e3bf661-ba8d-4897-a4d6-2bef67156d33'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:54.835287 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-6e3bf661-ba8d-4897-a4d6-2bef67156d33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adba1d74cb2441a9a238dc0e6a47c112', 'request_id': 'req-6e3bf661-ba8d-4897-a4d6-2bef67156d33'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:54.846689 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-6e3bf661-ba8d-4897-a4d6-2bef67156d33 admin admin] The token cache is being invalidate because project adba1d74cb2441a9a238dc0e6a47c112 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:22:54.846975 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-6e3bf661-ba8d-4897-a4d6-2bef67156d33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:54.847628 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-6e3bf661-ba8d-4897-a4d6-2bef67156d33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:54.850319 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1263/2511] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:22:54 2022] DELETE /identity/v3/projects/adba1d74cb2441a9a238dc0e6a47c112 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:54.855692 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9266ec7-db72-4b2d-a316-7c35d7e898f3 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:54.855926 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9266ec7-db72-4b2d-a316-7c35d7e898f3 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:54.856231 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9266ec7-db72-4b2d-a316-7c35d7e898f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:54.875504 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-f9266ec7-db72-4b2d-a316-7c35d7e898f3 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:54.876939 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-f9266ec7-db72-4b2d-a316-7c35d7e898f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:54.937026 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1249/2512] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:22:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:22:54.945188 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef21a73-89aa-499d-8623-39c5b1d100ee None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:54.945478 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef21a73-89aa-499d-8623-39c5b1d100ee None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:54.945757 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef21a73-89aa-499d-8623-39c5b1d100ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:54.963745 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-8ef21a73-89aa-499d-8623-39c5b1d100ee None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:54.964988 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-8ef21a73-89aa-499d-8623-39c5b1d100ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:54.973553 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1264/2513] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:22:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:22:54.978456 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9266ec7-db72-4b2d-a316-7c35d7e898f3 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:54.989633 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9266ec7-db72-4b2d-a316-7c35d7e898f3 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:54.994079 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e5684-42c4-4068-9769-3e88493635af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:54.994740 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e5684-42c4-4068-9769-3e88493635af admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:54.995025 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e5684-42c4-4068-9769-3e88493635af admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:54.995304 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e5684-42c4-4068-9769-3e88493635af admin admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:54.996031 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956e5684-42c4-4068-9769-3e88493635af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:22:54.996343 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956e5684-42c4-4068-9769-3e88493635af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:54.997986 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956e5684-42c4-4068-9769-3e88493635af admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:55.010124 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1250/2514] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:22:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:22:55.014589 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef21a73-89aa-499d-8623-39c5b1d100ee None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:55.024497 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef21a73-89aa-499d-8623-39c5b1d100ee None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:55.029204 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ef6494-c6bd-4615-b87f-c33e605ced52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:55.029855 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef6494-c6bd-4615-b87f-c33e605ced52 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:55.030166 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef6494-c6bd-4615-b87f-c33e605ced52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:55.030447 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef6494-c6bd-4615-b87f-c33e605ced52 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:55.031149 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ef6494-c6bd-4615-b87f-c33e605ced52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:55.033071 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ef6494-c6bd-4615-b87f-c33e605ced52 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:55.063554 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1265/2515] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:22:55 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:22:55.068512 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e5684-42c4-4068-9769-3e88493635af admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:55.078943 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e5684-42c4-4068-9769-3e88493635af admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:55.133950 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:55.151510 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef9502-e404-4aa2-aa24-7a5b8b05b1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:55.152195 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef9502-e404-4aa2-aa24-7a5b8b05b1fa admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:55.152485 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef9502-e404-4aa2-aa24-7a5b8b05b1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:55.152783 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef9502-e404-4aa2-aa24-7a5b8b05b1fa admin admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:55.153528 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef9502-e404-4aa2-aa24-7a5b8b05b1fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:55.155521 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef9502-e404-4aa2-aa24-7a5b8b05b1fa admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:55.178974 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1251/2516] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:22:55 2022] POST /identity/v3/users => generated 286 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:22:55.182904 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ef6494-c6bd-4615-b87f-c33e605ced52 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:55.194113 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ef6494-c6bd-4615-b87f-c33e605ced52 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:55.198926 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db00d4-41f3-4d25-ab2b-b12453f364c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:55.199627 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db00d4-41f3-4d25-ab2b-b12453f364c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:55.199911 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db00d4-41f3-4d25-ab2b-b12453f364c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:55.200187 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db00d4-41f3-4d25-ab2b-b12453f364c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:55.200947 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db00d4-41f3-4d25-ab2b-b12453f364c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:55.202667 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db00d4-41f3-4d25-ab2b-b12453f364c7 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:55.213522 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1266/2517] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:22:55.217659 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef9502-e404-4aa2-aa24-7a5b8b05b1fa admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:55.229235 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef9502-e404-4aa2-aa24-7a5b8b05b1fa admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:55.234952 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817cf124-2ecd-46c2-a303-a519169242da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:55.235732 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817cf124-2ecd-46c2-a303-a519169242da admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:55.236027 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817cf124-2ecd-46c2-a303-a519169242da admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:55.236330 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817cf124-2ecd-46c2-a303-a519169242da admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:55.237177 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817cf124-2ecd-46c2-a303-a519169242da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:55.238866 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817cf124-2ecd-46c2-a303-a519169242da admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:55.254051 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1252/2518] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:22:55.255806 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db00d4-41f3-4d25-ab2b-b12453f364c7 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:55.266149 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db00d4-41f3-4d25-ab2b-b12453f364c7 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:55.271425 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a709da5-eff9-4b07-a1f2-774011bebe17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:55.272360 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a709da5-eff9-4b07-a1f2-774011bebe17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:55.272600 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a709da5-eff9-4b07-a1f2-774011bebe17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:55.273112 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a709da5-eff9-4b07-a1f2-774011bebe17 admin admin] PATH_INFO: `/v3/projects/02c42b3b784049a4b829f0b4ee5647c2/users/2e837c49aa3749619f8190b4df9ab7ca/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:55.289284 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a709da5-eff9-4b07-a1f2-774011bebe17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02c42b3b784049a4b829f0b4ee5647c2, user_id=2e837c49aa3749619f8190b4df9ab7ca, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:55.292150 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a709da5-eff9-4b07-a1f2-774011bebe17 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:55.309814 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1267/2519] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:22:55 2022] PUT /identity/v3/projects/02c42b3b784049a4b829f0b4ee5647c2/users/2e837c49aa3749619f8190b4df9ab7ca/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:22:55.320532 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b68f1-2db5-4cc3-88c4-5a9c101bcee0 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:55.320903 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b68f1-2db5-4cc3-88c4-5a9c101bcee0 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:55.321184 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b68f1-2db5-4cc3-88c4-5a9c101bcee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:55.347647 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-881b68f1-2db5-4cc3-88c4-5a9c101bcee0 None None] MFA Rules not processed for user `2e837c49aa3749619f8190b4df9ab7ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:55.349461 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-881b68f1-2db5-4cc3-88c4-5a9c101bcee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:55.417285 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1253/2520] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:22:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:22:55.421650 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a709da5-eff9-4b07-a1f2-774011bebe17 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:55.497702 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a709da5-eff9-4b07-a1f2-774011bebe17 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:55.502794 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f94b83d-2c74-4e26-adfe-838bed6ba108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:55.503820 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94b83d-2c74-4e26-adfe-838bed6ba108 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:55.503820 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94b83d-2c74-4e26-adfe-838bed6ba108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:55.504105 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94b83d-2c74-4e26-adfe-838bed6ba108 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:55.504733 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f94b83d-2c74-4e26-adfe-838bed6ba108 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:55.506657 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f94b83d-2c74-4e26-adfe-838bed6ba108 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:55.532496 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1268/2521] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:22:55 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:22:55.537233 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b68f1-2db5-4cc3-88c4-5a9c101bcee0 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:55.547970 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b68f1-2db5-4cc3-88c4-5a9c101bcee0 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:55.607605 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce7788-868f-4028-b1fe-65f918f5b1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:55.608276 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce7788-868f-4028-b1fe-65f918f5b1f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:55.608562 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce7788-868f-4028-b1fe-65f918f5b1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:55.608877 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce7788-868f-4028-b1fe-65f918f5b1f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:55.609580 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acce7788-868f-4028-b1fe-65f918f5b1f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:55.611504 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acce7788-868f-4028-b1fe-65f918f5b1f2 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:55.631319 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1254/2522] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:22:55 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:22:55.635478 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f94b83d-2c74-4e26-adfe-838bed6ba108 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:55.646406 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f94b83d-2c74-4e26-adfe-838bed6ba108 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:55.651128 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788c30b-5616-4c81-a827-e483998ad4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:55.651785 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788c30b-5616-4c81-a827-e483998ad4ec admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:55.652072 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788c30b-5616-4c81-a827-e483998ad4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:55.652352 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788c30b-5616-4c81-a827-e483998ad4ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:55.653113 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4788c30b-5616-4c81-a827-e483998ad4ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:55.654702 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4788c30b-5616-4c81-a827-e483998ad4ec admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:55.665624 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1269/2523] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:22:55.669825 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce7788-868f-4028-b1fe-65f918f5b1f2 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:55.679899 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce7788-868f-4028-b1fe-65f918f5b1f2 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:55.684592 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef211c01-d8a8-4499-b9c0-77708b9df63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:55.685577 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef211c01-d8a8-4499-b9c0-77708b9df63f admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:55.685861 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef211c01-d8a8-4499-b9c0-77708b9df63f admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:55.686143 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef211c01-d8a8-4499-b9c0-77708b9df63f admin admin] PATH_INFO: `/v3/projects/2707a9b913c84f2ea9a1bfd2a0569183/users/872cf7fc5ec744a0ae167061b00b85ab/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:55.704788 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef211c01-d8a8-4499-b9c0-77708b9df63f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2707a9b913c84f2ea9a1bfd2a0569183, user_id=872cf7fc5ec744a0ae167061b00b85ab, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:55.707462 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef211c01-d8a8-4499-b9c0-77708b9df63f admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:55.721236 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1255/2524] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:22:55 2022] PUT /identity/v3/projects/2707a9b913c84f2ea9a1bfd2a0569183/users/872cf7fc5ec744a0ae167061b00b85ab/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:22:55.725448 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788c30b-5616-4c81-a827-e483998ad4ec admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:55.735877 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788c30b-5616-4c81-a827-e483998ad4ec admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:55.779945 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:55.806012 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1833b9-a403-4e74-b80d-710e3f6d6622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:55.806734 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1833b9-a403-4e74-b80d-710e3f6d6622 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:55.807010 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1833b9-a403-4e74-b80d-710e3f6d6622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:55.807283 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1833b9-a403-4e74-b80d-710e3f6d6622 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:55.808008 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1833b9-a403-4e74-b80d-710e3f6d6622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:55.809663 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1833b9-a403-4e74-b80d-710e3f6d6622 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:55.820787 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1270/2525] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:22:55.825065 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef211c01-d8a8-4499-b9c0-77708b9df63f admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:55.837009 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef211c01-d8a8-4499-b9c0-77708b9df63f admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:55.841652 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f8a80-2a07-4850-aa5f-96adf730c66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:55.842531 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f8a80-2a07-4850-aa5f-96adf730c66c admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:55.842809 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f8a80-2a07-4850-aa5f-96adf730c66c admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:55.843079 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f8a80-2a07-4850-aa5f-96adf730c66c admin admin] PATH_INFO: `/v3/projects/2707a9b913c84f2ea9a1bfd2a0569183/users/872cf7fc5ec744a0ae167061b00b85ab/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:55.845102 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999f8a80-2a07-4850-aa5f-96adf730c66c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2707a9b913c84f2ea9a1bfd2a0569183, user_id=872cf7fc5ec744a0ae167061b00b85ab, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:55.847737 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999f8a80-2a07-4850-aa5f-96adf730c66c admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:55.858727 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1256/2526] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:22:55 2022] PUT /identity/v3/projects/2707a9b913c84f2ea9a1bfd2a0569183/users/872cf7fc5ec744a0ae167061b00b85ab/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:55.872219 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bed2e9-ac9f-4072-a294-2fa8adc26351 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:55.872504 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bed2e9-ac9f-4072-a294-2fa8adc26351 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:55.872987 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bed2e9-ac9f-4072-a294-2fa8adc26351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:55.902933 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-c9bed2e9-ac9f-4072-a294-2fa8adc26351 None None] MFA Rules not processed for user `872cf7fc5ec744a0ae167061b00b85ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:55.904155 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-c9bed2e9-ac9f-4072-a294-2fa8adc26351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:55.974391 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1271/2527] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:22:55 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:22:55.986079 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f8a80-2a07-4850-aa5f-96adf730c66c admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:55.987767 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-999f8a80-2a07-4850-aa5f-96adf730c66c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:55.999096 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:56.047367 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f8a80-2a07-4850-aa5f-96adf730c66c admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:56.051215 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f72b55-f7d4-468f-8145-35e0631ca00e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:56.052588 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f72b55-f7d4-468f-8145-35e0631ca00e service cinder] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:56.052903 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f72b55-f7d4-468f-8145-35e0631ca00e service cinder] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:56.053250 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f72b55-f7d4-468f-8145-35e0631ca00e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:56.063885 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f72b55-f7d4-468f-8145-35e0631ca00e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:56.065504 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f72b55-f7d4-468f-8145-35e0631ca00e service cinder] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:56.076970 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1257/2528] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:22:55 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:22:56.151605 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bed2e9-ac9f-4072-a294-2fa8adc26351 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:56.161520 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bed2e9-ac9f-4072-a294-2fa8adc26351 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:56.165296 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373612f8-2545-45b6-bfb3-81e548c75da7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:56.165982 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373612f8-2545-45b6-bfb3-81e548c75da7 service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:56.166243 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373612f8-2545-45b6-bfb3-81e548c75da7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:56.166513 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373612f8-2545-45b6-bfb3-81e548c75da7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:56.225193 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373612f8-2545-45b6-bfb3-81e548c75da7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:56.226559 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373612f8-2545-45b6-bfb3-81e548c75da7 service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:56.235599 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1272/2529] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:22:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:23:06.072343 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=22 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:23:06.231514 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=72 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:23:15.280626 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f72b55-f7d4-468f-8145-35e0631ca00e service cinder] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:15.287180 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-94f72b55-f7d4-468f-8145-35e0631ca00e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:15.339251 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f72b55-f7d4-468f-8145-35e0631ca00e service cinder] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:15.342861 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a4e662-5271-4111-b32c-d66cbf0b74e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:15.343500 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4e662-5271-4111-b32c-d66cbf0b74e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:15.343782 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4e662-5271-4111-b32c-d66cbf0b74e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:15.344057 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4e662-5271-4111-b32c-d66cbf0b74e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:15.345993 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-83a4e662-5271-4111-b32c-d66cbf0b74e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:15.414627 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a4e662-5271-4111-b32c-d66cbf0b74e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:15.416009 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a4e662-5271-4111-b32c-d66cbf0b74e1 service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:15.426930 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1258/2530] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:23:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:23:18.371984 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373612f8-2545-45b6-bfb3-81e548c75da7 service cinder] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:18.376521 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-373612f8-2545-45b6-bfb3-81e548c75da7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:18.476638 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a4e662-5271-4111-b32c-d66cbf0b74e1 service neutron] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:18.478570 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-83a4e662-5271-4111-b32c-d66cbf0b74e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:18.487026 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373612f8-2545-45b6-bfb3-81e548c75da7 service cinder] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:18.492863 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa987a-0abb-4867-8294-63deb11fd65c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f0f9248178049cda6571fa365a21225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:18.493522 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa987a-0abb-4867-8294-63deb11fd65c service placement] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:18.493797 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa987a-0abb-4867-8294-63deb11fd65c service placement] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:18.493970 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a4e662-5271-4111-b32c-d66cbf0b74e1 service neutron] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:18.494110 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa987a-0abb-4867-8294-63deb11fd65c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:18.495931 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-f1aa987a-0abb-4867-8294-63deb11fd65c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:18.499627 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c38dd-de18-4f4c-af2a-57d5e947bb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:18.501135 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c38dd-de18-4f4c-af2a-57d5e947bb29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:18.501575 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c38dd-de18-4f4c-af2a-57d5e947bb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:18.502048 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c38dd-de18-4f4c-af2a-57d5e947bb29 admin admin] PATH_INFO: `/v3/users/498822fcffaf4cc79532c487418cb11c` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:18.503429 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c38dd-de18-4f4c-af2a-57d5e947bb29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=498822fcffaf4cc79532c487418cb11c)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:18.505570 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c38dd-de18-4f4c-af2a-57d5e947bb29 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:18.509077 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aa987a-0abb-4867-8294-63deb11fd65c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:18.510700 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aa987a-0abb-4867-8294-63deb11fd65c service placement] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:18.522368 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1273/2531] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:23:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:23:18.565350 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-1b4c38dd-de18-4f4c-af2a-57d5e947bb29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '498822fcffaf4cc79532c487418cb11c'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:18.573326 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-1b4c38dd-de18-4f4c-af2a-57d5e947bb29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '498822fcffaf4cc79532c487418cb11c'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:18.574003 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-1b4c38dd-de18-4f4c-af2a-57d5e947bb29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '498822fcffaf4cc79532c487418cb11c'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:18.574625 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-1b4c38dd-de18-4f4c-af2a-57d5e947bb29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '498822fcffaf4cc79532c487418cb11c'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:18.587514 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-1b4c38dd-de18-4f4c-af2a-57d5e947bb29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '498822fcffaf4cc79532c487418cb11c'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:18.602071 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1259/2532] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:23:18 2022] DELETE /identity/v3/users/498822fcffaf4cc79532c487418cb11c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:23:18.786088 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa987a-0abb-4867-8294-63deb11fd65c service placement] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:18.801349 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa987a-0abb-4867-8294-63deb11fd65c service placement] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:18.864857 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e439cfa5-5268-4b16-aa15-23ac9aa14940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:18.865752 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439cfa5-5268-4b16-aa15-23ac9aa14940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:18.866052 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439cfa5-5268-4b16-aa15-23ac9aa14940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:18.866324 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439cfa5-5268-4b16-aa15-23ac9aa14940 admin admin] PATH_INFO: `/v3/projects/0b2cb11b20af48f8b0e9f0a4cf1b9406` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:18.867508 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e439cfa5-5268-4b16-aa15-23ac9aa14940 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b2cb11b20af48f8b0e9f0a4cf1b9406)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:18.869464 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e439cfa5-5268-4b16-aa15-23ac9aa14940 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:18.918470 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e439cfa5-5268-4b16-aa15-23ac9aa14940 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'request_id': 'req-e439cfa5-5268-4b16-aa15-23ac9aa14940'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:18.924435 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e439cfa5-5268-4b16-aa15-23ac9aa14940 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'request_id': 'req-e439cfa5-5268-4b16-aa15-23ac9aa14940'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:18.932903 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e439cfa5-5268-4b16-aa15-23ac9aa14940 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'request_id': 'req-e439cfa5-5268-4b16-aa15-23ac9aa14940'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:18.945317 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e439cfa5-5268-4b16-aa15-23ac9aa14940 admin admin] The token cache is being invalidate because project 0b2cb11b20af48f8b0e9f0a4cf1b9406 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:23:18.945617 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e439cfa5-5268-4b16-aa15-23ac9aa14940 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:18.946318 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e439cfa5-5268-4b16-aa15-23ac9aa14940 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:18.948144 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1274/2533] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:23:18 2022] DELETE /identity/v3/projects/0b2cb11b20af48f8b0e9f0a4cf1b9406 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:23:18.953364 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd84e1-2e97-4cb7-87f2-70a72cefd036 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:18.953846 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd84e1-2e97-4cb7-87f2-70a72cefd036 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:18.954127 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd84e1-2e97-4cb7-87f2-70a72cefd036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:18.985956 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-97dd84e1-2e97-4cb7-87f2-70a72cefd036 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:23:18.987228 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-97dd84e1-2e97-4cb7-87f2-70a72cefd036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:19.004887 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:23:19.051605 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1260/2534] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:23:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:23:19.060493 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17551525-1ec1-4c29-82a2-eb344b41bf70 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:19.060823 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17551525-1ec1-4c29-82a2-eb344b41bf70 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:19.061108 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17551525-1ec1-4c29-82a2-eb344b41bf70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:19.079901 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-17551525-1ec1-4c29-82a2-eb344b41bf70 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:23:19.081162 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-17551525-1ec1-4c29-82a2-eb344b41bf70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:19.089949 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1275/2535] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:23:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:23:19.094221 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd84e1-2e97-4cb7-87f2-70a72cefd036 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:19.104214 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd84e1-2e97-4cb7-87f2-70a72cefd036 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:19.108911 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf16df1-dd96-48b6-b008-8983714a1ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:19.109561 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf16df1-dd96-48b6-b008-8983714a1ece admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:19.109838 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf16df1-dd96-48b6-b008-8983714a1ece admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:19.110118 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf16df1-dd96-48b6-b008-8983714a1ece admin admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:19.110866 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf16df1-dd96-48b6-b008-8983714a1ece admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:23:19.111169 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf16df1-dd96-48b6-b008-8983714a1ece admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:19.112780 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf16df1-dd96-48b6-b008-8983714a1ece admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:19.124338 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1261/2536] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:23:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:23:19.128813 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17551525-1ec1-4c29-82a2-eb344b41bf70 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:19.138919 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17551525-1ec1-4c29-82a2-eb344b41bf70 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:19.143568 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b511bf-3d0c-4b3d-a579-521088604c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:19.144212 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b511bf-3d0c-4b3d-a579-521088604c01 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:19.144504 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b511bf-3d0c-4b3d-a579-521088604c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:19.144818 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b511bf-3d0c-4b3d-a579-521088604c01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:19.145550 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b511bf-3d0c-4b3d-a579-521088604c01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:19.148157 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b511bf-3d0c-4b3d-a579-521088604c01 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:19.157929 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:23:19.178450 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1276/2537] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:23:19 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:23:19.180581 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf16df1-dd96-48b6-b008-8983714a1ece admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:19.192337 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf16df1-dd96-48b6-b008-8983714a1ece admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:19.257604 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7274a9-ed1c-485f-9bbc-ab7751c171c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:19.258371 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7274a9-ed1c-485f-9bbc-ab7751c171c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:19.258721 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7274a9-ed1c-485f-9bbc-ab7751c171c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:19.259091 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7274a9-ed1c-485f-9bbc-ab7751c171c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:19.259864 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7274a9-ed1c-485f-9bbc-ab7751c171c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:19.261852 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7274a9-ed1c-485f-9bbc-ab7751c171c9 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:19.285376 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1262/2538] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:23:19 2022] POST /identity/v3/users => generated 283 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:23:19.286553 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b511bf-3d0c-4b3d-a579-521088604c01 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:19.301765 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b511bf-3d0c-4b3d-a579-521088604c01 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:19.307496 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eedfb91-ae0a-4b2e-a48f-4c336bf767b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:19.308170 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eedfb91-ae0a-4b2e-a48f-4c336bf767b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:19.308454 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eedfb91-ae0a-4b2e-a48f-4c336bf767b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:19.308763 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eedfb91-ae0a-4b2e-a48f-4c336bf767b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:19.309504 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eedfb91-ae0a-4b2e-a48f-4c336bf767b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:19.311196 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eedfb91-ae0a-4b2e-a48f-4c336bf767b7 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:19.323206 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1277/2539] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:23:19.327346 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7274a9-ed1c-485f-9bbc-ab7751c171c9 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:19.338514 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7274a9-ed1c-485f-9bbc-ab7751c171c9 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:19.342761 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9000ee1-b355-4470-b93f-6a2c5876ff39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:19.343423 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9000ee1-b355-4470-b93f-6a2c5876ff39 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:19.343706 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9000ee1-b355-4470-b93f-6a2c5876ff39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:19.343983 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9000ee1-b355-4470-b93f-6a2c5876ff39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:19.344826 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9000ee1-b355-4470-b93f-6a2c5876ff39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:19.346328 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9000ee1-b355-4470-b93f-6a2c5876ff39 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:19.360185 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1263/2540] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:23:19.361739 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eedfb91-ae0a-4b2e-a48f-4c336bf767b7 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:19.373738 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eedfb91-ae0a-4b2e-a48f-4c336bf767b7 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:19.378436 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44cf9b-2d3c-47a3-a679-fc3788ae6689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:19.379318 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44cf9b-2d3c-47a3-a679-fc3788ae6689 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:19.379603 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44cf9b-2d3c-47a3-a679-fc3788ae6689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:19.379883 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44cf9b-2d3c-47a3-a679-fc3788ae6689 admin admin] PATH_INFO: `/v3/projects/eb5cee399f394d2cbc266728447de25b/users/1d0b548704424f74ae8dd11fe2f4d12d/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:19.395686 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d44cf9b-2d3c-47a3-a679-fc3788ae6689 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb5cee399f394d2cbc266728447de25b, user_id=1d0b548704424f74ae8dd11fe2f4d12d, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:19.398614 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d44cf9b-2d3c-47a3-a679-fc3788ae6689 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:19.415336 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1278/2541] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:23:19 2022] PUT /identity/v3/projects/eb5cee399f394d2cbc266728447de25b/users/1d0b548704424f74ae8dd11fe2f4d12d/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:23:19.425466 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8150439-9fd3-4b6d-b5f0-99fdd5da8b46 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:19.425784 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8150439-9fd3-4b6d-b5f0-99fdd5da8b46 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:19.426065 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8150439-9fd3-4b6d-b5f0-99fdd5da8b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:19.457893 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-e8150439-9fd3-4b6d-b5f0-99fdd5da8b46 None None] MFA Rules not processed for user `1d0b548704424f74ae8dd11fe2f4d12d`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:23:19.459191 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-e8150439-9fd3-4b6d-b5f0-99fdd5da8b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:19.524844 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1264/2542] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:23:19 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:23:19.529415 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44cf9b-2d3c-47a3-a679-fc3788ae6689 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:19.599617 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44cf9b-2d3c-47a3-a679-fc3788ae6689 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:19.605053 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e27dd8-c2f8-4ab7-ad9f-ec3509008fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:19.605955 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e27dd8-c2f8-4ab7-ad9f-ec3509008fa1 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:19.606237 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e27dd8-c2f8-4ab7-ad9f-ec3509008fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:19.606513 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e27dd8-c2f8-4ab7-ad9f-ec3509008fa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:19.607215 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e27dd8-c2f8-4ab7-ad9f-ec3509008fa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:19.609132 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e27dd8-c2f8-4ab7-ad9f-ec3509008fa1 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:19.637984 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1279/2543] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:23:19 2022] POST /identity/v3/projects => generated 365 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:23:19.639386 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8150439-9fd3-4b6d-b5f0-99fdd5da8b46 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:19.650809 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8150439-9fd3-4b6d-b5f0-99fdd5da8b46 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:19.663872 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:23:19.709242 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4777e96-282a-47d4-afed-a9bb1a3e7184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:19.709848 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4777e96-282a-47d4-afed-a9bb1a3e7184 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:19.710032 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4777e96-282a-47d4-afed-a9bb1a3e7184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:19.710288 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4777e96-282a-47d4-afed-a9bb1a3e7184 admin admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:19.711011 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4777e96-282a-47d4-afed-a9bb1a3e7184 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:19.712935 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4777e96-282a-47d4-afed-a9bb1a3e7184 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:19.733355 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1265/2544] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:23:19 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:23:19.737495 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e27dd8-c2f8-4ab7-ad9f-ec3509008fa1 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:19.748487 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e27dd8-c2f8-4ab7-ad9f-ec3509008fa1 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:19.753216 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee288c-968e-4b86-b831-1187fbdef6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:19.753869 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee288c-968e-4b86-b831-1187fbdef6f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:19.754158 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee288c-968e-4b86-b831-1187fbdef6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:19.754441 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee288c-968e-4b86-b831-1187fbdef6f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:19.755170 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbee288c-968e-4b86-b831-1187fbdef6f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:19.756925 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbee288c-968e-4b86-b831-1187fbdef6f4 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:19.767215 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1280/2545] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:23:19.771057 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4777e96-282a-47d4-afed-a9bb1a3e7184 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:19.781430 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4777e96-282a-47d4-afed-a9bb1a3e7184 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:19.786100 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15062a3b-304f-4c56-bbcf-e769452152c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:19.786973 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15062a3b-304f-4c56-bbcf-e769452152c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:19.787792 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15062a3b-304f-4c56-bbcf-e769452152c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:19.788066 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15062a3b-304f-4c56-bbcf-e769452152c5 admin admin] PATH_INFO: `/v3/projects/3ffa00e23bce4d0f9c7a207ac0c3361d/users/013d7368d2084949b4edca77aa04974e/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:19.804636 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15062a3b-304f-4c56-bbcf-e769452152c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ffa00e23bce4d0f9c7a207ac0c3361d, user_id=013d7368d2084949b4edca77aa04974e, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:19.807467 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15062a3b-304f-4c56-bbcf-e769452152c5 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:19.820359 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1266/2546] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:23:19 2022] PUT /identity/v3/projects/3ffa00e23bce4d0f9c7a207ac0c3361d/users/013d7368d2084949b4edca77aa04974e/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:23:19.824257 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee288c-968e-4b86-b831-1187fbdef6f4 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:19.834831 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee288c-968e-4b86-b831-1187fbdef6f4 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:19.891823 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdeeed6-43f0-4f83-b4df-c5363e895066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:19.892412 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdeeed6-43f0-4f83-b4df-c5363e895066 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:19.892715 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdeeed6-43f0-4f83-b4df-c5363e895066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:19.893001 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdeeed6-43f0-4f83-b4df-c5363e895066 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:19.893723 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdeeed6-43f0-4f83-b4df-c5363e895066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:19.895312 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdeeed6-43f0-4f83-b4df-c5363e895066 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:19.905138 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1281/2547] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:23:19.909164 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15062a3b-304f-4c56-bbcf-e769452152c5 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:19.919889 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15062a3b-304f-4c56-bbcf-e769452152c5 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:19.924413 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee7334-f794-4376-b6dd-aff26d38aa40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:19.925326 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee7334-f794-4376-b6dd-aff26d38aa40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:19.925604 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee7334-f794-4376-b6dd-aff26d38aa40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:19.925877 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee7334-f794-4376-b6dd-aff26d38aa40 admin admin] PATH_INFO: `/v3/projects/3ffa00e23bce4d0f9c7a207ac0c3361d/users/013d7368d2084949b4edca77aa04974e/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:19.927831 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ee7334-f794-4376-b6dd-aff26d38aa40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ffa00e23bce4d0f9c7a207ac0c3361d, user_id=013d7368d2084949b4edca77aa04974e, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:19.931224 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ee7334-f794-4376-b6dd-aff26d38aa40 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:19.941144 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1267/2548] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:23:19 2022] PUT /identity/v3/projects/3ffa00e23bce4d0f9c7a207ac0c3361d/users/013d7368d2084949b4edca77aa04974e/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:23:19.950717 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc6166-5835-4b2e-b47b-a8836290ac90 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:19.951034 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc6166-5835-4b2e-b47b-a8836290ac90 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:19.951312 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc6166-5835-4b2e-b47b-a8836290ac90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:19.977202 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-0bdc6166-5835-4b2e-b47b-a8836290ac90 None None] MFA Rules not processed for user `013d7368d2084949b4edca77aa04974e`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:23:19.978412 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-0bdc6166-5835-4b2e-b47b-a8836290ac90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:19.992274 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:23:20.051293 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1282/2549] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:23:19 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:23:20.062790 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee7334-f794-4376-b6dd-aff26d38aa40 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:20.064489 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-e7ee7334-f794-4376-b6dd-aff26d38aa40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:20.130146 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee7334-f794-4376-b6dd-aff26d38aa40 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:20.134824 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df070c23-ddba-4a09-9bf3-dea50b5bb8f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:20.135770 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df070c23-ddba-4a09-9bf3-dea50b5bb8f3 service cinder] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:20.136058 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df070c23-ddba-4a09-9bf3-dea50b5bb8f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:20.136337 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df070c23-ddba-4a09-9bf3-dea50b5bb8f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:20.148598 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df070c23-ddba-4a09-9bf3-dea50b5bb8f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:20.150068 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df070c23-ddba-4a09-9bf3-dea50b5bb8f3 service cinder] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:20.160076 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1268/2550] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:23:20 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:23:20.234470 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc6166-5835-4b2e-b47b-a8836290ac90 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:20.244493 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc6166-5835-4b2e-b47b-a8836290ac90 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:20.248148 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee0a81d-99f7-4621-9510-d4bb7d6bbd9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:20.248849 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0a81d-99f7-4621-9510-d4bb7d6bbd9d service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:20.249132 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0a81d-99f7-4621-9510-d4bb7d6bbd9d service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:20.249406 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0a81d-99f7-4621-9510-d4bb7d6bbd9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:20.304658 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee0a81d-99f7-4621-9510-d4bb7d6bbd9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:20.306127 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee0a81d-99f7-4621-9510-d4bb7d6bbd9d service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:20.315221 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1283/2551] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:23:20 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:23:23.482263 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df070c23-ddba-4a09-9bf3-dea50b5bb8f3 service cinder] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:23.483640 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-df070c23-ddba-4a09-9bf3-dea50b5bb8f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:23.546992 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df070c23-ddba-4a09-9bf3-dea50b5bb8f3 service cinder] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:23.551346 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c1c2a-79f5-4bc5-a386-fc7f9952c9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:23.552201 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c1c2a-79f5-4bc5-a386-fc7f9952c9e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:23.552478 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c1c2a-79f5-4bc5-a386-fc7f9952c9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:23.553429 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c1c2a-79f5-4bc5-a386-fc7f9952c9e3 admin admin] PATH_INFO: `/v3/users/521de1a6cf4e471e824bbccf82ba9ec6` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:23.554631 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1c1c2a-79f5-4bc5-a386-fc7f9952c9e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=521de1a6cf4e471e824bbccf82ba9ec6)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:23.556533 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1c1c2a-79f5-4bc5-a386-fc7f9952c9e3 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:23.569824 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:23:23.604461 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-6e1c1c2a-79f5-4bc5-a386-fc7f9952c9e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '521de1a6cf4e471e824bbccf82ba9ec6'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:23.612133 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-6e1c1c2a-79f5-4bc5-a386-fc7f9952c9e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '521de1a6cf4e471e824bbccf82ba9ec6'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:23.612876 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-6e1c1c2a-79f5-4bc5-a386-fc7f9952c9e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '521de1a6cf4e471e824bbccf82ba9ec6'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:23.613845 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-6e1c1c2a-79f5-4bc5-a386-fc7f9952c9e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '521de1a6cf4e471e824bbccf82ba9ec6'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:23.632269 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-6e1c1c2a-79f5-4bc5-a386-fc7f9952c9e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '521de1a6cf4e471e824bbccf82ba9ec6'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:23.644432 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1269/2552] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:23:23 2022] DELETE /identity/v3/users/521de1a6cf4e471e824bbccf82ba9ec6 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:23:23.649598 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34008893-1a8f-4f26-92d2-4419da28a2f2 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:23.650113 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34008893-1a8f-4f26-92d2-4419da28a2f2 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:23.650222 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34008893-1a8f-4f26-92d2-4419da28a2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:23.667633 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-34008893-1a8f-4f26-92d2-4419da28a2f2 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:23:23.668880 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-34008893-1a8f-4f26-92d2-4419da28a2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:23.729417 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1284/2553] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:23:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:23:23.739135 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c1c2a-79f5-4bc5-a386-fc7f9952c9e3 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:23.741209 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-6e1c1c2a-79f5-4bc5-a386-fc7f9952c9e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:23.796841 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c1c2a-79f5-4bc5-a386-fc7f9952c9e3 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:23.800466 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9dacf2-5652-40b9-b989-1f254ed13cc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:23.801065 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9dacf2-5652-40b9-b989-1f254ed13cc1 service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:23.801346 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9dacf2-5652-40b9-b989-1f254ed13cc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:23.801622 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9dacf2-5652-40b9-b989-1f254ed13cc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:23.810448 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9dacf2-5652-40b9-b989-1f254ed13cc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:23.811861 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9dacf2-5652-40b9-b989-1f254ed13cc1 service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:23.821409 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1270/2554] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:23:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:23:24.104204 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34008893-1a8f-4f26-92d2-4419da28a2f2 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:24.106059 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-34008893-1a8f-4f26-92d2-4419da28a2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:24.120427 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34008893-1a8f-4f26-92d2-4419da28a2f2 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:24.125107 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd12b40-2feb-41b7-90bf-78ce048b547f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:24.126480 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd12b40-2feb-41b7-90bf-78ce048b547f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:24.126976 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd12b40-2feb-41b7-90bf-78ce048b547f admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:24.127270 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd12b40-2feb-41b7-90bf-78ce048b547f admin admin] PATH_INFO: `/v3/projects/cc39d799725048868f4448f94e18318d` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:24.128466 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd12b40-2feb-41b7-90bf-78ce048b547f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc39d799725048868f4448f94e18318d)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:24.130430 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd12b40-2feb-41b7-90bf-78ce048b547f admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:24.175344 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:23:24.179814 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-6bd12b40-2feb-41b7-90bf-78ce048b547f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc39d799725048868f4448f94e18318d', 'request_id': 'req-6bd12b40-2feb-41b7-90bf-78ce048b547f'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:24.185819 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-6bd12b40-2feb-41b7-90bf-78ce048b547f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc39d799725048868f4448f94e18318d', 'request_id': 'req-6bd12b40-2feb-41b7-90bf-78ce048b547f'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:24.192725 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-6bd12b40-2feb-41b7-90bf-78ce048b547f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc39d799725048868f4448f94e18318d', 'request_id': 'req-6bd12b40-2feb-41b7-90bf-78ce048b547f'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:24.203611 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-6bd12b40-2feb-41b7-90bf-78ce048b547f admin admin] The token cache is being invalidate because project cc39d799725048868f4448f94e18318d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:23:24.203895 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-6bd12b40-2feb-41b7-90bf-78ce048b547f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:24.204531 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-6bd12b40-2feb-41b7-90bf-78ce048b547f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:24.206092 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1285/2555] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:23:24 2022] DELETE /identity/v3/projects/cc39d799725048868f4448f94e18318d => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:23:24.211333 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763bd78-8e7a-49fa-9752-fef6cec73419 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:24.211626 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763bd78-8e7a-49fa-9752-fef6cec73419 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:24.211918 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763bd78-8e7a-49fa-9752-fef6cec73419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:24.229711 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-4763bd78-8e7a-49fa-9752-fef6cec73419 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:23:24.231156 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-4763bd78-8e7a-49fa-9752-fef6cec73419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:24.301913 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1271/2556] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:23:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:23:24.309678 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd2984-92c2-4823-8635-c4585a042688 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:24.309965 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd2984-92c2-4823-8635-c4585a042688 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:24.310240 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd2984-92c2-4823-8635-c4585a042688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:24.328909 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-e2cd2984-92c2-4823-8635-c4585a042688 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:23:24.330032 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-e2cd2984-92c2-4823-8635-c4585a042688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:24.338450 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1286/2557] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:23:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:23:24.342471 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4763bd78-8e7a-49fa-9752-fef6cec73419 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:24.352109 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4763bd78-8e7a-49fa-9752-fef6cec73419 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:24.356870 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf3000e-0d29-48dd-83d7-fcca494e7750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:24.357513 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3000e-0d29-48dd-83d7-fcca494e7750 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:24.357793 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3000e-0d29-48dd-83d7-fcca494e7750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:24.358067 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3000e-0d29-48dd-83d7-fcca494e7750 admin admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:24.358782 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf3000e-0d29-48dd-83d7-fcca494e7750 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:23:24.359088 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf3000e-0d29-48dd-83d7-fcca494e7750 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:24.360672 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf3000e-0d29-48dd-83d7-fcca494e7750 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:24.373044 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1272/2558] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:23:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:23:24.377397 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd2984-92c2-4823-8635-c4585a042688 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:24.387181 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd2984-92c2-4823-8635-c4585a042688 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:24.391781 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1323db-3b54-4e53-b9f7-5e3ab54df4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:24.392421 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1323db-3b54-4e53-b9f7-5e3ab54df4dc admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:24.392723 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1323db-3b54-4e53-b9f7-5e3ab54df4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:24.393000 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1323db-3b54-4e53-b9f7-5e3ab54df4dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:24.393679 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1323db-3b54-4e53-b9f7-5e3ab54df4dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:24.395546 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1323db-3b54-4e53-b9f7-5e3ab54df4dc admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:24.422303 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1287/2559] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:23:24 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:23:24.426514 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf3000e-0d29-48dd-83d7-fcca494e7750 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:24.436310 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf3000e-0d29-48dd-83d7-fcca494e7750 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:24.457220 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:23:24.500019 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f665195-3b21-4283-9252-d2e6d3fd8351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:24.500574 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f665195-3b21-4283-9252-d2e6d3fd8351 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:24.500890 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f665195-3b21-4283-9252-d2e6d3fd8351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:24.501168 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f665195-3b21-4283-9252-d2e6d3fd8351 admin admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:24.501877 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f665195-3b21-4283-9252-d2e6d3fd8351 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:24.503826 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f665195-3b21-4283-9252-d2e6d3fd8351 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:24.524762 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1273/2560] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:23:24 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:23:24.528846 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1323db-3b54-4e53-b9f7-5e3ab54df4dc admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:24.540395 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1323db-3b54-4e53-b9f7-5e3ab54df4dc admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:24.545130 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f470946-1499-4c29-a693-df0fea7ae34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:24.545781 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f470946-1499-4c29-a693-df0fea7ae34e admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:24.546063 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f470946-1499-4c29-a693-df0fea7ae34e admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:24.546336 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f470946-1499-4c29-a693-df0fea7ae34e admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:24.547060 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f470946-1499-4c29-a693-df0fea7ae34e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:24.548641 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f470946-1499-4c29-a693-df0fea7ae34e admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:24.559487 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1288/2561] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:23:24.563493 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f665195-3b21-4283-9252-d2e6d3fd8351 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:24.574261 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f665195-3b21-4283-9252-d2e6d3fd8351 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:24.578905 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf5e85-9fda-4bc2-a23e-32ead6b2771e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:24.579611 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf5e85-9fda-4bc2-a23e-32ead6b2771e admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:24.579845 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf5e85-9fda-4bc2-a23e-32ead6b2771e admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:24.580123 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf5e85-9fda-4bc2-a23e-32ead6b2771e admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:24.580880 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bf5e85-9fda-4bc2-a23e-32ead6b2771e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:24.582513 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bf5e85-9fda-4bc2-a23e-32ead6b2771e admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:24.592768 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1274/2562] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:23:24.596662 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f470946-1499-4c29-a693-df0fea7ae34e admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:24.608311 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f470946-1499-4c29-a693-df0fea7ae34e admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:24.613044 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a161da6-33ed-4fad-bfd5-e7b016e4af90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:24.613916 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a161da6-33ed-4fad-bfd5-e7b016e4af90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:24.614197 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a161da6-33ed-4fad-bfd5-e7b016e4af90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:24.614472 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a161da6-33ed-4fad-bfd5-e7b016e4af90 admin admin] PATH_INFO: `/v3/projects/205a62429cea49ba80167ac7866639f0/users/c7e9f3f1a65e4204887ee69de7cf2f58/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:24.629262 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a161da6-33ed-4fad-bfd5-e7b016e4af90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=205a62429cea49ba80167ac7866639f0, user_id=c7e9f3f1a65e4204887ee69de7cf2f58, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:24.631903 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a161da6-33ed-4fad-bfd5-e7b016e4af90 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:24.644683 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1289/2563] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:23:24 2022] PUT /identity/v3/projects/205a62429cea49ba80167ac7866639f0/users/c7e9f3f1a65e4204887ee69de7cf2f58/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:23:24.650835 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0d4ae-b3e3-46ef-8e81-1df188b0fa36 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:24.651159 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0d4ae-b3e3-46ef-8e81-1df188b0fa36 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:24.651457 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0d4ae-b3e3-46ef-8e81-1df188b0fa36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:24.669531 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-05d0d4ae-b3e3-46ef-8e81-1df188b0fa36 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:23:24.670717 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-05d0d4ae-b3e3-46ef-8e81-1df188b0fa36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:24.728641 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1275/2564] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:23:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:23:24.738242 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a161da6-33ed-4fad-bfd5-e7b016e4af90 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:24.739989 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-8a161da6-33ed-4fad-bfd5-e7b016e4af90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:24.795718 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a161da6-33ed-4fad-bfd5-e7b016e4af90 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:24.799297 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98644249-3aab-4bda-bfe9-277dcb788e1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:24.799934 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98644249-3aab-4bda-bfe9-277dcb788e1a service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:24.800214 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98644249-3aab-4bda-bfe9-277dcb788e1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:24.800485 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98644249-3aab-4bda-bfe9-277dcb788e1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:24.810010 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98644249-3aab-4bda-bfe9-277dcb788e1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:24.811572 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98644249-3aab-4bda-bfe9-277dcb788e1a service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:24.821524 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1290/2565] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:23:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:23:28.900259 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb7f64-a89d-4f26-86dd-b028c9ff4825 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:28.900811 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb7f64-a89d-4f26-86dd-b028c9ff4825 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:28.900988 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb7f64-a89d-4f26-86dd-b028c9ff4825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:28.944671 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-80cb7f64-a89d-4f26-86dd-b028c9ff4825 None None] MFA Rules not processed for user `c7e9f3f1a65e4204887ee69de7cf2f58`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:23:28.945982 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-80cb7f64-a89d-4f26-86dd-b028c9ff4825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:29.035306 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1276/2566] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:23:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:23:29.040542 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98644249-3aab-4bda-bfe9-277dcb788e1a service neutron] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:29.095666 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98644249-3aab-4bda-bfe9-277dcb788e1a service neutron] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:29.101548 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a85ceb-da8b-4a37-8ba2-a3928e8cf8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:29.102313 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a85ceb-da8b-4a37-8ba2-a3928e8cf8fb admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:29.102678 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a85ceb-da8b-4a37-8ba2-a3928e8cf8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:29.102958 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a85ceb-da8b-4a37-8ba2-a3928e8cf8fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:29.103675 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a85ceb-da8b-4a37-8ba2-a3928e8cf8fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:29.105926 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a85ceb-da8b-4a37-8ba2-a3928e8cf8fb admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:29.141441 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:23:29.149365 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1291/2567] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:23:29 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:23:29.153947 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb7f64-a89d-4f26-86dd-b028c9ff4825 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:29.160661 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:23:29.166563 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb7f64-a89d-4f26-86dd-b028c9ff4825 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:29.235294 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78291462-a83d-4570-a4f2-5ed7e1e53ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:29.236064 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78291462-a83d-4570-a4f2-5ed7e1e53ad4 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:29.236347 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78291462-a83d-4570-a4f2-5ed7e1e53ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:29.236682 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78291462-a83d-4570-a4f2-5ed7e1e53ad4 admin admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:29.237419 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78291462-a83d-4570-a4f2-5ed7e1e53ad4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:29.239409 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78291462-a83d-4570-a4f2-5ed7e1e53ad4 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:29.264733 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1277/2568] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:23:29 2022] POST /identity/v3/users => generated 298 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:23:29.268406 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a85ceb-da8b-4a37-8ba2-a3928e8cf8fb admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:29.283606 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a85ceb-da8b-4a37-8ba2-a3928e8cf8fb admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:29.288417 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53deee-d980-4313-8b6f-48ffbc61a2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:29.289132 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53deee-d980-4313-8b6f-48ffbc61a2ff admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:29.289416 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53deee-d980-4313-8b6f-48ffbc61a2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:29.289692 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53deee-d980-4313-8b6f-48ffbc61a2ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:29.290423 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d53deee-d980-4313-8b6f-48ffbc61a2ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:29.292021 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d53deee-d980-4313-8b6f-48ffbc61a2ff admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:29.303088 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1292/2569] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:23:29.307381 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78291462-a83d-4570-a4f2-5ed7e1e53ad4 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:29.319066 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78291462-a83d-4570-a4f2-5ed7e1e53ad4 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:29.326208 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b5017-92ae-419f-b0cd-c30e2fc28643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:29.327849 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b5017-92ae-419f-b0cd-c30e2fc28643 admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:29.328224 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b5017-92ae-419f-b0cd-c30e2fc28643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:29.328520 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b5017-92ae-419f-b0cd-c30e2fc28643 admin admin] PATH_INFO: `/v3/projects/4e045776b6a5494d9731ca9d5f646100/users/4ef44ce62f72486c938bfbb37b947e7f/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:29.354867 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b5017-92ae-419f-b0cd-c30e2fc28643 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e045776b6a5494d9731ca9d5f646100, user_id=4ef44ce62f72486c938bfbb37b947e7f, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:29.357872 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b5017-92ae-419f-b0cd-c30e2fc28643 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:29.373214 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1278/2570] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:23:29 2022] PUT /identity/v3/projects/4e045776b6a5494d9731ca9d5f646100/users/4ef44ce62f72486c938bfbb37b947e7f/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:23:29.377556 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53deee-d980-4313-8b6f-48ffbc61a2ff admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:29.388922 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53deee-d980-4313-8b6f-48ffbc61a2ff admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:29.455575 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f010eb-0d39-4618-96b1-d52e8a868311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:29.456324 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f010eb-0d39-4618-96b1-d52e8a868311 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:29.456677 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f010eb-0d39-4618-96b1-d52e8a868311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:29.457055 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f010eb-0d39-4618-96b1-d52e8a868311 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:29.459707 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f010eb-0d39-4618-96b1-d52e8a868311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:29.459818 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f010eb-0d39-4618-96b1-d52e8a868311 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:29.471063 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1293/2571] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:23:29.475835 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b5017-92ae-419f-b0cd-c30e2fc28643 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:29.486627 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b5017-92ae-419f-b0cd-c30e2fc28643 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:29.491879 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda6381f-f0db-4157-9bc7-b0f58b172639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:29.492770 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6381f-f0db-4157-9bc7-b0f58b172639 admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:29.493081 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6381f-f0db-4157-9bc7-b0f58b172639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:29.493359 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6381f-f0db-4157-9bc7-b0f58b172639 admin admin] PATH_INFO: `/v3/projects/4e045776b6a5494d9731ca9d5f646100/users/4ef44ce62f72486c938bfbb37b947e7f/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:29.495362 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda6381f-f0db-4157-9bc7-b0f58b172639 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e045776b6a5494d9731ca9d5f646100, user_id=4ef44ce62f72486c938bfbb37b947e7f, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:29.498039 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda6381f-f0db-4157-9bc7-b0f58b172639 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:29.509763 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1279/2572] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:23:29 2022] PUT /identity/v3/projects/4e045776b6a5494d9731ca9d5f646100/users/4ef44ce62f72486c938bfbb37b947e7f/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:23:34.180118 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65a576-96b6-437c-8b55-6f8497361af2 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:34.184844 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65a576-96b6-437c-8b55-6f8497361af2 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:34.185252 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65a576-96b6-437c-8b55-6f8497361af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:34.221901 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-fd65a576-96b6-437c-8b55-6f8497361af2 None None] MFA Rules not processed for user `4ef44ce62f72486c938bfbb37b947e7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:23:34.223405 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-fd65a576-96b6-437c-8b55-6f8497361af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:34.307487 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1294/2573] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:23:34 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:23:34.319778 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda6381f-f0db-4157-9bc7-b0f58b172639 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:34.321632 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-fda6381f-f0db-4157-9bc7-b0f58b172639 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:34.428790 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda6381f-f0db-4157-9bc7-b0f58b172639 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:34.433136 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a851ca41-73e2-4048-b0ad-14b051cc848b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9cb22811a754357ab9d839b70d44261', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:34.434309 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851ca41-73e2-4048-b0ad-14b051cc848b service glance] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:34.434826 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851ca41-73e2-4048-b0ad-14b051cc848b service glance] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:34.435337 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851ca41-73e2-4048-b0ad-14b051cc848b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:34.503967 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:23:34.507301 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a851ca41-73e2-4048-b0ad-14b051cc848b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:34.509488 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a851ca41-73e2-4048-b0ad-14b051cc848b service glance] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:34.519971 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1280/2574] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:23:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:23:34.624813 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba95f7a-2110-4dca-94dc-ea511dd257b7 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:34.625126 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba95f7a-2110-4dca-94dc-ea511dd257b7 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:34.625409 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba95f7a-2110-4dca-94dc-ea511dd257b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:34.647436 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-6ba95f7a-2110-4dca-94dc-ea511dd257b7 None None] MFA Rules not processed for user `8c0f131484cb48d289cae1f473ec2fbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:23:34.647436 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-6ba95f7a-2110-4dca-94dc-ea511dd257b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:34.713452 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1295/2575] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Jun 20 06:23:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:23:34.770416 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a851ca41-73e2-4048-b0ad-14b051cc848b service glance] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:34.772493 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-a851ca41-73e2-4048-b0ad-14b051cc848b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:34.847484 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a851ca41-73e2-4048-b0ad-14b051cc848b service glance] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:34.852582 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6701c7-dc35-494f-8b5b-fae2afd99a6d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b490cf71bc468da5ea2be04239e33f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:34.853266 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6701c7-dc35-494f-8b5b-fae2afd99a6d service swift] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:34.853548 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6701c7-dc35-494f-8b5b-fae2afd99a6d service swift] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:34.853820 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6701c7-dc35-494f-8b5b-fae2afd99a6d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:34.863272 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6701c7-dc35-494f-8b5b-fae2afd99a6d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:34.864916 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6701c7-dc35-494f-8b5b-fae2afd99a6d service swift] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:34.874137 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1281/2576] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Jun 20 06:23:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 06:23:41.048458 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba95f7a-2110-4dca-94dc-ea511dd257b7 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:41.051345 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-6ba95f7a-2110-4dca-94dc-ea511dd257b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:41.083020 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:23:41.159203 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba95f7a-2110-4dca-94dc-ea511dd257b7 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:41.166598 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd017067-a3b9-4d74-a877-b6f82a58ec83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:41.167844 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd017067-a3b9-4d74-a877-b6f82a58ec83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:41.168290 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd017067-a3b9-4d74-a877-b6f82a58ec83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:41.169226 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd017067-a3b9-4d74-a877-b6f82a58ec83 admin admin] PATH_INFO: `/v3/users/1d0b548704424f74ae8dd11fe2f4d12d` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:41.170765 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd017067-a3b9-4d74-a877-b6f82a58ec83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d0b548704424f74ae8dd11fe2f4d12d)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:41.173881 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd017067-a3b9-4d74-a877-b6f82a58ec83 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:41.245860 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-cd017067-a3b9-4d74-a877-b6f82a58ec83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d0b548704424f74ae8dd11fe2f4d12d'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:41.256499 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-cd017067-a3b9-4d74-a877-b6f82a58ec83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d0b548704424f74ae8dd11fe2f4d12d'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:41.267731 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-cd017067-a3b9-4d74-a877-b6f82a58ec83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d0b548704424f74ae8dd11fe2f4d12d'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:41.284263 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-cd017067-a3b9-4d74-a877-b6f82a58ec83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d0b548704424f74ae8dd11fe2f4d12d'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:41.285430 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-cd017067-a3b9-4d74-a877-b6f82a58ec83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d0b548704424f74ae8dd11fe2f4d12d'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:41.295271 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1296/2577] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:23:41 2022] DELETE /identity/v3/users/1d0b548704424f74ae8dd11fe2f4d12d => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:23:41.300469 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbc179-e7fc-4eef-bcda-8263f0ebab67 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:41.301043 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbc179-e7fc-4eef-bcda-8263f0ebab67 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:41.301133 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbc179-e7fc-4eef-bcda-8263f0ebab67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:41.336950 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-99fbc179-e7fc-4eef-bcda-8263f0ebab67 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:23:41.338219 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-99fbc179-e7fc-4eef-bcda-8263f0ebab67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:41.427607 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1282/2578] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:23:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:23:41.437931 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd017067-a3b9-4d74-a877-b6f82a58ec83 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:41.441700 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-cd017067-a3b9-4d74-a877-b6f82a58ec83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:41.545910 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd017067-a3b9-4d74-a877-b6f82a58ec83 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:41.550087 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006278c2-4915-4a54-b459-1955e4c7da41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:41.550744 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006278c2-4915-4a54-b459-1955e4c7da41 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:41.551024 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006278c2-4915-4a54-b459-1955e4c7da41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:41.551301 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006278c2-4915-4a54-b459-1955e4c7da41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:41.563200 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006278c2-4915-4a54-b459-1955e4c7da41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:41.564784 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006278c2-4915-4a54-b459-1955e4c7da41 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:41.575967 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1297/2579] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:23:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:23:41.895618 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fbc179-e7fc-4eef-bcda-8263f0ebab67 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:41.897928 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-99fbc179-e7fc-4eef-bcda-8263f0ebab67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:41.910885 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fbc179-e7fc-4eef-bcda-8263f0ebab67 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:41.917894 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155e3ec-38bb-4db0-b50a-f640764ecfdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:41.918841 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155e3ec-38bb-4db0-b50a-f640764ecfdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:41.919199 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155e3ec-38bb-4db0-b50a-f640764ecfdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:41.919544 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155e3ec-38bb-4db0-b50a-f640764ecfdd admin admin] PATH_INFO: `/v3/projects/eb5cee399f394d2cbc266728447de25b` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:41.920877 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d155e3ec-38bb-4db0-b50a-f640764ecfdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb5cee399f394d2cbc266728447de25b)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:41.928581 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d155e3ec-38bb-4db0-b50a-f640764ecfdd admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:41.987652 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-d155e3ec-38bb-4db0-b50a-f640764ecfdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb5cee399f394d2cbc266728447de25b', 'request_id': 'req-d155e3ec-38bb-4db0-b50a-f640764ecfdd'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:41.999804 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-d155e3ec-38bb-4db0-b50a-f640764ecfdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb5cee399f394d2cbc266728447de25b', 'request_id': 'req-d155e3ec-38bb-4db0-b50a-f640764ecfdd'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:42.007249 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-d155e3ec-38bb-4db0-b50a-f640764ecfdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb5cee399f394d2cbc266728447de25b', 'request_id': 'req-d155e3ec-38bb-4db0-b50a-f640764ecfdd'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:42.020502 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-d155e3ec-38bb-4db0-b50a-f640764ecfdd admin admin] The token cache is being invalidate because project eb5cee399f394d2cbc266728447de25b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:23:42.021505 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-d155e3ec-38bb-4db0-b50a-f640764ecfdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:42.022363 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-d155e3ec-38bb-4db0-b50a-f640764ecfdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:42.023977 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1283/2580] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:23:41 2022] DELETE /identity/v3/projects/eb5cee399f394d2cbc266728447de25b => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:23:42.027955 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006278c2-4915-4a54-b459-1955e4c7da41 service neutron] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:42.044937 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006278c2-4915-4a54-b459-1955e4c7da41 service neutron] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:42.061242 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:23:42.118638 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e1ffc2-8afa-4e01-a032-4dd803be9e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:42.119604 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1ffc2-8afa-4e01-a032-4dd803be9e61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:42.119947 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1ffc2-8afa-4e01-a032-4dd803be9e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:42.120285 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1ffc2-8afa-4e01-a032-4dd803be9e61 admin admin] PATH_INFO: `/v3/users/013d7368d2084949b4edca77aa04974e` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:42.121628 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e1ffc2-8afa-4e01-a032-4dd803be9e61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=013d7368d2084949b4edca77aa04974e)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:42.123613 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e1ffc2-8afa-4e01-a032-4dd803be9e61 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:42.184280 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-27e1ffc2-8afa-4e01-a032-4dd803be9e61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '013d7368d2084949b4edca77aa04974e'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:42.200136 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-27e1ffc2-8afa-4e01-a032-4dd803be9e61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '013d7368d2084949b4edca77aa04974e'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:42.213081 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-27e1ffc2-8afa-4e01-a032-4dd803be9e61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '013d7368d2084949b4edca77aa04974e'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:42.236770 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-27e1ffc2-8afa-4e01-a032-4dd803be9e61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '013d7368d2084949b4edca77aa04974e'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:42.237753 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-27e1ffc2-8afa-4e01-a032-4dd803be9e61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '013d7368d2084949b4edca77aa04974e'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:42.248177 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1298/2581] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:23:42 2022] DELETE /identity/v3/users/013d7368d2084949b4edca77aa04974e => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:23:42.639711 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155e3ec-38bb-4db0-b50a-f640764ecfdd admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:42.642230 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-d155e3ec-38bb-4db0-b50a-f640764ecfdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:42.650525 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:23:42.672147 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155e3ec-38bb-4db0-b50a-f640764ecfdd admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:42.795604 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b7f85-94fc-4498-addf-4b7904ef9c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:42.796572 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b7f85-94fc-4498-addf-4b7904ef9c77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:42.796935 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b7f85-94fc-4498-addf-4b7904ef9c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:42.797215 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b7f85-94fc-4498-addf-4b7904ef9c77 admin admin] PATH_INFO: `/v3/projects/3ffa00e23bce4d0f9c7a207ac0c3361d` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:42.798422 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6b7f85-94fc-4498-addf-4b7904ef9c77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ffa00e23bce4d0f9c7a207ac0c3361d)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:42.800462 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6b7f85-94fc-4498-addf-4b7904ef9c77 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:42.857043 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-8c6b7f85-94fc-4498-addf-4b7904ef9c77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ffa00e23bce4d0f9c7a207ac0c3361d', 'request_id': 'req-8c6b7f85-94fc-4498-addf-4b7904ef9c77'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:42.869974 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-8c6b7f85-94fc-4498-addf-4b7904ef9c77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ffa00e23bce4d0f9c7a207ac0c3361d', 'request_id': 'req-8c6b7f85-94fc-4498-addf-4b7904ef9c77'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:42.876663 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-8c6b7f85-94fc-4498-addf-4b7904ef9c77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ffa00e23bce4d0f9c7a207ac0c3361d', 'request_id': 'req-8c6b7f85-94fc-4498-addf-4b7904ef9c77'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:42.890708 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-8c6b7f85-94fc-4498-addf-4b7904ef9c77 admin admin] The token cache is being invalidate because project 3ffa00e23bce4d0f9c7a207ac0c3361d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:23:42.890991 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-8c6b7f85-94fc-4498-addf-4b7904ef9c77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:42.891638 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-8c6b7f85-94fc-4498-addf-4b7904ef9c77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:42.897143 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1284/2582] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:23:42 2022] DELETE /identity/v3/projects/3ffa00e23bce4d0f9c7a207ac0c3361d => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:23:42.898735 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16bfab-176c-43db-aee0-723ba48802c5 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:42.900528 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16bfab-176c-43db-aee0-723ba48802c5 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:42.901035 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16bfab-176c-43db-aee0-723ba48802c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:42.956937 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-4c16bfab-176c-43db-aee0-723ba48802c5 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:23:42.958421 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-4c16bfab-176c-43db-aee0-723ba48802c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:43.029791 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1299/2583] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:23:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:23:43.038351 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4438a-8fa4-4416-95c2-6ff05586135e None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:43.038746 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4438a-8fa4-4416-95c2-6ff05586135e None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:43.039022 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4438a-8fa4-4416-95c2-6ff05586135e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:43.060015 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-99a4438a-8fa4-4416-95c2-6ff05586135e None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:23:43.061247 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-99a4438a-8fa4-4416-95c2-6ff05586135e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:43.073172 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1285/2584] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:23:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:23:43.074520 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c16bfab-176c-43db-aee0-723ba48802c5 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:43.086460 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c16bfab-176c-43db-aee0-723ba48802c5 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:43.091446 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738da3b2-013d-4ad1-9a4e-a646626a918a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:43.092287 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738da3b2-013d-4ad1-9a4e-a646626a918a admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:43.092570 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738da3b2-013d-4ad1-9a4e-a646626a918a admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:43.092877 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738da3b2-013d-4ad1-9a4e-a646626a918a admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:43.093643 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738da3b2-013d-4ad1-9a4e-a646626a918a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:23:43.093950 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738da3b2-013d-4ad1-9a4e-a646626a918a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:43.100291 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738da3b2-013d-4ad1-9a4e-a646626a918a admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:43.109062 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:23:43.124592 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1300/2585] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:23:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:23:43.125721 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a4438a-8fa4-4416-95c2-6ff05586135e None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:43.136736 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a4438a-8fa4-4416-95c2-6ff05586135e None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:43.141211 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdccc22-bbc0-4770-8615-b3c9df5762c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:43.142003 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdccc22-bbc0-4770-8615-b3c9df5762c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:43.142286 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdccc22-bbc0-4770-8615-b3c9df5762c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:43.142560 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdccc22-bbc0-4770-8615-b3c9df5762c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:43.143372 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdccc22-bbc0-4770-8615-b3c9df5762c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:43.145318 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdccc22-bbc0-4770-8615-b3c9df5762c4 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:43.175518 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1286/2586] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:23:43 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:23:43.180671 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738da3b2-013d-4ad1-9a4e-a646626a918a admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:43.191723 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738da3b2-013d-4ad1-9a4e-a646626a918a admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:43.263718 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2b8b7e-1361-402f-9bd5-d7b0818c3610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:43.264514 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b8b7e-1361-402f-9bd5-d7b0818c3610 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:43.264900 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b8b7e-1361-402f-9bd5-d7b0818c3610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:43.265248 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b8b7e-1361-402f-9bd5-d7b0818c3610 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:43.266126 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2b8b7e-1361-402f-9bd5-d7b0818c3610 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:43.268183 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2b8b7e-1361-402f-9bd5-d7b0818c3610 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:43.296754 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1301/2587] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:23:43 2022] POST /identity/v3/users => generated 294 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:23:43.298758 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdccc22-bbc0-4770-8615-b3c9df5762c4 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:43.313314 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdccc22-bbc0-4770-8615-b3c9df5762c4 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:43.319065 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8524bddd-3a79-4582-a9bf-24e7346ec9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:43.319333 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524bddd-3a79-4582-a9bf-24e7346ec9e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:43.319613 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524bddd-3a79-4582-a9bf-24e7346ec9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:43.319889 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524bddd-3a79-4582-a9bf-24e7346ec9e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:43.320856 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8524bddd-3a79-4582-a9bf-24e7346ec9e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:43.322457 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8524bddd-3a79-4582-a9bf-24e7346ec9e3 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:43.336372 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1287/2588] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:23:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:23:43.340673 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2b8b7e-1361-402f-9bd5-d7b0818c3610 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:43.352579 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2b8b7e-1361-402f-9bd5-d7b0818c3610 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:43.357710 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c1bbf-baf4-4fb0-ae8d-73da00a00a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:43.358729 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c1bbf-baf4-4fb0-ae8d-73da00a00a76 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:43.358729 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c1bbf-baf4-4fb0-ae8d-73da00a00a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:43.360022 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c1bbf-baf4-4fb0-ae8d-73da00a00a76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:43.360022 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c1bbf-baf4-4fb0-ae8d-73da00a00a76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:43.361303 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c1bbf-baf4-4fb0-ae8d-73da00a00a76 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:43.379329 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8524bddd-3a79-4582-a9bf-24e7346ec9e3 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:43.381159 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1302/2589] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:23:43 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:23:43.395145 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8524bddd-3a79-4582-a9bf-24e7346ec9e3 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:43.402703 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfcb2d8-ca24-4e91-89e9-1dcc56cabb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:43.403736 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfcb2d8-ca24-4e91-89e9-1dcc56cabb0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:43.404084 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfcb2d8-ca24-4e91-89e9-1dcc56cabb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:43.404453 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfcb2d8-ca24-4e91-89e9-1dcc56cabb0e admin admin] PATH_INFO: `/v3/projects/5a20a7fc9d0248e3b6ef86d25a89c21d/users/08299e909ece45a1b44045d22872ff49/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:43.430007 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfcb2d8-ca24-4e91-89e9-1dcc56cabb0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a20a7fc9d0248e3b6ef86d25a89c21d, user_id=08299e909ece45a1b44045d22872ff49, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:43.433222 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfcb2d8-ca24-4e91-89e9-1dcc56cabb0e admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:43.449685 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1288/2590] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:23:43 2022] PUT /identity/v3/projects/5a20a7fc9d0248e3b6ef86d25a89c21d/users/08299e909ece45a1b44045d22872ff49/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:23:43.460738 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7129e2f-2815-49a2-80a2-b3069091640b None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:43.461048 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7129e2f-2815-49a2-80a2-b3069091640b None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:43.461322 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7129e2f-2815-49a2-80a2-b3069091640b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:43.490899 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-b7129e2f-2815-49a2-80a2-b3069091640b None None] MFA Rules not processed for user `08299e909ece45a1b44045d22872ff49`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:23:43.492112 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-b7129e2f-2815-49a2-80a2-b3069091640b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:43.586529 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1303/2591] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:23:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:23:43.590893 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfcb2d8-ca24-4e91-89e9-1dcc56cabb0e admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:43.627847 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:23:43.667234 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfcb2d8-ca24-4e91-89e9-1dcc56cabb0e admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:43.672239 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10fb2c9-4a8e-40c2-8836-6ee2e4a2f4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:43.673070 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fb2c9-4a8e-40c2-8836-6ee2e4a2f4b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:43.673407 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fb2c9-4a8e-40c2-8836-6ee2e4a2f4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:43.673872 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fb2c9-4a8e-40c2-8836-6ee2e4a2f4b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:43.674695 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10fb2c9-4a8e-40c2-8836-6ee2e4a2f4b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:43.676635 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10fb2c9-4a8e-40c2-8836-6ee2e4a2f4b3 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:43.714148 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1289/2592] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:23:43 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:23:43.715315 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7129e2f-2815-49a2-80a2-b3069091640b None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:43.729186 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7129e2f-2815-49a2-80a2-b3069091640b None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:43.798419 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d58cc-e1f3-4b54-90e6-783841a6f9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:43.799295 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d58cc-e1f3-4b54-90e6-783841a6f9cd admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:43.799685 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d58cc-e1f3-4b54-90e6-783841a6f9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:43.800025 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d58cc-e1f3-4b54-90e6-783841a6f9cd admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:43.800893 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56d58cc-e1f3-4b54-90e6-783841a6f9cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:43.803074 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56d58cc-e1f3-4b54-90e6-783841a6f9cd admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:43.821704 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:23:43.832821 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1304/2593] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:23:43 2022] POST /identity/v3/users => generated 299 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:23:43.835408 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10fb2c9-4a8e-40c2-8836-6ee2e4a2f4b3 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:43.847371 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10fb2c9-4a8e-40c2-8836-6ee2e4a2f4b3 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:43.852922 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3989fed2-d241-488c-9d44-c816481cda3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:43.853792 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989fed2-d241-488c-9d44-c816481cda3e admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:43.854173 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989fed2-d241-488c-9d44-c816481cda3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:43.854567 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989fed2-d241-488c-9d44-c816481cda3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:43.855719 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3989fed2-d241-488c-9d44-c816481cda3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:43.857570 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3989fed2-d241-488c-9d44-c816481cda3e admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:43.872692 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1290/2594] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:23:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:23:43.877813 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d58cc-e1f3-4b54-90e6-783841a6f9cd admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:43.904514 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d58cc-e1f3-4b54-90e6-783841a6f9cd admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:43.921430 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a8021-03ae-4421-a915-7514e0139630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:43.922354 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a8021-03ae-4421-a915-7514e0139630 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:43.922788 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a8021-03ae-4421-a915-7514e0139630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:43.923071 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a8021-03ae-4421-a915-7514e0139630 admin admin] PATH_INFO: `/v3/projects/6ce6193598314be0b21c18fa127416d3/users/f4a61e54a6b442a08eb3dbf5460776e5/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:43.941044 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622a8021-03ae-4421-a915-7514e0139630 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ce6193598314be0b21c18fa127416d3, user_id=f4a61e54a6b442a08eb3dbf5460776e5, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:43.944578 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622a8021-03ae-4421-a915-7514e0139630 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:43.967963 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1305/2595] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:23:43 2022] PUT /identity/v3/projects/6ce6193598314be0b21c18fa127416d3/users/f4a61e54a6b442a08eb3dbf5460776e5/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:23:43.976220 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3989fed2-d241-488c-9d44-c816481cda3e admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:43.987849 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3989fed2-d241-488c-9d44-c816481cda3e admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:44.062597 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7227cb21-e375-4e83-92ff-113b0c56885f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:44.063868 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227cb21-e375-4e83-92ff-113b0c56885f admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:44.064475 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227cb21-e375-4e83-92ff-113b0c56885f admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:44.064976 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227cb21-e375-4e83-92ff-113b0c56885f admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:44.066014 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7227cb21-e375-4e83-92ff-113b0c56885f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:44.070025 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7227cb21-e375-4e83-92ff-113b0c56885f admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:44.085873 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1291/2596] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:23:43 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:23:44.089607 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a8021-03ae-4421-a915-7514e0139630 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:44.103412 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a8021-03ae-4421-a915-7514e0139630 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:44.109569 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fcd1e1-b48b-4810-9e79-0c2d6cd004c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:44.110748 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fcd1e1-b48b-4810-9e79-0c2d6cd004c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:44.111159 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fcd1e1-b48b-4810-9e79-0c2d6cd004c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:44.111560 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fcd1e1-b48b-4810-9e79-0c2d6cd004c0 admin admin] PATH_INFO: `/v3/projects/6ce6193598314be0b21c18fa127416d3/users/f4a61e54a6b442a08eb3dbf5460776e5/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:44.113839 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fcd1e1-b48b-4810-9e79-0c2d6cd004c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ce6193598314be0b21c18fa127416d3, user_id=f4a61e54a6b442a08eb3dbf5460776e5, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:44.117456 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fcd1e1-b48b-4810-9e79-0c2d6cd004c0 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:44.131891 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1306/2597] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:23:44 2022] PUT /identity/v3/projects/6ce6193598314be0b21c18fa127416d3/users/f4a61e54a6b442a08eb3dbf5460776e5/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:23:44.143596 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de18c80-a26a-4607-bd86-7140a1814499 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:44.144043 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de18c80-a26a-4607-bd86-7140a1814499 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:44.144439 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de18c80-a26a-4607-bd86-7140a1814499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:44.180336 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-9de18c80-a26a-4607-bd86-7140a1814499 None None] MFA Rules not processed for user `f4a61e54a6b442a08eb3dbf5460776e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:23:44.181625 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-9de18c80-a26a-4607-bd86-7140a1814499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:44.261898 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1292/2598] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:23:44 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:23:44.274471 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fcd1e1-b48b-4810-9e79-0c2d6cd004c0 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:44.276299 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-06fcd1e1-b48b-4810-9e79-0c2d6cd004c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:44.351660 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fcd1e1-b48b-4810-9e79-0c2d6cd004c0 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:44.355989 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164bbe5-d953-4b7c-8486-651d0121beee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:44.356640 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164bbe5-d953-4b7c-8486-651d0121beee service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:44.357014 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164bbe5-d953-4b7c-8486-651d0121beee service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:44.357295 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164bbe5-d953-4b7c-8486-651d0121beee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:44.367846 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4164bbe5-d953-4b7c-8486-651d0121beee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:44.369590 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4164bbe5-d953-4b7c-8486-651d0121beee service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:44.381006 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1307/2599] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:23:44 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:23:44.451341 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de18c80-a26a-4607-bd86-7140a1814499 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:44.490094 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:23:44.527337 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de18c80-a26a-4607-bd86-7140a1814499 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:44.532095 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bac73a-76af-4f29-a96b-17e0be0b8db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:44.533105 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bac73a-76af-4f29-a96b-17e0be0b8db9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:44.533392 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bac73a-76af-4f29-a96b-17e0be0b8db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:44.533671 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bac73a-76af-4f29-a96b-17e0be0b8db9 admin admin] PATH_INFO: `/v3/users/08299e909ece45a1b44045d22872ff49` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:44.535001 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bac73a-76af-4f29-a96b-17e0be0b8db9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08299e909ece45a1b44045d22872ff49)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:44.537713 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bac73a-76af-4f29-a96b-17e0be0b8db9 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:44.589402 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-93bac73a-76af-4f29-a96b-17e0be0b8db9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08299e909ece45a1b44045d22872ff49'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:44.596442 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-93bac73a-76af-4f29-a96b-17e0be0b8db9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08299e909ece45a1b44045d22872ff49'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:44.597071 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-93bac73a-76af-4f29-a96b-17e0be0b8db9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08299e909ece45a1b44045d22872ff49'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:44.597658 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-93bac73a-76af-4f29-a96b-17e0be0b8db9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08299e909ece45a1b44045d22872ff49'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:44.610591 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-93bac73a-76af-4f29-a96b-17e0be0b8db9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08299e909ece45a1b44045d22872ff49'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:44.623090 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1293/2600] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:23:44 2022] DELETE /identity/v3/users/08299e909ece45a1b44045d22872ff49 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:23:44.627472 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271e271-efe5-465e-96d2-1feb23671bce None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:44.627762 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271e271-efe5-465e-96d2-1feb23671bce None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:44.628033 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271e271-efe5-465e-96d2-1feb23671bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:44.647567 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-d271e271-efe5-465e-96d2-1feb23671bce None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:23:44.648927 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-d271e271-efe5-465e-96d2-1feb23671bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:44.714930 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1308/2601] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:23:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:23:44.725748 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bac73a-76af-4f29-a96b-17e0be0b8db9 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:44.727265 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-93bac73a-76af-4f29-a96b-17e0be0b8db9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:44.736739 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f03b63-b689-45f4-9161-662d928bc799 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:44.737026 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f03b63-b689-45f4-9161-662d928bc799 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:44.737305 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f03b63-b689-45f4-9161-662d928bc799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:44.756552 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-80f03b63-b689-45f4-9161-662d928bc799 None None] MFA Rules not processed for user `c7e9f3f1a65e4204887ee69de7cf2f58`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:23:44.757795 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-80f03b63-b689-45f4-9161-662d928bc799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:44.786783 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bac73a-76af-4f29-a96b-17e0be0b8db9 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:44.790579 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427b041-6a6c-4a97-a690-df8b54da9774 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:44.791229 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427b041-6a6c-4a97-a690-df8b54da9774 service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:44.791514 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427b041-6a6c-4a97-a690-df8b54da9774 service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:44.791786 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427b041-6a6c-4a97-a690-df8b54da9774 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:44.801442 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3427b041-6a6c-4a97-a690-df8b54da9774 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:44.803812 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3427b041-6a6c-4a97-a690-df8b54da9774 service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:44.812998 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1309/2602] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:23:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:23:44.813638 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1294/2603] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:23:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:23:45.199797 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f03b63-b689-45f4-9161-662d928bc799 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:45.201517 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-80f03b63-b689-45f4-9161-662d928bc799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:45.218550 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f03b63-b689-45f4-9161-662d928bc799 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:45.224534 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651e97e-ca30-4540-b583-4ed6aaacf3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:45.225533 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651e97e-ca30-4540-b583-4ed6aaacf3ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:45.225874 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651e97e-ca30-4540-b583-4ed6aaacf3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:45.226235 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651e97e-ca30-4540-b583-4ed6aaacf3ee admin admin] PATH_INFO: `/v3/projects/5a20a7fc9d0248e3b6ef86d25a89c21d` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:45.227523 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5651e97e-ca30-4540-b583-4ed6aaacf3ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a20a7fc9d0248e3b6ef86d25a89c21d)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:45.229607 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5651e97e-ca30-4540-b583-4ed6aaacf3ee admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:45.233409 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:23:45.282343 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-5651e97e-ca30-4540-b583-4ed6aaacf3ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a20a7fc9d0248e3b6ef86d25a89c21d', 'request_id': 'req-5651e97e-ca30-4540-b583-4ed6aaacf3ee'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:45.290993 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-5651e97e-ca30-4540-b583-4ed6aaacf3ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a20a7fc9d0248e3b6ef86d25a89c21d', 'request_id': 'req-5651e97e-ca30-4540-b583-4ed6aaacf3ee'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:45.299927 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-5651e97e-ca30-4540-b583-4ed6aaacf3ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a20a7fc9d0248e3b6ef86d25a89c21d', 'request_id': 'req-5651e97e-ca30-4540-b583-4ed6aaacf3ee'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:45.313003 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-5651e97e-ca30-4540-b583-4ed6aaacf3ee admin admin] The token cache is being invalidate because project 5a20a7fc9d0248e3b6ef86d25a89c21d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:23:45.313290 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-5651e97e-ca30-4540-b583-4ed6aaacf3ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:45.313975 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-5651e97e-ca30-4540-b583-4ed6aaacf3ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:45.315605 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1310/2604] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:23:45 2022] DELETE /identity/v3/projects/5a20a7fc9d0248e3b6ef86d25a89c21d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:23:45.319817 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427b041-6a6c-4a97-a690-df8b54da9774 service neutron] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:45.329437 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427b041-6a6c-4a97-a690-df8b54da9774 service neutron] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:45.376900 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:23:45.391346 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62071cc-26d6-44dd-b04a-ae8d5423acd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:45.392215 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62071cc-26d6-44dd-b04a-ae8d5423acd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:45.392495 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62071cc-26d6-44dd-b04a-ae8d5423acd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:45.392819 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62071cc-26d6-44dd-b04a-ae8d5423acd8 admin admin] PATH_INFO: `/v3/users/f4a61e54a6b442a08eb3dbf5460776e5` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:45.394251 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62071cc-26d6-44dd-b04a-ae8d5423acd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4a61e54a6b442a08eb3dbf5460776e5)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:45.396894 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62071cc-26d6-44dd-b04a-ae8d5423acd8 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:45.463881 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-b62071cc-26d6-44dd-b04a-ae8d5423acd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4a61e54a6b442a08eb3dbf5460776e5'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:45.475584 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-b62071cc-26d6-44dd-b04a-ae8d5423acd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4a61e54a6b442a08eb3dbf5460776e5'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:45.476153 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-b62071cc-26d6-44dd-b04a-ae8d5423acd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4a61e54a6b442a08eb3dbf5460776e5'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:45.476835 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-b62071cc-26d6-44dd-b04a-ae8d5423acd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4a61e54a6b442a08eb3dbf5460776e5'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:45.497156 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-b62071cc-26d6-44dd-b04a-ae8d5423acd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4a61e54a6b442a08eb3dbf5460776e5'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:45.512849 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1295/2605] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:23:45 2022] DELETE /identity/v3/users/f4a61e54a6b442a08eb3dbf5460776e5 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:23:45.814931 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651e97e-ca30-4540-b583-4ed6aaacf3ee admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:45.816794 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-5651e97e-ca30-4540-b583-4ed6aaacf3ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:45.833975 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651e97e-ca30-4540-b583-4ed6aaacf3ee admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:45.907869 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ce157-2fc9-4826-96af-888b0ae5fb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:45.908748 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ce157-2fc9-4826-96af-888b0ae5fb0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:45.909029 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ce157-2fc9-4826-96af-888b0ae5fb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:45.909300 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ce157-2fc9-4826-96af-888b0ae5fb0a admin admin] PATH_INFO: `/v3/projects/6ce6193598314be0b21c18fa127416d3` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:45.910473 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261ce157-2fc9-4826-96af-888b0ae5fb0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ce6193598314be0b21c18fa127416d3)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:45.913240 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261ce157-2fc9-4826-96af-888b0ae5fb0a admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:45.960154 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-261ce157-2fc9-4826-96af-888b0ae5fb0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ce6193598314be0b21c18fa127416d3', 'request_id': 'req-261ce157-2fc9-4826-96af-888b0ae5fb0a'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:45.965713 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-261ce157-2fc9-4826-96af-888b0ae5fb0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ce6193598314be0b21c18fa127416d3', 'request_id': 'req-261ce157-2fc9-4826-96af-888b0ae5fb0a'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:45.972957 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-261ce157-2fc9-4826-96af-888b0ae5fb0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ce6193598314be0b21c18fa127416d3', 'request_id': 'req-261ce157-2fc9-4826-96af-888b0ae5fb0a'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:45.984572 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-261ce157-2fc9-4826-96af-888b0ae5fb0a admin admin] The token cache is being invalidate because project 6ce6193598314be0b21c18fa127416d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:23:45.984887 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-261ce157-2fc9-4826-96af-888b0ae5fb0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:45.985512 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-261ce157-2fc9-4826-96af-888b0ae5fb0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:45.987047 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1311/2606] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:23:45 2022] DELETE /identity/v3/projects/6ce6193598314be0b21c18fa127416d3 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:23:45.991876 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab1943-f8a9-48a5-8dee-b3bd29687ae9 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:45.992343 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab1943-f8a9-48a5-8dee-b3bd29687ae9 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:45.992476 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab1943-f8a9-48a5-8dee-b3bd29687ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:46.010529 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-9bab1943-f8a9-48a5-8dee-b3bd29687ae9 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:23:46.011674 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-9bab1943-f8a9-48a5-8dee-b3bd29687ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:46.071077 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1296/2607] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:23:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:23:46.078705 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b90f40-9783-4332-a4c0-308b7fa98b80 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:46.078990 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b90f40-9783-4332-a4c0-308b7fa98b80 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:46.079264 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b90f40-9783-4332-a4c0-308b7fa98b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:46.097821 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-24b90f40-9783-4332-a4c0-308b7fa98b80 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:23:46.099733 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-24b90f40-9783-4332-a4c0-308b7fa98b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:46.107897 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1312/2608] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:23:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:23:46.111849 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab1943-f8a9-48a5-8dee-b3bd29687ae9 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:46.121659 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab1943-f8a9-48a5-8dee-b3bd29687ae9 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:46.126145 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26084aa7-1a89-4bf0-8df5-2d5368156790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:46.126789 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26084aa7-1a89-4bf0-8df5-2d5368156790 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:46.127075 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26084aa7-1a89-4bf0-8df5-2d5368156790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:46.127346 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26084aa7-1a89-4bf0-8df5-2d5368156790 admin admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:46.128064 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26084aa7-1a89-4bf0-8df5-2d5368156790 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:23:46.128365 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26084aa7-1a89-4bf0-8df5-2d5368156790 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:46.130026 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26084aa7-1a89-4bf0-8df5-2d5368156790 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:46.141376 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1297/2609] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:23:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:23:46.145472 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b90f40-9783-4332-a4c0-308b7fa98b80 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:46.155346 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b90f40-9783-4332-a4c0-308b7fa98b80 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:46.159992 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dae3e6-4c27-4b96-b4a9-0551b05f804e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:46.160848 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dae3e6-4c27-4b96-b4a9-0551b05f804e admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:46.161138 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dae3e6-4c27-4b96-b4a9-0551b05f804e admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:46.162035 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dae3e6-4c27-4b96-b4a9-0551b05f804e admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:46.162739 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dae3e6-4c27-4b96-b4a9-0551b05f804e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:46.164800 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dae3e6-4c27-4b96-b4a9-0551b05f804e admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:46.177642 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:23:46.192432 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1313/2610] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:23:46 2022] POST /identity/v3/projects => generated 393 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:23:46.196602 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26084aa7-1a89-4bf0-8df5-2d5368156790 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:46.207212 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26084aa7-1a89-4bf0-8df5-2d5368156790 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:46.256952 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:23:46.267035 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2575df-8156-4be6-81ea-3d56f86551e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:46.267636 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2575df-8156-4be6-81ea-3d56f86551e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:46.267936 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2575df-8156-4be6-81ea-3d56f86551e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:46.268208 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2575df-8156-4be6-81ea-3d56f86551e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:46.268930 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2575df-8156-4be6-81ea-3d56f86551e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:46.271517 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2575df-8156-4be6-81ea-3d56f86551e7 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:46.290360 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1298/2611] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:23:46 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:23:46.294467 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dae3e6-4c27-4b96-b4a9-0551b05f804e admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:46.304916 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dae3e6-4c27-4b96-b4a9-0551b05f804e admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:46.309475 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c1ab87-1b69-4f8c-a7b8-4b5a1cd67f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:46.310134 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1ab87-1b69-4f8c-a7b8-4b5a1cd67f5b admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:46.310419 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1ab87-1b69-4f8c-a7b8-4b5a1cd67f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:46.310695 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1ab87-1b69-4f8c-a7b8-4b5a1cd67f5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:46.311418 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c1ab87-1b69-4f8c-a7b8-4b5a1cd67f5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:46.313040 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c1ab87-1b69-4f8c-a7b8-4b5a1cd67f5b admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:46.324032 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1314/2612] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:23:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:23:46.327889 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2575df-8156-4be6-81ea-3d56f86551e7 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:46.338454 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2575df-8156-4be6-81ea-3d56f86551e7 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:46.342975 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc61eda4-a838-4477-b6f0-35d3b9d66e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:46.343618 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61eda4-a838-4477-b6f0-35d3b9d66e10 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:46.343899 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61eda4-a838-4477-b6f0-35d3b9d66e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:46.344201 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61eda4-a838-4477-b6f0-35d3b9d66e10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:46.345095 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc61eda4-a838-4477-b6f0-35d3b9d66e10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:46.346545 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc61eda4-a838-4477-b6f0-35d3b9d66e10 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:46.356937 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1299/2613] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:23:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:23:46.361041 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c1ab87-1b69-4f8c-a7b8-4b5a1cd67f5b admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:46.373021 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c1ab87-1b69-4f8c-a7b8-4b5a1cd67f5b admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:46.377788 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4104e5a6-3312-449c-a0d1-60ba2944c54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:46.378663 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104e5a6-3312-449c-a0d1-60ba2944c54d admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:46.378948 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104e5a6-3312-449c-a0d1-60ba2944c54d admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:46.379224 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104e5a6-3312-449c-a0d1-60ba2944c54d admin admin] PATH_INFO: `/v3/projects/8911066c1883492ea77715ea49ffbe2d/users/f1a6c311e9c8418a921092a8e7b13e73/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:46.394440 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4104e5a6-3312-449c-a0d1-60ba2944c54d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8911066c1883492ea77715ea49ffbe2d, user_id=f1a6c311e9c8418a921092a8e7b13e73, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:46.397685 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4104e5a6-3312-449c-a0d1-60ba2944c54d admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:46.410316 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1315/2614] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:23:46 2022] PUT /identity/v3/projects/8911066c1883492ea77715ea49ffbe2d/users/f1a6c311e9c8418a921092a8e7b13e73/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:23:46.420594 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83246dd0-f1f2-4a30-a363-a736c39e2caf None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:46.420916 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83246dd0-f1f2-4a30-a363-a736c39e2caf None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:46.421220 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83246dd0-f1f2-4a30-a363-a736c39e2caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:46.447859 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-83246dd0-f1f2-4a30-a363-a736c39e2caf None None] MFA Rules not processed for user `f1a6c311e9c8418a921092a8e7b13e73`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:23:46.449251 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-83246dd0-f1f2-4a30-a363-a736c39e2caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:46.514827 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1300/2615] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:23:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:23:46.519365 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4104e5a6-3312-449c-a0d1-60ba2944c54d admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:46.587398 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4104e5a6-3312-449c-a0d1-60ba2944c54d admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:46.592237 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55041844-733e-4267-a1fb-450cdfdbeea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:46.592963 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55041844-733e-4267-a1fb-450cdfdbeea7 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:46.593246 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55041844-733e-4267-a1fb-450cdfdbeea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:46.593519 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55041844-733e-4267-a1fb-450cdfdbeea7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:46.594219 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55041844-733e-4267-a1fb-450cdfdbeea7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:46.596171 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55041844-733e-4267-a1fb-450cdfdbeea7 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:46.628860 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1316/2616] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:23:46 2022] POST /identity/v3/projects => generated 391 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:23:46.629793 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83246dd0-f1f2-4a30-a363-a736c39e2caf None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:46.641150 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83246dd0-f1f2-4a30-a363-a736c39e2caf None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:46.697956 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee32c64-f903-46ad-9c88-20c69f5c6acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:46.698621 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee32c64-f903-46ad-9c88-20c69f5c6acf admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:46.698905 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee32c64-f903-46ad-9c88-20c69f5c6acf admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:46.699178 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee32c64-f903-46ad-9c88-20c69f5c6acf admin admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:46.699880 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee32c64-f903-46ad-9c88-20c69f5c6acf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:46.701816 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee32c64-f903-46ad-9c88-20c69f5c6acf admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:46.721052 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1301/2617] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:23:46 2022] POST /identity/v3/users => generated 302 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:23:46.725643 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55041844-733e-4267-a1fb-450cdfdbeea7 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:46.736086 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55041844-733e-4267-a1fb-450cdfdbeea7 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:46.741331 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac06966-d850-4b90-bf18-375790106416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:46.741992 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac06966-d850-4b90-bf18-375790106416 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:46.742278 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac06966-d850-4b90-bf18-375790106416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:46.742556 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac06966-d850-4b90-bf18-375790106416 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:46.743286 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac06966-d850-4b90-bf18-375790106416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:46.744899 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac06966-d850-4b90-bf18-375790106416 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:46.755839 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1317/2618] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:23:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:23:46.759950 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee32c64-f903-46ad-9c88-20c69f5c6acf admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:46.769915 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee32c64-f903-46ad-9c88-20c69f5c6acf admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:46.776057 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18d806-8e4b-4a81-a4d7-50448af32542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:46.777021 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18d806-8e4b-4a81-a4d7-50448af32542 admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:46.777309 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18d806-8e4b-4a81-a4d7-50448af32542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:46.777619 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18d806-8e4b-4a81-a4d7-50448af32542 admin admin] PATH_INFO: `/v3/projects/33b6b718eea7430889df7e07ded4c7a5/users/a807c800d6684c86a8844a27b240d6ef/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:46.793420 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae18d806-8e4b-4a81-a4d7-50448af32542 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33b6b718eea7430889df7e07ded4c7a5, user_id=a807c800d6684c86a8844a27b240d6ef, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:46.796057 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae18d806-8e4b-4a81-a4d7-50448af32542 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:46.808775 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1302/2619] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:23:46 2022] PUT /identity/v3/projects/33b6b718eea7430889df7e07ded4c7a5/users/a807c800d6684c86a8844a27b240d6ef/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:23:46.812830 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac06966-d850-4b90-bf18-375790106416 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:46.822617 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac06966-d850-4b90-bf18-375790106416 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:46.879326 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149970c6-b3dd-4f78-aa41-26dc1f6d5a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:46.880020 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149970c6-b3dd-4f78-aa41-26dc1f6d5a84 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:46.880303 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149970c6-b3dd-4f78-aa41-26dc1f6d5a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:46.880792 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149970c6-b3dd-4f78-aa41-26dc1f6d5a84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:46.881523 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149970c6-b3dd-4f78-aa41-26dc1f6d5a84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:46.883109 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149970c6-b3dd-4f78-aa41-26dc1f6d5a84 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:46.892672 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1318/2620] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:23:46 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:23:46.897427 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18d806-8e4b-4a81-a4d7-50448af32542 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:46.907651 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18d806-8e4b-4a81-a4d7-50448af32542 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:46.912933 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add287e-c633-4c6a-9bcd-c5a1a0362805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:46.913803 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add287e-c633-4c6a-9bcd-c5a1a0362805 admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:46.914085 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add287e-c633-4c6a-9bcd-c5a1a0362805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:46.914361 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add287e-c633-4c6a-9bcd-c5a1a0362805 admin admin] PATH_INFO: `/v3/projects/33b6b718eea7430889df7e07ded4c7a5/users/a807c800d6684c86a8844a27b240d6ef/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:46.916337 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6add287e-c633-4c6a-9bcd-c5a1a0362805 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33b6b718eea7430889df7e07ded4c7a5, user_id=a807c800d6684c86a8844a27b240d6ef, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:46.921157 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6add287e-c633-4c6a-9bcd-c5a1a0362805 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:46.932803 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1303/2621] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:23:46 2022] PUT /identity/v3/projects/33b6b718eea7430889df7e07ded4c7a5/users/a807c800d6684c86a8844a27b240d6ef/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:23:46.943981 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170597c-8cb1-41ba-8d22-58525e822b91 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:46.944268 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170597c-8cb1-41ba-8d22-58525e822b91 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:46.944546 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170597c-8cb1-41ba-8d22-58525e822b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:46.971397 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-7170597c-8cb1-41ba-8d22-58525e822b91 None None] MFA Rules not processed for user `a807c800d6684c86a8844a27b240d6ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:23:46.972618 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-7170597c-8cb1-41ba-8d22-58525e822b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:46.989993 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:23:47.042091 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1319/2622] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:23:46 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:23:47.052463 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add287e-c633-4c6a-9bcd-c5a1a0362805 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:47.054301 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-6add287e-c633-4c6a-9bcd-c5a1a0362805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:47.068852 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:23:47.113337 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add287e-c633-4c6a-9bcd-c5a1a0362805 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:47.117236 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68498c9b-966c-4705-a6fc-189dbc537bb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:47.117898 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68498c9b-966c-4705-a6fc-189dbc537bb5 service cinder] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:47.118178 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68498c9b-966c-4705-a6fc-189dbc537bb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:47.118478 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68498c9b-966c-4705-a6fc-189dbc537bb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:47.127278 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68498c9b-966c-4705-a6fc-189dbc537bb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:47.128693 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68498c9b-966c-4705-a6fc-189dbc537bb5 service cinder] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:47.138796 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1304/2623] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:23:47 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:23:47.189255 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7170597c-8cb1-41ba-8d22-58525e822b91 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:47.190688 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-7170597c-8cb1-41ba-8d22-58525e822b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:47.203601 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7170597c-8cb1-41ba-8d22-58525e822b91 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:47.207529 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecfaf74-4c53-4312-be10-9ed30b016250 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:47.208826 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecfaf74-4c53-4312-be10-9ed30b016250 service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:47.209113 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecfaf74-4c53-4312-be10-9ed30b016250 service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:47.209389 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecfaf74-4c53-4312-be10-9ed30b016250 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:47.266116 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecfaf74-4c53-4312-be10-9ed30b016250 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:47.267555 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecfaf74-4c53-4312-be10-9ed30b016250 service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:47.277133 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1320/2624] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:23:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:23:49.397098 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0467d6e-6132-4321-a016-60468adabd2b None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:49.397614 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0467d6e-6132-4321-a016-60468adabd2b None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:49.397614 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0467d6e-6132-4321-a016-60468adabd2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:49.415839 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-c0467d6e-6132-4321-a016-60468adabd2b None None] MFA Rules not processed for user `8c0f131484cb48d289cae1f473ec2fbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:23:49.417172 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-c0467d6e-6132-4321-a016-60468adabd2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:49.501718 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1305/2625] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Jun 20 06:23:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:23:49.508983 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecfaf74-4c53-4312-be10-9ed30b016250 service cinder] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:49.510436 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-0ecfaf74-4c53-4312-be10-9ed30b016250 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:49.588410 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecfaf74-4c53-4312-be10-9ed30b016250 service cinder] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:49.593851 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb0c628-5ca4-4f47-8653-3195b1f7ac52 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b490cf71bc468da5ea2be04239e33f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:49.595041 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0c628-5ca4-4f47-8653-3195b1f7ac52 service swift] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:49.595041 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0c628-5ca4-4f47-8653-3195b1f7ac52 service swift] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:49.595041 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0c628-5ca4-4f47-8653-3195b1f7ac52 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:49.605855 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb0c628-5ca4-4f47-8653-3195b1f7ac52 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:49.607715 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb0c628-5ca4-4f47-8653-3195b1f7ac52 service swift] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:49.622715 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1321/2626] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Jun 20 06:23:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 20 06:23:52.160687 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0467d6e-6132-4321-a016-60468adabd2b None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:52.247078 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0467d6e-6132-4321-a016-60468adabd2b None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:52.251252 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8a3f6-fefc-44a5-9ca1-9391a0b59fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:52.252190 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8a3f6-fefc-44a5-9ca1-9391a0b59fd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:52.252578 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8a3f6-fefc-44a5-9ca1-9391a0b59fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:52.252876 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8a3f6-fefc-44a5-9ca1-9391a0b59fd3 admin admin] PATH_INFO: `/v3/users/f1a6c311e9c8418a921092a8e7b13e73` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:52.254298 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd8a3f6-fefc-44a5-9ca1-9391a0b59fd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1a6c311e9c8418a921092a8e7b13e73)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:52.257031 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd8a3f6-fefc-44a5-9ca1-9391a0b59fd3 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:52.339359 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-6dd8a3f6-fefc-44a5-9ca1-9391a0b59fd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1a6c311e9c8418a921092a8e7b13e73'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:52.351090 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-6dd8a3f6-fefc-44a5-9ca1-9391a0b59fd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1a6c311e9c8418a921092a8e7b13e73'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:52.352812 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-6dd8a3f6-fefc-44a5-9ca1-9391a0b59fd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1a6c311e9c8418a921092a8e7b13e73'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:52.353957 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-6dd8a3f6-fefc-44a5-9ca1-9391a0b59fd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1a6c311e9c8418a921092a8e7b13e73'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:52.366736 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:23:52.371649 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-6dd8a3f6-fefc-44a5-9ca1-9391a0b59fd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1a6c311e9c8418a921092a8e7b13e73'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:52.395612 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1306/2627] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:23:52 2022] DELETE /identity/v3/users/f1a6c311e9c8418a921092a8e7b13e73 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:23:52.401585 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d91c7-50b1-4454-a807-f0e6761b3663 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:52.402110 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d91c7-50b1-4454-a807-f0e6761b3663 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:52.402400 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d91c7-50b1-4454-a807-f0e6761b3663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:52.437156 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-615d91c7-50b1-4454-a807-f0e6761b3663 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:23:52.438572 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-615d91c7-50b1-4454-a807-f0e6761b3663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:52.515843 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:23:52.567395 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1322/2628] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:23:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:23:52.578779 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8a3f6-fefc-44a5-9ca1-9391a0b59fd3 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:52.581548 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-6dd8a3f6-fefc-44a5-9ca1-9391a0b59fd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:52.612926 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d91c7-50b1-4454-a807-f0e6761b3663 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:52.614459 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-615d91c7-50b1-4454-a807-f0e6761b3663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:52.628817 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d91c7-50b1-4454-a807-f0e6761b3663 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:52.635124 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd6874-7715-41e2-8746-743dc5bb4571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:52.635997 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd6874-7715-41e2-8746-743dc5bb4571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:52.636275 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd6874-7715-41e2-8746-743dc5bb4571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:52.636542 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd6874-7715-41e2-8746-743dc5bb4571 admin admin] PATH_INFO: `/v3/users/2e837c49aa3749619f8190b4df9ab7ca` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:52.637783 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd6874-7715-41e2-8746-743dc5bb4571 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e837c49aa3749619f8190b4df9ab7ca)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:52.639702 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd6874-7715-41e2-8746-743dc5bb4571 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:52.643807 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8a3f6-fefc-44a5-9ca1-9391a0b59fd3 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:52.648135 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85afe3fe-52f2-4a05-9c14-e41a84010896 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:52.648801 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85afe3fe-52f2-4a05-9c14-e41a84010896 service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:52.649082 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85afe3fe-52f2-4a05-9c14-e41a84010896 service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:52.649352 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85afe3fe-52f2-4a05-9c14-e41a84010896 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:52.658477 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85afe3fe-52f2-4a05-9c14-e41a84010896 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:52.659893 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85afe3fe-52f2-4a05-9c14-e41a84010896 service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:52.671208 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1307/2629] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:23:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:23:52.700555 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-95fd6874-7715-41e2-8746-743dc5bb4571 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e837c49aa3749619f8190b4df9ab7ca'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:52.711994 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-95fd6874-7715-41e2-8746-743dc5bb4571 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e837c49aa3749619f8190b4df9ab7ca'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:52.719425 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-95fd6874-7715-41e2-8746-743dc5bb4571 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e837c49aa3749619f8190b4df9ab7ca'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:52.733753 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-95fd6874-7715-41e2-8746-743dc5bb4571 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e837c49aa3749619f8190b4df9ab7ca'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:52.734605 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-95fd6874-7715-41e2-8746-743dc5bb4571 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e837c49aa3749619f8190b4df9ab7ca'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:52.741450 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1323/2630] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:23:52 2022] DELETE /identity/v3/users/2e837c49aa3749619f8190b4df9ab7ca => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:23:52.745929 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7939dc-9e12-4f5b-b4dc-3771cea50faf None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:52.746217 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7939dc-9e12-4f5b-b4dc-3771cea50faf None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:52.746494 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7939dc-9e12-4f5b-b4dc-3771cea50faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:52.764624 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-4c7939dc-9e12-4f5b-b4dc-3771cea50faf None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:23:52.766050 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-4c7939dc-9e12-4f5b-b4dc-3771cea50faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:52.845561 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1308/2631] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:23:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:23:52.855873 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd6874-7715-41e2-8746-743dc5bb4571 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:52.857390 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-95fd6874-7715-41e2-8746-743dc5bb4571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:52.936360 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd6874-7715-41e2-8746-743dc5bb4571 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:52.940658 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e618a64-8e34-4bcf-99c0-77d00b3a7176 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:52.941427 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e618a64-8e34-4bcf-99c0-77d00b3a7176 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:52.941774 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e618a64-8e34-4bcf-99c0-77d00b3a7176 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:52.942127 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e618a64-8e34-4bcf-99c0-77d00b3a7176 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:52.957123 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e618a64-8e34-4bcf-99c0-77d00b3a7176 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:52.957123 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e618a64-8e34-4bcf-99c0-77d00b3a7176 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:52.960765 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7939dc-9e12-4f5b-b4dc-3771cea50faf None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:52.962442 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-4c7939dc-9e12-4f5b-b4dc-3771cea50faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:52.970149 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1324/2632] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:23:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:23:52.982522 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7939dc-9e12-4f5b-b4dc-3771cea50faf None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:52.992961 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2774110-b654-4eed-8f7e-8a8ea5209ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:52.993947 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2774110-b654-4eed-8f7e-8a8ea5209ce6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:52.994259 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2774110-b654-4eed-8f7e-8a8ea5209ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:52.994710 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2774110-b654-4eed-8f7e-8a8ea5209ce6 admin admin] PATH_INFO: `/v3/projects/8911066c1883492ea77715ea49ffbe2d` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:52.996228 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2774110-b654-4eed-8f7e-8a8ea5209ce6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8911066c1883492ea77715ea49ffbe2d)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:53.000729 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2774110-b654-4eed-8f7e-8a8ea5209ce6 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:53.079097 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-e2774110-b654-4eed-8f7e-8a8ea5209ce6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8911066c1883492ea77715ea49ffbe2d', 'request_id': 'req-e2774110-b654-4eed-8f7e-8a8ea5209ce6'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:53.103543 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-e2774110-b654-4eed-8f7e-8a8ea5209ce6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8911066c1883492ea77715ea49ffbe2d', 'request_id': 'req-e2774110-b654-4eed-8f7e-8a8ea5209ce6'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:53.110036 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-e2774110-b654-4eed-8f7e-8a8ea5209ce6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8911066c1883492ea77715ea49ffbe2d', 'request_id': 'req-e2774110-b654-4eed-8f7e-8a8ea5209ce6'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:53.122333 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-e2774110-b654-4eed-8f7e-8a8ea5209ce6 admin admin] The token cache is being invalidate because project 8911066c1883492ea77715ea49ffbe2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:23:53.122715 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-e2774110-b654-4eed-8f7e-8a8ea5209ce6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:53.125127 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-e2774110-b654-4eed-8f7e-8a8ea5209ce6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:53.126764 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1309/2633] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:23:52 2022] DELETE /identity/v3/projects/8911066c1883492ea77715ea49ffbe2d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:23:53.132034 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e618a64-8e34-4bcf-99c0-77d00b3a7176 service neutron] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:53.142351 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e618a64-8e34-4bcf-99c0-77d00b3a7176 service neutron] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:53.224917 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:23:53.233573 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e971ef07-bec6-41c2-89c1-98fdf1c669cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:53.235501 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971ef07-bec6-41c2-89c1-98fdf1c669cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:53.236004 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971ef07-bec6-41c2-89c1-98fdf1c669cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:53.236609 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971ef07-bec6-41c2-89c1-98fdf1c669cc admin admin] PATH_INFO: `/v3/users/a807c800d6684c86a8844a27b240d6ef` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:53.238493 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e971ef07-bec6-41c2-89c1-98fdf1c669cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a807c800d6684c86a8844a27b240d6ef)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:53.242098 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e971ef07-bec6-41c2-89c1-98fdf1c669cc admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:53.314666 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e971ef07-bec6-41c2-89c1-98fdf1c669cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a807c800d6684c86a8844a27b240d6ef'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:53.326773 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e971ef07-bec6-41c2-89c1-98fdf1c669cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a807c800d6684c86a8844a27b240d6ef'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:53.333509 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2774110-b654-4eed-8f7e-8a8ea5209ce6 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:53.335624 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-e2774110-b654-4eed-8f7e-8a8ea5209ce6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:53.351071 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2774110-b654-4eed-8f7e-8a8ea5209ce6 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:53.352803 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e971ef07-bec6-41c2-89c1-98fdf1c669cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a807c800d6684c86a8844a27b240d6ef'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:53.359163 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8956ae5a-73be-43e9-8f26-f1577d41c8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:53.360270 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956ae5a-73be-43e9-8f26-f1577d41c8c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:53.360973 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956ae5a-73be-43e9-8f26-f1577d41c8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:53.361267 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956ae5a-73be-43e9-8f26-f1577d41c8c1 admin admin] PATH_INFO: `/v3/projects/02c42b3b784049a4b829f0b4ee5647c2` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:53.362726 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8956ae5a-73be-43e9-8f26-f1577d41c8c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02c42b3b784049a4b829f0b4ee5647c2)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:53.365806 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8956ae5a-73be-43e9-8f26-f1577d41c8c1 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:53.367959 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:23:53.378656 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e971ef07-bec6-41c2-89c1-98fdf1c669cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a807c800d6684c86a8844a27b240d6ef'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:53.379737 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e971ef07-bec6-41c2-89c1-98fdf1c669cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a807c800d6684c86a8844a27b240d6ef'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:53.388360 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1325/2634] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:23:53 2022] DELETE /identity/v3/users/a807c800d6684c86a8844a27b240d6ef => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:23:53.424747 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-8956ae5a-73be-43e9-8f26-f1577d41c8c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02c42b3b784049a4b829f0b4ee5647c2', 'request_id': 'req-8956ae5a-73be-43e9-8f26-f1577d41c8c1'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:53.433887 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-8956ae5a-73be-43e9-8f26-f1577d41c8c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02c42b3b784049a4b829f0b4ee5647c2', 'request_id': 'req-8956ae5a-73be-43e9-8f26-f1577d41c8c1'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:53.442009 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-8956ae5a-73be-43e9-8f26-f1577d41c8c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02c42b3b784049a4b829f0b4ee5647c2', 'request_id': 'req-8956ae5a-73be-43e9-8f26-f1577d41c8c1'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:53.461608 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-8956ae5a-73be-43e9-8f26-f1577d41c8c1 admin admin] The token cache is being invalidate because project 02c42b3b784049a4b829f0b4ee5647c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:23:53.461904 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-8956ae5a-73be-43e9-8f26-f1577d41c8c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:53.462575 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-8956ae5a-73be-43e9-8f26-f1577d41c8c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:53.464144 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1310/2635] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:23:53 2022] DELETE /identity/v3/projects/02c42b3b784049a4b829f0b4ee5647c2 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:23:53.468131 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e971ef07-bec6-41c2-89c1-98fdf1c669cc admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:53.469746 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-e971ef07-bec6-41c2-89c1-98fdf1c669cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:53.613805 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e971ef07-bec6-41c2-89c1-98fdf1c669cc admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:53.727823 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35114e3-6081-4552-9688-9d1c048904b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:53.729474 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35114e3-6081-4552-9688-9d1c048904b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:53.729922 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35114e3-6081-4552-9688-9d1c048904b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:53.730614 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35114e3-6081-4552-9688-9d1c048904b2 admin admin] PATH_INFO: `/v3/users/872cf7fc5ec744a0ae167061b00b85ab` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:53.732270 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35114e3-6081-4552-9688-9d1c048904b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=872cf7fc5ec744a0ae167061b00b85ab)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:53.740374 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35114e3-6081-4552-9688-9d1c048904b2 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:53.780460 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:23:53.821414 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8956ae5a-73be-43e9-8f26-f1577d41c8c1 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:53.823294 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-8956ae5a-73be-43e9-8f26-f1577d41c8c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:53.827240 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-b35114e3-6081-4552-9688-9d1c048904b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '872cf7fc5ec744a0ae167061b00b85ab'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:53.838862 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-b35114e3-6081-4552-9688-9d1c048904b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '872cf7fc5ec744a0ae167061b00b85ab'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:53.847832 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8956ae5a-73be-43e9-8f26-f1577d41c8c1 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:53.849029 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-b35114e3-6081-4552-9688-9d1c048904b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '872cf7fc5ec744a0ae167061b00b85ab'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:53.858551 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c874ce0-06a4-4727-89e8-6a35b6edb600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:53.859308 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c874ce0-06a4-4727-89e8-6a35b6edb600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:53.860150 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c874ce0-06a4-4727-89e8-6a35b6edb600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:53.860508 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c874ce0-06a4-4727-89e8-6a35b6edb600 admin admin] PATH_INFO: `/v3/projects/33b6b718eea7430889df7e07ded4c7a5` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:53.861982 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c874ce0-06a4-4727-89e8-6a35b6edb600 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33b6b718eea7430889df7e07ded4c7a5)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:53.864054 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c874ce0-06a4-4727-89e8-6a35b6edb600 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:53.879955 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-b35114e3-6081-4552-9688-9d1c048904b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '872cf7fc5ec744a0ae167061b00b85ab'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:53.881131 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-b35114e3-6081-4552-9688-9d1c048904b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '872cf7fc5ec744a0ae167061b00b85ab'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:53.888178 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1326/2636] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:23:53 2022] DELETE /identity/v3/users/872cf7fc5ec744a0ae167061b00b85ab => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:23:53.927184 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-3c874ce0-06a4-4727-89e8-6a35b6edb600 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33b6b718eea7430889df7e07ded4c7a5', 'request_id': 'req-3c874ce0-06a4-4727-89e8-6a35b6edb600'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:53.936623 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-3c874ce0-06a4-4727-89e8-6a35b6edb600 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33b6b718eea7430889df7e07ded4c7a5', 'request_id': 'req-3c874ce0-06a4-4727-89e8-6a35b6edb600'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:53.943854 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-3c874ce0-06a4-4727-89e8-6a35b6edb600 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33b6b718eea7430889df7e07ded4c7a5', 'request_id': 'req-3c874ce0-06a4-4727-89e8-6a35b6edb600'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:53.978944 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-3c874ce0-06a4-4727-89e8-6a35b6edb600 admin admin] The token cache is being invalidate because project 33b6b718eea7430889df7e07ded4c7a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:23:53.979237 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-3c874ce0-06a4-4727-89e8-6a35b6edb600 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:53.980462 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-3c874ce0-06a4-4727-89e8-6a35b6edb600 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:53.982591 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1311/2637] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:23:53 2022] DELETE /identity/v3/projects/33b6b718eea7430889df7e07ded4c7a5 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:23:53.987633 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4425bfa-7a88-498a-9a30-d9ef70911ef8 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:53.987946 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4425bfa-7a88-498a-9a30-d9ef70911ef8 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:53.988224 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4425bfa-7a88-498a-9a30-d9ef70911ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:54.013072 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-d4425bfa-7a88-498a-9a30-d9ef70911ef8 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:23:54.014590 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-d4425bfa-7a88-498a-9a30-d9ef70911ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:54.108484 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1327/2638] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:23:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:23:54.116878 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8e77f-c2bb-455e-9915-e672030c44c4 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:54.117434 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8e77f-c2bb-455e-9915-e672030c44c4 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:54.117798 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8e77f-c2bb-455e-9915-e672030c44c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:54.136246 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-d0a8e77f-c2bb-455e-9915-e672030c44c4 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:23:54.137482 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-d0a8e77f-c2bb-455e-9915-e672030c44c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:54.145410 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1312/2639] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:23:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:23:54.150314 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4425bfa-7a88-498a-9a30-d9ef70911ef8 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:54.160038 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4425bfa-7a88-498a-9a30-d9ef70911ef8 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:54.166601 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7cfaa8-77a4-4384-a429-31aef8d7faac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:54.167281 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7cfaa8-77a4-4384-a429-31aef8d7faac admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:54.167562 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7cfaa8-77a4-4384-a429-31aef8d7faac admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:54.167980 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7cfaa8-77a4-4384-a429-31aef8d7faac admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:54.168879 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7cfaa8-77a4-4384-a429-31aef8d7faac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:23:54.169188 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7cfaa8-77a4-4384-a429-31aef8d7faac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:54.170798 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7cfaa8-77a4-4384-a429-31aef8d7faac admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:54.184142 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1328/2640] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:23:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:23:54.195949 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a8e77f-c2bb-455e-9915-e672030c44c4 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:54.207519 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a8e77f-c2bb-455e-9915-e672030c44c4 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:54.216641 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c3a958-7233-482a-a757-280e52efe80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:54.218802 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7cfaa8-77a4-4384-a429-31aef8d7faac admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:54.220633 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-9c7cfaa8-77a4-4384-a429-31aef8d7faac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:54.221314 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3a958-7233-482a-a757-280e52efe80f admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:54.221623 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3a958-7233-482a-a757-280e52efe80f admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:54.221905 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3a958-7233-482a-a757-280e52efe80f admin admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:54.222646 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c3a958-7233-482a-a757-280e52efe80f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:54.225331 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c3a958-7233-482a-a757-280e52efe80f admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:54.236211 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7cfaa8-77a4-4384-a429-31aef8d7faac admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:54.242633 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c828fe-ac2d-4dd0-a975-01a49a5e35d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:54.243602 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c828fe-ac2d-4dd0-a975-01a49a5e35d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:54.243951 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c828fe-ac2d-4dd0-a975-01a49a5e35d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:54.244296 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c828fe-ac2d-4dd0-a975-01a49a5e35d7 admin admin] PATH_INFO: `/v3/projects/2707a9b913c84f2ea9a1bfd2a0569183` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:54.245638 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c828fe-ac2d-4dd0-a975-01a49a5e35d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2707a9b913c84f2ea9a1bfd2a0569183)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:54.247939 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c828fe-ac2d-4dd0-a975-01a49a5e35d7 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:54.273801 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1313/2641] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:23:54 2022] POST /identity/v3/projects => generated 381 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:23:54.277852 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c3a958-7233-482a-a757-280e52efe80f admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:54.307614 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-32c828fe-ac2d-4dd0-a975-01a49a5e35d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2707a9b913c84f2ea9a1bfd2a0569183', 'request_id': 'req-32c828fe-ac2d-4dd0-a975-01a49a5e35d7'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:54.313157 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-32c828fe-ac2d-4dd0-a975-01a49a5e35d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2707a9b913c84f2ea9a1bfd2a0569183', 'request_id': 'req-32c828fe-ac2d-4dd0-a975-01a49a5e35d7'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:54.321291 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-32c828fe-ac2d-4dd0-a975-01a49a5e35d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2707a9b913c84f2ea9a1bfd2a0569183', 'request_id': 'req-32c828fe-ac2d-4dd0-a975-01a49a5e35d7'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:54.325651 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:23:54.333192 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-32c828fe-ac2d-4dd0-a975-01a49a5e35d7 admin admin] The token cache is being invalidate because project 2707a9b913c84f2ea9a1bfd2a0569183 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:23:54.334262 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-32c828fe-ac2d-4dd0-a975-01a49a5e35d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:54.335227 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-32c828fe-ac2d-4dd0-a975-01a49a5e35d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:54.337715 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1329/2642] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:23:54 2022] DELETE /identity/v3/projects/2707a9b913c84f2ea9a1bfd2a0569183 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:23:54.342837 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c3b6c-f009-40dd-b9e2-68914ddb1b1f None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:54.343194 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c3b6c-f009-40dd-b9e2-68914ddb1b1f None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:54.343542 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c3b6c-f009-40dd-b9e2-68914ddb1b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:54.346740 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c3a958-7233-482a-a757-280e52efe80f admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:54.364459 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-794c3b6c-f009-40dd-b9e2-68914ddb1b1f None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:23:54.367892 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-794c3b6c-f009-40dd-b9e2-68914ddb1b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:54.379286 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:23:54.420280 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eeedcf-20e4-48fc-8b7e-a1a539f7298b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:54.421084 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eeedcf-20e4-48fc-8b7e-a1a539f7298b admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:54.421407 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eeedcf-20e4-48fc-8b7e-a1a539f7298b admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:54.421754 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eeedcf-20e4-48fc-8b7e-a1a539f7298b admin admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:54.422697 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eeedcf-20e4-48fc-8b7e-a1a539f7298b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:54.425484 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eeedcf-20e4-48fc-8b7e-a1a539f7298b admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:54.440037 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1330/2643] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:23:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:23:54.452822 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ef937-9596-429e-9591-12342e057ee1 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:54.453167 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ef937-9596-429e-9591-12342e057ee1 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:54.453429 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ef937-9596-429e-9591-12342e057ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:54.455186 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1314/2644] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:23:54 2022] POST /identity/v3/users => generated 291 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:23:54.459677 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eeedcf-20e4-48fc-8b7e-a1a539f7298b admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:54.465712 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-14eeedcf-20e4-48fc-8b7e-a1a539f7298b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:54.497358 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-320ef937-9596-429e-9591-12342e057ee1 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:23:54.498712 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-320ef937-9596-429e-9591-12342e057ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:54.499106 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eeedcf-20e4-48fc-8b7e-a1a539f7298b admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:54.504322 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ca3c7-3db7-4a06-9362-06510d8a8d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:54.505240 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ca3c7-3db7-4a06-9362-06510d8a8d80 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:54.505694 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ca3c7-3db7-4a06-9362-06510d8a8d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:54.506091 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ca3c7-3db7-4a06-9362-06510d8a8d80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:54.507048 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ca3c7-3db7-4a06-9362-06510d8a8d80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:54.507248 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1331/2645] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:23:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:23:54.509427 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ca3c7-3db7-4a06-9362-06510d8a8d80 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:54.511474 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320ef937-9596-429e-9591-12342e057ee1 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:54.520246 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320ef937-9596-429e-9591-12342e057ee1 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:54.524674 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1315/2646] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:23:54 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:23:54.525727 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ca3c7-3db7-4a06-9362-06510d8a8d80 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:54.528224 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa96ec-f57b-4809-b47b-a9f49ad027e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:54.528905 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa96ec-f57b-4809-b47b-a9f49ad027e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:54.529191 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa96ec-f57b-4809-b47b-a9f49ad027e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:54.529464 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa96ec-f57b-4809-b47b-a9f49ad027e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:54.530191 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fa96ec-f57b-4809-b47b-a9f49ad027e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:23:54.530496 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fa96ec-f57b-4809-b47b-a9f49ad027e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:54.532246 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fa96ec-f57b-4809-b47b-a9f49ad027e9 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:54.535935 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ca3c7-3db7-4a06-9362-06510d8a8d80 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:54.541251 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c5aaf-12bd-4cee-bb4b-fa895987098a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:54.541900 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c5aaf-12bd-4cee-bb4b-fa895987098a admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:54.542183 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c5aaf-12bd-4cee-bb4b-fa895987098a admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:54.542461 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c5aaf-12bd-4cee-bb4b-fa895987098a admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:54.543179 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c5aaf-12bd-4cee-bb4b-fa895987098a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:54.547969 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1332/2647] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:23:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:23:54.548133 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c5aaf-12bd-4cee-bb4b-fa895987098a admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:54.549294 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa96ec-f57b-4809-b47b-a9f49ad027e9 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:54.560963 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1316/2648] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:23:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:23:54.561999 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c5aaf-12bd-4cee-bb4b-fa895987098a admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:54.566095 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa96ec-f57b-4809-b47b-a9f49ad027e9 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:54.571403 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b91e19a-c759-435c-8ec0-4cd23bd7b88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:54.573221 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c5aaf-12bd-4cee-bb4b-fa895987098a admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:54.578148 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ce49e-2b11-4697-8d30-5ebffe7e44ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:54.579284 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ce49e-2b11-4697-8d30-5ebffe7e44ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:54.579643 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ce49e-2b11-4697-8d30-5ebffe7e44ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:54.580139 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ce49e-2b11-4697-8d30-5ebffe7e44ad admin admin] PATH_INFO: `/v3/projects/b6222a5fbd254edfab7df0832781ef11/users/7f25235cae4d4fe4a905e43964009603/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:54.584581 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b91e19a-c759-435c-8ec0-4cd23bd7b88a admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:54.585189 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b91e19a-c759-435c-8ec0-4cd23bd7b88a admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:54.585641 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b91e19a-c759-435c-8ec0-4cd23bd7b88a admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:54.586572 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b91e19a-c759-435c-8ec0-4cd23bd7b88a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:54.590140 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b91e19a-c759-435c-8ec0-4cd23bd7b88a admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:54.598761 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ce49e-2b11-4697-8d30-5ebffe7e44ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6222a5fbd254edfab7df0832781ef11, user_id=7f25235cae4d4fe4a905e43964009603, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:54.602242 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ce49e-2b11-4697-8d30-5ebffe7e44ad admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:54.617738 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1317/2649] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:23:54 2022] PUT /identity/v3/projects/b6222a5fbd254edfab7df0832781ef11/users/7f25235cae4d4fe4a905e43964009603/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:23:54.628033 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c6d5a-b417-4798-a3f0-0311f671d405 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:54.628415 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c6d5a-b417-4798-a3f0-0311f671d405 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:54.628794 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c6d5a-b417-4798-a3f0-0311f671d405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:54.630435 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1333/2650] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:23:54 2022] POST /identity/v3/projects => generated 365 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:23:54.631551 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b91e19a-c759-435c-8ec0-4cd23bd7b88a admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:54.664062 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-b03c6d5a-b417-4798-a3f0-0311f671d405 None None] MFA Rules not processed for user `7f25235cae4d4fe4a905e43964009603`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:23:54.665556 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-b03c6d5a-b417-4798-a3f0-0311f671d405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:54.697904 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b91e19a-c759-435c-8ec0-4cd23bd7b88a admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:54.702660 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc17cc-541e-4e41-86b5-9b21c9ce1cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:54.703339 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc17cc-541e-4e41-86b5-9b21c9ce1cf0 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:54.703679 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc17cc-541e-4e41-86b5-9b21c9ce1cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:54.703965 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc17cc-541e-4e41-86b5-9b21c9ce1cf0 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:54.704827 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fc17cc-541e-4e41-86b5-9b21c9ce1cf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:54.707094 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fc17cc-541e-4e41-86b5-9b21c9ce1cf0 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:54.735082 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1334/2651] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:23:54 2022] POST /identity/v3/users => generated 283 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:23:54.736009 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc17cc-541e-4e41-86b5-9b21c9ce1cf0 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:54.736395 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1318/2652] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:23:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:23:54.741888 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c6d5a-b417-4798-a3f0-0311f671d405 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:54.747261 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc17cc-541e-4e41-86b5-9b21c9ce1cf0 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:54.752078 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4485b69-f3fc-4540-88ca-072c9d531950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:54.752815 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4485b69-f3fc-4540-88ca-072c9d531950 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:54.753102 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4485b69-f3fc-4540-88ca-072c9d531950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:54.753381 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4485b69-f3fc-4540-88ca-072c9d531950 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:54.754110 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4485b69-f3fc-4540-88ca-072c9d531950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:54.755215 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c6d5a-b417-4798-a3f0-0311f671d405 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:54.756270 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4485b69-f3fc-4540-88ca-072c9d531950 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:54.761040 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56296f28-5982-4a8e-99b1-596eeb8108e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:54.761864 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56296f28-5982-4a8e-99b1-596eeb8108e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:54.762169 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56296f28-5982-4a8e-99b1-596eeb8108e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:54.762431 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56296f28-5982-4a8e-99b1-596eeb8108e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:54.763157 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56296f28-5982-4a8e-99b1-596eeb8108e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:54.765078 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56296f28-5982-4a8e-99b1-596eeb8108e9 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:54.767429 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1335/2653] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:23:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:23:54.772209 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4485b69-f3fc-4540-88ca-072c9d531950 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:54.783424 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4485b69-f3fc-4540-88ca-072c9d531950 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:54.791256 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ca6ba-f6f8-4c0d-9b4c-99439b119dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:54.792093 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ca6ba-f6f8-4c0d-9b4c-99439b119dee admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:54.792482 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ca6ba-f6f8-4c0d-9b4c-99439b119dee admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:54.792865 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ca6ba-f6f8-4c0d-9b4c-99439b119dee admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:54.793442 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1319/2654] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:23:54 2022] POST /identity/v3/projects => generated 381 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:23:54.793742 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501ca6ba-f6f8-4c0d-9b4c-99439b119dee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:54.795514 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501ca6ba-f6f8-4c0d-9b4c-99439b119dee admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:54.797142 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56296f28-5982-4a8e-99b1-596eeb8108e9 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:54.801709 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:23:54.812236 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1336/2655] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:23:54 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:23:54.816072 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ca6ba-f6f8-4c0d-9b4c-99439b119dee admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:54.828547 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ca6ba-f6f8-4c0d-9b4c-99439b119dee admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:54.880689 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56296f28-5982-4a8e-99b1-596eeb8108e9 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:54.905160 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf35fc74-139a-4a1d-9e37-7e1f7b30867b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:54.911534 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:23:54.911951 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35fc74-139a-4a1d-9e37-7e1f7b30867b admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:54.913073 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35fc74-139a-4a1d-9e37-7e1f7b30867b admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:54.913530 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35fc74-139a-4a1d-9e37-7e1f7b30867b admin admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:54.914344 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf35fc74-139a-4a1d-9e37-7e1f7b30867b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:54.917208 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf35fc74-139a-4a1d-9e37-7e1f7b30867b admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:54.938739 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b670c4-4aa7-4a3c-85a6-2e3b8cf82345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:54.940159 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b670c4-4aa7-4a3c-85a6-2e3b8cf82345 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:54.940541 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b670c4-4aa7-4a3c-85a6-2e3b8cf82345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:54.940834 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b670c4-4aa7-4a3c-85a6-2e3b8cf82345 admin admin] PATH_INFO: `/v3/projects/3833478a49e54e3094aa901776148eb1/users/4fcd4087729d4ebdb62366c99373b7ae/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:54.962090 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1320/2656] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:23:54 2022] POST /identity/v3/users => generated 297 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:23:54.966448 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf35fc74-139a-4a1d-9e37-7e1f7b30867b admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:54.978699 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf35fc74-139a-4a1d-9e37-7e1f7b30867b admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:54.979164 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b670c4-4aa7-4a3c-85a6-2e3b8cf82345 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3833478a49e54e3094aa901776148eb1, user_id=4fcd4087729d4ebdb62366c99373b7ae, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:54.983581 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b670c4-4aa7-4a3c-85a6-2e3b8cf82345 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:54.984125 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1157cba-a60d-489c-8ff3-4184a83beee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:54.984795 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1157cba-a60d-489c-8ff3-4184a83beee1 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:54.985081 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1157cba-a60d-489c-8ff3-4184a83beee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:54.985966 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1157cba-a60d-489c-8ff3-4184a83beee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:54.986455 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1157cba-a60d-489c-8ff3-4184a83beee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:54.988029 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1157cba-a60d-489c-8ff3-4184a83beee1 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:55.003135 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1337/2657] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:23:54 2022] PUT /identity/v3/projects/3833478a49e54e3094aa901776148eb1/users/4fcd4087729d4ebdb62366c99373b7ae/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:23:55.004882 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1321/2658] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:23:54 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:23:55.007074 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b670c4-4aa7-4a3c-85a6-2e3b8cf82345 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:55.010954 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93506f-6c99-4ace-8141-12aebadf2eab None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:55.011320 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93506f-6c99-4ace-8141-12aebadf2eab None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:55.011821 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93506f-6c99-4ace-8141-12aebadf2eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:55.052781 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-1d93506f-6c99-4ace-8141-12aebadf2eab None None] MFA Rules not processed for user `4fcd4087729d4ebdb62366c99373b7ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:23:55.057716 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-1d93506f-6c99-4ace-8141-12aebadf2eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:55.106908 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b670c4-4aa7-4a3c-85a6-2e3b8cf82345 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:55.111970 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56c0a0-3fb9-4794-b5ed-23731556bd62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:55.113099 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56c0a0-3fb9-4794-b5ed-23731556bd62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:55.113604 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56c0a0-3fb9-4794-b5ed-23731556bd62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:55.114053 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56c0a0-3fb9-4794-b5ed-23731556bd62 admin admin] PATH_INFO: `/v3/projects/926aa4103da241689eb83af63403bdc5/users/bb65c2c1243341aa9e438caad4c85480/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:55.130123 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be56c0a0-3fb9-4794-b5ed-23731556bd62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=926aa4103da241689eb83af63403bdc5, user_id=bb65c2c1243341aa9e438caad4c85480, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:55.133619 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be56c0a0-3fb9-4794-b5ed-23731556bd62 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:55.140762 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1322/2659] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:23:55 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:23:55.143661 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93506f-6c99-4ace-8141-12aebadf2eab None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:55.151078 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1338/2660] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:23:55 2022] PUT /identity/v3/projects/926aa4103da241689eb83af63403bdc5/users/bb65c2c1243341aa9e438caad4c85480/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:23:55.154844 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56c0a0-3fb9-4794-b5ed-23731556bd62 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:55.158199 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93506f-6c99-4ace-8141-12aebadf2eab None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:55.228110 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56c0a0-3fb9-4794-b5ed-23731556bd62 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:55.233661 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8953dfb6-ed04-404d-9dc1-f0f5bcd96109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:55.234451 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953dfb6-ed04-404d-9dc1-f0f5bcd96109 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:55.234828 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953dfb6-ed04-404d-9dc1-f0f5bcd96109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:55.235220 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953dfb6-ed04-404d-9dc1-f0f5bcd96109 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:55.236048 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8953dfb6-ed04-404d-9dc1-f0f5bcd96109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:55.237780 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8953dfb6-ed04-404d-9dc1-f0f5bcd96109 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:55.246757 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f2678-da3d-4996-a146-4f2f255d8a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:55.247418 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f2678-da3d-4996-a146-4f2f255d8a28 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:55.247699 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f2678-da3d-4996-a146-4f2f255d8a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:55.247972 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f2678-da3d-4996-a146-4f2f255d8a28 admin admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:55.248685 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f2678-da3d-4996-a146-4f2f255d8a28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:55.251962 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1339/2661] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:23:55 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:23:55.252116 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f2678-da3d-4996-a146-4f2f255d8a28 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:55.253037 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8953dfb6-ed04-404d-9dc1-f0f5bcd96109 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:55.263466 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8953dfb6-ed04-404d-9dc1-f0f5bcd96109 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:55.265400 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:23:55.268863 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a37767-7c03-4cb7-a35e-0eef09effb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:55.269735 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a37767-7c03-4cb7-a35e-0eef09effb78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:55.269997 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a37767-7c03-4cb7-a35e-0eef09effb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:55.270272 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a37767-7c03-4cb7-a35e-0eef09effb78 admin admin] PATH_INFO: `/v3/projects/926aa4103da241689eb83af63403bdc5/users/bb65c2c1243341aa9e438caad4c85480/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:55.272986 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a37767-7c03-4cb7-a35e-0eef09effb78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=926aa4103da241689eb83af63403bdc5, user_id=bb65c2c1243341aa9e438caad4c85480, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:55.278682 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a37767-7c03-4cb7-a35e-0eef09effb78 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:55.289373 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1323/2662] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:23:55 2022] POST /identity/v3/projects => generated 363 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:23:55.293653 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1340/2663] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:23:55 2022] PUT /identity/v3/projects/926aa4103da241689eb83af63403bdc5/users/bb65c2c1243341aa9e438caad4c85480/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:23:55.293850 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f2678-da3d-4996-a146-4f2f255d8a28 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:55.305245 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da603607-332d-4038-93e6-87b2e693a542 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:55.305533 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da603607-332d-4038-93e6-87b2e693a542 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:55.305851 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da603607-332d-4038-93e6-87b2e693a542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:55.336301 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-da603607-332d-4038-93e6-87b2e693a542 None None] MFA Rules not processed for user `bb65c2c1243341aa9e438caad4c85480`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:23:55.337564 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-da603607-332d-4038-93e6-87b2e693a542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:55.354442 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:23:55.376636 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f2678-da3d-4996-a146-4f2f255d8a28 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:55.381826 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a286bb-690e-4805-94ea-519b13950d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:55.382489 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a286bb-690e-4805-94ea-519b13950d63 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:55.382766 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a286bb-690e-4805-94ea-519b13950d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:55.383039 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a286bb-690e-4805-94ea-519b13950d63 admin admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:55.383778 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a286bb-690e-4805-94ea-519b13950d63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:55.385736 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a286bb-690e-4805-94ea-519b13950d63 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:55.409535 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1324/2664] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:23:55 2022] POST /identity/v3/users => generated 288 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:23:55.413529 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a286bb-690e-4805-94ea-519b13950d63 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:55.426615 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1341/2665] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:23:55 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:23:55.438596 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a286bb-690e-4805-94ea-519b13950d63 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:55.440280 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da603607-332d-4038-93e6-87b2e693a542 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:55.441935 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-da603607-332d-4038-93e6-87b2e693a542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:55.451138 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be9a682-f468-408a-83fc-e06835e9c61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:55.452071 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9a682-f468-408a-83fc-e06835e9c61a admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:55.452421 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9a682-f468-408a-83fc-e06835e9c61a admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:55.452820 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9a682-f468-408a-83fc-e06835e9c61a admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:55.453663 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be9a682-f468-408a-83fc-e06835e9c61a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:55.455614 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be9a682-f468-408a-83fc-e06835e9c61a admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:55.467621 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1325/2666] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:23:55 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:23:55.471828 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be9a682-f468-408a-83fc-e06835e9c61a admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:55.483174 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be9a682-f468-408a-83fc-e06835e9c61a admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:55.492334 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf330f-a0d2-4802-b416-d72216501a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:55.494123 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf330f-a0d2-4802-b416-d72216501a65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:55.494397 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf330f-a0d2-4802-b416-d72216501a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:55.495942 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf330f-a0d2-4802-b416-d72216501a65 admin admin] PATH_INFO: `/v3/projects/3894b726fddd42b88c54a12b420d0a8f/users/1b85723b23854bddbcd6be8f1cc3d295/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:55.514511 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf330f-a0d2-4802-b416-d72216501a65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3894b726fddd42b88c54a12b420d0a8f, user_id=1b85723b23854bddbcd6be8f1cc3d295, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:55.517187 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf330f-a0d2-4802-b416-d72216501a65 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:55.529731 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da603607-332d-4038-93e6-87b2e693a542 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:55.531921 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1326/2667] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:23:55 2022] PUT /identity/v3/projects/3894b726fddd42b88c54a12b420d0a8f/users/1b85723b23854bddbcd6be8f1cc3d295/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:23:55.535772 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf330f-a0d2-4802-b416-d72216501a65 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:55.586990 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f094d25-b1cd-4fff-a051-9a2a1a305102 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:55.587965 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f094d25-b1cd-4fff-a051-9a2a1a305102 service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:55.588385 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f094d25-b1cd-4fff-a051-9a2a1a305102 service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:55.588725 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f094d25-b1cd-4fff-a051-9a2a1a305102 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:55.611989 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf330f-a0d2-4802-b416-d72216501a65 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:55.620544 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83046a40-68f6-4f5a-83eb-f4f6f35f4516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:55.621272 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83046a40-68f6-4f5a-83eb-f4f6f35f4516 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:55.621559 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83046a40-68f6-4f5a-83eb-f4f6f35f4516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:55.621817 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83046a40-68f6-4f5a-83eb-f4f6f35f4516 admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:55.622554 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83046a40-68f6-4f5a-83eb-f4f6f35f4516 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:55.624761 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83046a40-68f6-4f5a-83eb-f4f6f35f4516 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:55.645467 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1327/2668] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:23:55 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:23:55.649663 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83046a40-68f6-4f5a-83eb-f4f6f35f4516 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:55.660773 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83046a40-68f6-4f5a-83eb-f4f6f35f4516 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:55.667102 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af66a8d-fd06-4a9f-b7b7-4e75982b014e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:55.668162 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af66a8d-fd06-4a9f-b7b7-4e75982b014e admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:55.668474 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af66a8d-fd06-4a9f-b7b7-4e75982b014e admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:55.668742 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af66a8d-fd06-4a9f-b7b7-4e75982b014e admin admin] PATH_INFO: `/v3/projects/3894b726fddd42b88c54a12b420d0a8f/users/1b85723b23854bddbcd6be8f1cc3d295/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:55.671235 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af66a8d-fd06-4a9f-b7b7-4e75982b014e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3894b726fddd42b88c54a12b420d0a8f, user_id=1b85723b23854bddbcd6be8f1cc3d295, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:55.674376 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af66a8d-fd06-4a9f-b7b7-4e75982b014e admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:55.687827 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1328/2669] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:23:55 2022] PUT /identity/v3/projects/3894b726fddd42b88c54a12b420d0a8f/users/1b85723b23854bddbcd6be8f1cc3d295/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:23:55.698779 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e90de5-2125-4efc-9547-6a87a1c048f5 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:55.699062 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e90de5-2125-4efc-9547-6a87a1c048f5 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:55.699336 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e90de5-2125-4efc-9547-6a87a1c048f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:55.703474 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f094d25-b1cd-4fff-a051-9a2a1a305102 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:55.705035 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f094d25-b1cd-4fff-a051-9a2a1a305102 service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:55.716048 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1342/2670] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:23:55 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:23:55.731801 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-a7e90de5-2125-4efc-9547-6a87a1c048f5 None None] MFA Rules not processed for user `1b85723b23854bddbcd6be8f1cc3d295`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:23:55.733307 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-a7e90de5-2125-4efc-9547-6a87a1c048f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:55.757072 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:23:55.828110 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1329/2671] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:23:55 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:23:55.833533 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f094d25-b1cd-4fff-a051-9a2a1a305102 service cinder] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:55.840066 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e90de5-2125-4efc-9547-6a87a1c048f5 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:55.841624 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-a7e90de5-2125-4efc-9547-6a87a1c048f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:55.842801 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f094d25-b1cd-4fff-a051-9a2a1a305102 service cinder] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:55.862244 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:23:55.915190 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d500e2cb-b621-4b21-b179-d280930ca952 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:55.915750 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500e2cb-b621-4b21-b179-d280930ca952 service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:55.916056 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500e2cb-b621-4b21-b179-d280930ca952 service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:55.916349 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500e2cb-b621-4b21-b179-d280930ca952 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:55.922988 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e90de5-2125-4efc-9547-6a87a1c048f5 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:55.926870 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a44026-172a-4ca8-8595-5e74fc7fc897 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:55.927799 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a44026-172a-4ca8-8595-5e74fc7fc897 service cinder] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:55.928125 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a44026-172a-4ca8-8595-5e74fc7fc897 service cinder] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:55.928362 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a44026-172a-4ca8-8595-5e74fc7fc897 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:55.941648 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a44026-172a-4ca8-8595-5e74fc7fc897 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:55.943611 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a44026-172a-4ca8-8595-5e74fc7fc897 service cinder] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:55.955047 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1330/2672] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:23:55 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:23:56.030362 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d500e2cb-b621-4b21-b179-d280930ca952 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:56.031876 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d500e2cb-b621-4b21-b179-d280930ca952 service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:56.047184 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a44026-172a-4ca8-8595-5e74fc7fc897 service cinder] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:56.060293 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a44026-172a-4ca8-8595-5e74fc7fc897 service cinder] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:56.063676 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1343/2673] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:23:55 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:23:56.072081 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd6ee42-9cc4-434b-9a2b-8d27a99a07d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:56.072774 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6ee42-9cc4-434b-9a2b-8d27a99a07d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:56.073083 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6ee42-9cc4-434b-9a2b-8d27a99a07d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:56.073361 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6ee42-9cc4-434b-9a2b-8d27a99a07d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:56.146592 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd6ee42-9cc4-434b-9a2b-8d27a99a07d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:56.149023 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd6ee42-9cc4-434b-9a2b-8d27a99a07d7 service cinder] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:56.165083 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1331/2674] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:23:56 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:23:59.035091 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d500e2cb-b621-4b21-b179-d280930ca952 service cinder] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:59.116724 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d500e2cb-b621-4b21-b179-d280930ca952 service cinder] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:59.122075 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f0559-1eb8-48de-86f7-5d29ab7ddd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:59.122955 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f0559-1eb8-48de-86f7-5d29ab7ddd72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:59.123237 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f0559-1eb8-48de-86f7-5d29ab7ddd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:59.123651 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f0559-1eb8-48de-86f7-5d29ab7ddd72 admin admin] PATH_INFO: `/v3/users/4fcd4087729d4ebdb62366c99373b7ae` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:59.125711 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f0559-1eb8-48de-86f7-5d29ab7ddd72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fcd4087729d4ebdb62366c99373b7ae)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:59.127803 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f0559-1eb8-48de-86f7-5d29ab7ddd72 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:59.177805 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-8f9f0559-1eb8-48de-86f7-5d29ab7ddd72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fcd4087729d4ebdb62366c99373b7ae'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:59.187240 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-8f9f0559-1eb8-48de-86f7-5d29ab7ddd72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fcd4087729d4ebdb62366c99373b7ae'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:59.211561 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-8f9f0559-1eb8-48de-86f7-5d29ab7ddd72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fcd4087729d4ebdb62366c99373b7ae'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:59.224464 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:23:59.228774 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-8f9f0559-1eb8-48de-86f7-5d29ab7ddd72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fcd4087729d4ebdb62366c99373b7ae'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:59.230605 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-8f9f0559-1eb8-48de-86f7-5d29ab7ddd72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fcd4087729d4ebdb62366c99373b7ae'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:59.239268 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1344/2675] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:23:59 2022] DELETE /identity/v3/users/4fcd4087729d4ebdb62366c99373b7ae => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:23:59.244179 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8aee65-a5f1-4767-aaf6-5391eccff524 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:59.244863 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8aee65-a5f1-4767-aaf6-5391eccff524 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:59.244863 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8aee65-a5f1-4767-aaf6-5391eccff524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:59.267252 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-9d8aee65-a5f1-4767-aaf6-5391eccff524 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:23:59.267951 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-9d8aee65-a5f1-4767-aaf6-5391eccff524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:59.377828 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:23:59.393527 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1332/2676] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:23:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:23:59.400202 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f0559-1eb8-48de-86f7-5d29ab7ddd72 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:59.401694 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-8f9f0559-1eb8-48de-86f7-5d29ab7ddd72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:59.473700 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f0559-1eb8-48de-86f7-5d29ab7ddd72 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:59.477768 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1887a5bb-d158-4004-bcfd-134ddd330a78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:59.478515 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887a5bb-d158-4004-bcfd-134ddd330a78 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:59.478799 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887a5bb-d158-4004-bcfd-134ddd330a78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:59.479277 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887a5bb-d158-4004-bcfd-134ddd330a78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:59.492353 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1887a5bb-d158-4004-bcfd-134ddd330a78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:59.494006 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1887a5bb-d158-4004-bcfd-134ddd330a78 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:59.507721 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1345/2677] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:23:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:23:59.813298 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8aee65-a5f1-4767-aaf6-5391eccff524 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:59.815220 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-9d8aee65-a5f1-4767-aaf6-5391eccff524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:59.867041 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8aee65-a5f1-4767-aaf6-5391eccff524 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:59.886282 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64dd090-43ee-49e5-bac3-0b238ee8ada8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:59.887267 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64dd090-43ee-49e5-bac3-0b238ee8ada8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:59.887556 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64dd090-43ee-49e5-bac3-0b238ee8ada8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:59.887834 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64dd090-43ee-49e5-bac3-0b238ee8ada8 admin admin] PATH_INFO: `/v3/projects/3833478a49e54e3094aa901776148eb1` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:59.887950 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1887a5bb-d158-4004-bcfd-134ddd330a78 service neutron] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:59.889149 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64dd090-43ee-49e5-bac3-0b238ee8ada8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3833478a49e54e3094aa901776148eb1)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:59.891427 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64dd090-43ee-49e5-bac3-0b238ee8ada8 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:59.897072 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-1887a5bb-d158-4004-bcfd-134ddd330a78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:59.910826 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1887a5bb-d158-4004-bcfd-134ddd330a78 service neutron] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:59.916409 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f88645-c4fc-4e2b-98a9-f384582a684e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:59.917326 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f88645-c4fc-4e2b-98a9-f384582a684e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:59.917628 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f88645-c4fc-4e2b-98a9-f384582a684e admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:59.917898 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f88645-c4fc-4e2b-98a9-f384582a684e admin admin] PATH_INFO: `/v3/users/7f25235cae4d4fe4a905e43964009603` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:59.919134 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f88645-c4fc-4e2b-98a9-f384582a684e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f25235cae4d4fe4a905e43964009603)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:59.921274 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f88645-c4fc-4e2b-98a9-f384582a684e admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:00.013190 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-e64dd090-43ee-49e5-bac3-0b238ee8ada8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3833478a49e54e3094aa901776148eb1', 'request_id': 'req-e64dd090-43ee-49e5-bac3-0b238ee8ada8'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:00.017739 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e2f88645-c4fc-4e2b-98a9-f384582a684e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f25235cae4d4fe4a905e43964009603'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:00.024010 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-e64dd090-43ee-49e5-bac3-0b238ee8ada8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3833478a49e54e3094aa901776148eb1', 'request_id': 'req-e64dd090-43ee-49e5-bac3-0b238ee8ada8'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:00.038187 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-e64dd090-43ee-49e5-bac3-0b238ee8ada8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3833478a49e54e3094aa901776148eb1', 'request_id': 'req-e64dd090-43ee-49e5-bac3-0b238ee8ada8'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:00.041122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e2f88645-c4fc-4e2b-98a9-f384582a684e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f25235cae4d4fe4a905e43964009603'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:00.055284 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-e64dd090-43ee-49e5-bac3-0b238ee8ada8 admin admin] The token cache is being invalidate because project 3833478a49e54e3094aa901776148eb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:24:00.056227 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-e64dd090-43ee-49e5-bac3-0b238ee8ada8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:00.057469 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-e64dd090-43ee-49e5-bac3-0b238ee8ada8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:00.060345 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1333/2678] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:23:59 2022] DELETE /identity/v3/projects/3833478a49e54e3094aa901776148eb1 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:24:00.064141 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64dd090-43ee-49e5-bac3-0b238ee8ada8 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:00.066650 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-e64dd090-43ee-49e5-bac3-0b238ee8ada8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:00.067082 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e2f88645-c4fc-4e2b-98a9-f384582a684e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f25235cae4d4fe4a905e43964009603'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:00.083212 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e2f88645-c4fc-4e2b-98a9-f384582a684e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f25235cae4d4fe4a905e43964009603'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:00.084419 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e2f88645-c4fc-4e2b-98a9-f384582a684e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f25235cae4d4fe4a905e43964009603'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:00.106708 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1346/2679] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:23:59 2022] DELETE /identity/v3/users/7f25235cae4d4fe4a905e43964009603 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:24:00.111226 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194485b5-cb3e-495c-893a-57065563b479 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:00.111652 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194485b5-cb3e-495c-893a-57065563b479 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:00.112003 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194485b5-cb3e-495c-893a-57065563b479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:00.132804 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-194485b5-cb3e-495c-893a-57065563b479 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:24:00.134088 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-194485b5-cb3e-495c-893a-57065563b479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:00.159440 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64dd090-43ee-49e5-bac3-0b238ee8ada8 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:00.238849 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1347/2680] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:24:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:24:00.250465 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194485b5-cb3e-495c-893a-57065563b479 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:00.252005 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-194485b5-cb3e-495c-893a-57065563b479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:00.258290 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38979a0b-b6d7-4318-b0a3-1b741fb8c6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:00.259248 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38979a0b-b6d7-4318-b0a3-1b741fb8c6bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:00.259618 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38979a0b-b6d7-4318-b0a3-1b741fb8c6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:00.259966 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38979a0b-b6d7-4318-b0a3-1b741fb8c6bf admin admin] PATH_INFO: `/v3/users/1b85723b23854bddbcd6be8f1cc3d295` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:00.261320 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38979a0b-b6d7-4318-b0a3-1b741fb8c6bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b85723b23854bddbcd6be8f1cc3d295)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:00.263383 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38979a0b-b6d7-4318-b0a3-1b741fb8c6bf admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:00.263681 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:00.302864 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:00.320420 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-38979a0b-b6d7-4318-b0a3-1b741fb8c6bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b85723b23854bddbcd6be8f1cc3d295'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:00.321127 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194485b5-cb3e-495c-893a-57065563b479 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:00.326286 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a923b-0b97-413b-835a-df56498f9404 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:00.327894 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a923b-0b97-413b-835a-df56498f9404 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:00.328247 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a923b-0b97-413b-835a-df56498f9404 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:00.328595 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a923b-0b97-413b-835a-df56498f9404 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:00.350960 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7a923b-0b97-413b-835a-df56498f9404 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:00.350960 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7a923b-0b97-413b-835a-df56498f9404 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:00.352359 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-38979a0b-b6d7-4318-b0a3-1b741fb8c6bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b85723b23854bddbcd6be8f1cc3d295'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:00.357135 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-38979a0b-b6d7-4318-b0a3-1b741fb8c6bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b85723b23854bddbcd6be8f1cc3d295'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:00.358060 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-38979a0b-b6d7-4318-b0a3-1b741fb8c6bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b85723b23854bddbcd6be8f1cc3d295'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:00.361926 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1348/2681] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:24:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:24:00.372860 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-38979a0b-b6d7-4318-b0a3-1b741fb8c6bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b85723b23854bddbcd6be8f1cc3d295'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:00.385748 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1334/2682] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:24:00 2022] DELETE /identity/v3/users/1b85723b23854bddbcd6be8f1cc3d295 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:24:00.695539 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a923b-0b97-413b-835a-df56498f9404 service neutron] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:00.698765 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-6b7a923b-0b97-413b-835a-df56498f9404 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:00.714108 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a923b-0b97-413b-835a-df56498f9404 service neutron] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:00.784172 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38979a0b-b6d7-4318-b0a3-1b741fb8c6bf admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:00.785848 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-38979a0b-b6d7-4318-b0a3-1b741fb8c6bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:00.804605 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc49ef0-ab5c-4089-b15e-877c8e4e8a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:00.805673 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc49ef0-ab5c-4089-b15e-877c8e4e8a63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:00.806073 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc49ef0-ab5c-4089-b15e-877c8e4e8a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:00.806465 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc49ef0-ab5c-4089-b15e-877c8e4e8a63 admin admin] PATH_INFO: `/v3/projects/b6222a5fbd254edfab7df0832781ef11` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:00.807758 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc49ef0-ab5c-4089-b15e-877c8e4e8a63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6222a5fbd254edfab7df0832781ef11)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:00.809783 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc49ef0-ab5c-4089-b15e-877c8e4e8a63 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:00.867285 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38979a0b-b6d7-4318-b0a3-1b741fb8c6bf admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:00.874773 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-3cc49ef0-ab5c-4089-b15e-877c8e4e8a63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6222a5fbd254edfab7df0832781ef11', 'request_id': 'req-3cc49ef0-ab5c-4089-b15e-877c8e4e8a63'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:00.883694 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-3cc49ef0-ab5c-4089-b15e-877c8e4e8a63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6222a5fbd254edfab7df0832781ef11', 'request_id': 'req-3cc49ef0-ab5c-4089-b15e-877c8e4e8a63'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:00.894124 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-3cc49ef0-ab5c-4089-b15e-877c8e4e8a63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6222a5fbd254edfab7df0832781ef11', 'request_id': 'req-3cc49ef0-ab5c-4089-b15e-877c8e4e8a63'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:00.907058 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-3cc49ef0-ab5c-4089-b15e-877c8e4e8a63 admin admin] The token cache is being invalidate because project b6222a5fbd254edfab7df0832781ef11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:24:00.907342 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-3cc49ef0-ab5c-4089-b15e-877c8e4e8a63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:00.907996 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-3cc49ef0-ab5c-4089-b15e-877c8e4e8a63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:00.909581 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1349/2683] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:24:00 2022] DELETE /identity/v3/projects/b6222a5fbd254edfab7df0832781ef11 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:24:00.913500 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc49ef0-ab5c-4089-b15e-877c8e4e8a63 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:00.914913 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-3cc49ef0-ab5c-4089-b15e-877c8e4e8a63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:00.954669 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b042669-e686-4e19-805b-e9be2f0ffb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:00.955547 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b042669-e686-4e19-805b-e9be2f0ffb0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:00.955823 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b042669-e686-4e19-805b-e9be2f0ffb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:00.956095 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b042669-e686-4e19-805b-e9be2f0ffb0b admin admin] PATH_INFO: `/v3/projects/3894b726fddd42b88c54a12b420d0a8f` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:00.957332 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b042669-e686-4e19-805b-e9be2f0ffb0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3894b726fddd42b88c54a12b420d0a8f)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:00.959531 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b042669-e686-4e19-805b-e9be2f0ffb0b admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:00.971337 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:00.997914 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc49ef0-ab5c-4089-b15e-877c8e4e8a63 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:01.010190 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-8b042669-e686-4e19-805b-e9be2f0ffb0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3894b726fddd42b88c54a12b420d0a8f', 'request_id': 'req-8b042669-e686-4e19-805b-e9be2f0ffb0b'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:01.019531 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-8b042669-e686-4e19-805b-e9be2f0ffb0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3894b726fddd42b88c54a12b420d0a8f', 'request_id': 'req-8b042669-e686-4e19-805b-e9be2f0ffb0b'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:01.028878 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:01.038316 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-8b042669-e686-4e19-805b-e9be2f0ffb0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3894b726fddd42b88c54a12b420d0a8f', 'request_id': 'req-8b042669-e686-4e19-805b-e9be2f0ffb0b'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:01.063288 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-8b042669-e686-4e19-805b-e9be2f0ffb0b admin admin] The token cache is being invalidate because project 3894b726fddd42b88c54a12b420d0a8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:24:01.063725 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-8b042669-e686-4e19-805b-e9be2f0ffb0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:01.064481 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-8b042669-e686-4e19-805b-e9be2f0ffb0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:01.066369 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1335/2684] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:24:00 2022] DELETE /identity/v3/projects/3894b726fddd42b88c54a12b420d0a8f => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:24:01.070541 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30748395-3a44-42dc-9989-59a0049f2b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:01.071435 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30748395-3a44-42dc-9989-59a0049f2b6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:01.071721 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30748395-3a44-42dc-9989-59a0049f2b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:01.071998 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30748395-3a44-42dc-9989-59a0049f2b6f admin admin] PATH_INFO: `/v3/users/bb65c2c1243341aa9e438caad4c85480` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:01.072107 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d435a6-e58c-4f46-8327-a171587c0139 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:01.072314 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d435a6-e58c-4f46-8327-a171587c0139 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:01.072594 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d435a6-e58c-4f46-8327-a171587c0139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:01.073254 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30748395-3a44-42dc-9989-59a0049f2b6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb65c2c1243341aa9e438caad4c85480)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:01.075228 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30748395-3a44-42dc-9989-59a0049f2b6f admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:01.091249 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-d4d435a6-e58c-4f46-8327-a171587c0139 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:24:01.092462 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-d4d435a6-e58c-4f46-8327-a171587c0139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:01.100753 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1336/2685] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:24:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:24:01.111132 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69ac5e-1885-4868-9315-1637f9fc9d27 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:01.111502 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69ac5e-1885-4868-9315-1637f9fc9d27 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:01.111847 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69ac5e-1885-4868-9315-1637f9fc9d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:01.124995 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-30748395-3a44-42dc-9989-59a0049f2b6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb65c2c1243341aa9e438caad4c85480'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:01.132046 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-8c69ac5e-1885-4868-9315-1637f9fc9d27 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:24:01.133445 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-8c69ac5e-1885-4868-9315-1637f9fc9d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:01.134385 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-30748395-3a44-42dc-9989-59a0049f2b6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb65c2c1243341aa9e438caad4c85480'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:01.144421 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-30748395-3a44-42dc-9989-59a0049f2b6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb65c2c1243341aa9e438caad4c85480'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:01.145122 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1337/2686] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:24:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:24:01.146134 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69ac5e-1885-4868-9315-1637f9fc9d27 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:01.156281 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69ac5e-1885-4868-9315-1637f9fc9d27 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:01.160736 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-30748395-3a44-42dc-9989-59a0049f2b6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb65c2c1243341aa9e438caad4c85480'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:01.161240 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb5e42-f5ad-4ae5-abc9-9d8495d8920c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:01.161958 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-30748395-3a44-42dc-9989-59a0049f2b6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb65c2c1243341aa9e438caad4c85480'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:01.162918 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb5e42-f5ad-4ae5-abc9-9d8495d8920c admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:01.163209 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb5e42-f5ad-4ae5-abc9-9d8495d8920c admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:01.163487 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb5e42-f5ad-4ae5-abc9-9d8495d8920c admin admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:01.164225 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bb5e42-f5ad-4ae5-abc9-9d8495d8920c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:24:01.164538 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bb5e42-f5ad-4ae5-abc9-9d8495d8920c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:01.166196 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bb5e42-f5ad-4ae5-abc9-9d8495d8920c admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:01.170863 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1350/2687] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:24:00 2022] DELETE /identity/v3/users/bb65c2c1243341aa9e438caad4c85480 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:24:01.184428 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1338/2688] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:24:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:24:01.185600 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30748395-3a44-42dc-9989-59a0049f2b6f admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:01.187011 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-30748395-3a44-42dc-9989-59a0049f2b6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:01.259558 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30748395-3a44-42dc-9989-59a0049f2b6f admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:01.264466 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e7c944-b6f9-45fd-84c5-691f2f63ae49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:01.265178 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e7c944-b6f9-45fd-84c5-691f2f63ae49 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:01.265479 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e7c944-b6f9-45fd-84c5-691f2f63ae49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:01.265747 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e7c944-b6f9-45fd-84c5-691f2f63ae49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:01.266842 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e7c944-b6f9-45fd-84c5-691f2f63ae49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:01.268771 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e7c944-b6f9-45fd-84c5-691f2f63ae49 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:01.283258 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:01.303812 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1351/2689] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:24:01 2022] POST /identity/v3/projects => generated 387 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:24:01.307627 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb5e42-f5ad-4ae5-abc9-9d8495d8920c admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:01.319787 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb5e42-f5ad-4ae5-abc9-9d8495d8920c admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:01.382632 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66ad2e-45ca-4280-bbb3-a47d3610e62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:01.383497 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66ad2e-45ca-4280-bbb3-a47d3610e62c admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:01.383782 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66ad2e-45ca-4280-bbb3-a47d3610e62c admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:01.384059 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66ad2e-45ca-4280-bbb3-a47d3610e62c admin admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:01.384797 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66ad2e-45ca-4280-bbb3-a47d3610e62c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:01.386734 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66ad2e-45ca-4280-bbb3-a47d3610e62c admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:01.414414 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1339/2690] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:24:01 2022] POST /identity/v3/users => generated 294 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:24:01.418138 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e7c944-b6f9-45fd-84c5-691f2f63ae49 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:01.430682 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e7c944-b6f9-45fd-84c5-691f2f63ae49 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:01.436337 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e27bd9-c656-4e63-b318-a95191edb717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:01.437347 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e27bd9-c656-4e63-b318-a95191edb717 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:01.437868 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e27bd9-c656-4e63-b318-a95191edb717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:01.438502 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e27bd9-c656-4e63-b318-a95191edb717 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:01.439968 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e27bd9-c656-4e63-b318-a95191edb717 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:01.441657 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e27bd9-c656-4e63-b318-a95191edb717 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:01.455611 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1352/2691] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:24:01.460361 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66ad2e-45ca-4280-bbb3-a47d3610e62c admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:01.470479 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66ad2e-45ca-4280-bbb3-a47d3610e62c admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:01.475581 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4150fb12-cf23-46e6-b63e-9ae2d750d21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:01.476254 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150fb12-cf23-46e6-b63e-9ae2d750d21b admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:01.476540 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150fb12-cf23-46e6-b63e-9ae2d750d21b admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:01.476856 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150fb12-cf23-46e6-b63e-9ae2d750d21b admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:01.477590 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4150fb12-cf23-46e6-b63e-9ae2d750d21b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:01.479226 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4150fb12-cf23-46e6-b63e-9ae2d750d21b admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:01.490190 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1340/2692] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:24:01.494269 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e27bd9-c656-4e63-b318-a95191edb717 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:01.504147 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e27bd9-c656-4e63-b318-a95191edb717 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:01.509645 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ebf9b1-9ebd-4681-85dc-9a4012657ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:01.510546 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebf9b1-9ebd-4681-85dc-9a4012657ed5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:01.510920 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebf9b1-9ebd-4681-85dc-9a4012657ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:01.511206 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebf9b1-9ebd-4681-85dc-9a4012657ed5 admin admin] PATH_INFO: `/v3/projects/65a0f87beb3a460ca877cadf492b76f6/users/76dafcc3884242eb8ab9cc3fa6da5b5d/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:01.529402 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ebf9b1-9ebd-4681-85dc-9a4012657ed5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65a0f87beb3a460ca877cadf492b76f6, user_id=76dafcc3884242eb8ab9cc3fa6da5b5d, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:01.532099 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ebf9b1-9ebd-4681-85dc-9a4012657ed5 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:01.547463 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1353/2693] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:24:01 2022] PUT /identity/v3/projects/65a0f87beb3a460ca877cadf492b76f6/users/76dafcc3884242eb8ab9cc3fa6da5b5d/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:24:01.558876 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a851a0-a1a5-4ec5-8bba-bc0399846488 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:01.559232 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a851a0-a1a5-4ec5-8bba-bc0399846488 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:01.559510 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a851a0-a1a5-4ec5-8bba-bc0399846488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:01.568752 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ebf9b1-9ebd-4681-85dc-9a4012657ed5 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:01.570492 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-c5ebf9b1-9ebd-4681-85dc-9a4012657ed5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:01.589777 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-02a851a0-a1a5-4ec5-8bba-bc0399846488 None None] MFA Rules not processed for user `76dafcc3884242eb8ab9cc3fa6da5b5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:24:01.591538 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-02a851a0-a1a5-4ec5-8bba-bc0399846488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:01.644069 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ebf9b1-9ebd-4681-85dc-9a4012657ed5 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:01.649533 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee1c60-42a3-4008-9b7d-c5053c5c0362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:01.650481 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee1c60-42a3-4008-9b7d-c5053c5c0362 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:01.650799 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee1c60-42a3-4008-9b7d-c5053c5c0362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:01.651227 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee1c60-42a3-4008-9b7d-c5053c5c0362 admin admin] PATH_INFO: `/v3/projects/926aa4103da241689eb83af63403bdc5` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:01.652373 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ee1c60-42a3-4008-9b7d-c5053c5c0362 admin admin] RBAC: Authorizing `identity:delete_project(project_id=926aa4103da241689eb83af63403bdc5)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:01.654313 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ee1c60-42a3-4008-9b7d-c5053c5c0362 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:01.666636 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1341/2694] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:24:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:24:01.671004 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a851a0-a1a5-4ec5-8bba-bc0399846488 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:01.681316 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a851a0-a1a5-4ec5-8bba-bc0399846488 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:01.686614 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce3feac-2ac5-4aaf-85b5-3f8c15585929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:01.687267 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3feac-2ac5-4aaf-85b5-3f8c15585929 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:01.687549 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3feac-2ac5-4aaf-85b5-3f8c15585929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:01.687823 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3feac-2ac5-4aaf-85b5-3f8c15585929 admin admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:01.688521 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce3feac-2ac5-4aaf-85b5-3f8c15585929 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:01.690444 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce3feac-2ac5-4aaf-85b5-3f8c15585929 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:01.703199 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-f1ee1c60-42a3-4008-9b7d-c5053c5c0362 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '926aa4103da241689eb83af63403bdc5', 'request_id': 'req-f1ee1c60-42a3-4008-9b7d-c5053c5c0362'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:01.709690 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-f1ee1c60-42a3-4008-9b7d-c5053c5c0362 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '926aa4103da241689eb83af63403bdc5', 'request_id': 'req-f1ee1c60-42a3-4008-9b7d-c5053c5c0362'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:01.717706 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-f1ee1c60-42a3-4008-9b7d-c5053c5c0362 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '926aa4103da241689eb83af63403bdc5', 'request_id': 'req-f1ee1c60-42a3-4008-9b7d-c5053c5c0362'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:01.718444 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1342/2695] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:24:01 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:24:01.722161 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce3feac-2ac5-4aaf-85b5-3f8c15585929 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:01.730897 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-f1ee1c60-42a3-4008-9b7d-c5053c5c0362 admin admin] The token cache is being invalidate because project 926aa4103da241689eb83af63403bdc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:24:01.731187 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-f1ee1c60-42a3-4008-9b7d-c5053c5c0362 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:01.731495 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:01.731983 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-f1ee1c60-42a3-4008-9b7d-c5053c5c0362 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:01.733778 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1354/2696] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:24:01 2022] DELETE /identity/v3/projects/926aa4103da241689eb83af63403bdc5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:24:01.738620 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20428472-ac7e-4126-95db-48337fc1f12c None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:01.738916 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20428472-ac7e-4126-95db-48337fc1f12c None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:01.739189 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20428472-ac7e-4126-95db-48337fc1f12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:01.757825 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-20428472-ac7e-4126-95db-48337fc1f12c None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:24:01.759084 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-20428472-ac7e-4126-95db-48337fc1f12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:01.789307 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce3feac-2ac5-4aaf-85b5-3f8c15585929 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:01.793987 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ab511-7a57-4e64-adf9-b6f4978c29bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:01.794650 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ab511-7a57-4e64-adf9-b6f4978c29bc admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:01.794940 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ab511-7a57-4e64-adf9-b6f4978c29bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:01.795216 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ab511-7a57-4e64-adf9-b6f4978c29bc admin admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:01.795903 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849ab511-7a57-4e64-adf9-b6f4978c29bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:01.797916 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849ab511-7a57-4e64-adf9-b6f4978c29bc admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:01.805579 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:01.819447 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1343/2697] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:24:01 2022] POST /identity/v3/users => generated 299 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:24:01.823421 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ab511-7a57-4e64-adf9-b6f4978c29bc admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:01.823890 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1355/2698] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:24:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:24:01.825090 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-849ab511-7a57-4e64-adf9-b6f4978c29bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:01.831135 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a4b0c-d4ab-4a17-bb09-f60c04fc3ea3 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:01.831431 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a4b0c-d4ab-4a17-bb09-f60c04fc3ea3 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:01.831714 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a4b0c-d4ab-4a17-bb09-f60c04fc3ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:01.837406 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ab511-7a57-4e64-adf9-b6f4978c29bc admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:01.842108 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0dba2d-1d54-4dee-aa6a-cdc2050915be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:01.842766 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0dba2d-1d54-4dee-aa6a-cdc2050915be admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:01.843048 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0dba2d-1d54-4dee-aa6a-cdc2050915be admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:01.843324 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0dba2d-1d54-4dee-aa6a-cdc2050915be admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:01.844049 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0dba2d-1d54-4dee-aa6a-cdc2050915be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:01.845676 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0dba2d-1d54-4dee-aa6a-cdc2050915be admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:01.850515 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-506a4b0c-d4ab-4a17-bb09-f60c04fc3ea3 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:24:01.851724 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-506a4b0c-d4ab-4a17-bb09-f60c04fc3ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:01.858123 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1344/2699] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:24:01.860273 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1356/2700] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:24:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:24:01.860411 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0dba2d-1d54-4dee-aa6a-cdc2050915be admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:01.864542 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a4b0c-d4ab-4a17-bb09-f60c04fc3ea3 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:01.871351 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0dba2d-1d54-4dee-aa6a-cdc2050915be admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:01.874101 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a4b0c-d4ab-4a17-bb09-f60c04fc3ea3 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:01.875945 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef90136-f1b5-475a-8e23-2178b5769c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:01.876835 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef90136-f1b5-475a-8e23-2178b5769c50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:01.877119 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef90136-f1b5-475a-8e23-2178b5769c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:01.877392 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef90136-f1b5-475a-8e23-2178b5769c50 admin admin] PATH_INFO: `/v3/projects/133bdde54df24e0c96c0b1fecace9cdd/users/01ae6a2ec7584e77975d23eb7d2b74a9/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:01.878921 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72f300c-d375-48f5-82df-93a401cce20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:01.879560 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f300c-d375-48f5-82df-93a401cce20f admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:01.879845 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f300c-d375-48f5-82df-93a401cce20f admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:01.880121 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f300c-d375-48f5-82df-93a401cce20f admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:01.881024 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72f300c-d375-48f5-82df-93a401cce20f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:24:01.881336 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72f300c-d375-48f5-82df-93a401cce20f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:01.882927 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72f300c-d375-48f5-82df-93a401cce20f admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:01.893151 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef90136-f1b5-475a-8e23-2178b5769c50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=133bdde54df24e0c96c0b1fecace9cdd, user_id=01ae6a2ec7584e77975d23eb7d2b74a9, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:01.894937 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1357/2701] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:24:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:24:01.895799 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef90136-f1b5-475a-8e23-2178b5769c50 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:01.899804 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72f300c-d375-48f5-82df-93a401cce20f admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:01.909615 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72f300c-d375-48f5-82df-93a401cce20f admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:01.910089 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1345/2702] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:24:01 2022] PUT /identity/v3/projects/133bdde54df24e0c96c0b1fecace9cdd/users/01ae6a2ec7584e77975d23eb7d2b74a9/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:24:01.914743 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef90136-f1b5-475a-8e23-2178b5769c50 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:01.969760 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47f8f1-ada8-473b-8021-050c4d6b92ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:01.970413 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47f8f1-ada8-473b-8021-050c4d6b92ea admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:01.970694 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47f8f1-ada8-473b-8021-050c4d6b92ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:01.970965 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47f8f1-ada8-473b-8021-050c4d6b92ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:01.971648 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef47f8f1-ada8-473b-8021-050c4d6b92ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:01.973574 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef47f8f1-ada8-473b-8021-050c4d6b92ea admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:01.977397 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef90136-f1b5-475a-8e23-2178b5769c50 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:01.982713 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2a4d1-6de2-4988-9f5c-67ffb0ab06a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:01.983804 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2a4d1-6de2-4988-9f5c-67ffb0ab06a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:01.984090 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2a4d1-6de2-4988-9f5c-67ffb0ab06a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:01.984370 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2a4d1-6de2-4988-9f5c-67ffb0ab06a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:01.985522 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc2a4d1-6de2-4988-9f5c-67ffb0ab06a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:01.987188 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc2a4d1-6de2-4988-9f5c-67ffb0ab06a9 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:01.997285 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1346/2703] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:24:02.000819 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1358/2704] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:24:01 2022] POST /identity/v3/projects => generated 365 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:24:02.001541 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2a4d1-6de2-4988-9f5c-67ffb0ab06a9 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:02.004378 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47f8f1-ada8-473b-8021-050c4d6b92ea admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:02.012053 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2a4d1-6de2-4988-9f5c-67ffb0ab06a9 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:02.062495 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:02.066536 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47f8f1-ada8-473b-8021-050c4d6b92ea admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:02.069593 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ff26e-6c8a-4018-817f-3f18abe492e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:02.070893 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ff26e-6c8a-4018-817f-3f18abe492e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:02.071354 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ff26e-6c8a-4018-817f-3f18abe492e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:02.071653 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ff26e-6c8a-4018-817f-3f18abe492e7 admin admin] PATH_INFO: `/v3/projects/133bdde54df24e0c96c0b1fecace9cdd/users/01ae6a2ec7584e77975d23eb7d2b74a9/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:02.072746 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3e821-c07b-40f9-8929-7440d360eb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:02.073414 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3e821-c07b-40f9-8929-7440d360eb5b admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:02.073656 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ff26e-6c8a-4018-817f-3f18abe492e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=133bdde54df24e0c96c0b1fecace9cdd, user_id=01ae6a2ec7584e77975d23eb7d2b74a9, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:02.073771 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3e821-c07b-40f9-8929-7440d360eb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:02.073959 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3e821-c07b-40f9-8929-7440d360eb5b admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:02.074644 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a3e821-c07b-40f9-8929-7440d360eb5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:02.076323 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ff26e-6c8a-4018-817f-3f18abe492e7 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:02.076649 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a3e821-c07b-40f9-8929-7440d360eb5b admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:02.086909 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1347/2705] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:24:02 2022] PUT /identity/v3/projects/133bdde54df24e0c96c0b1fecace9cdd/users/01ae6a2ec7584e77975d23eb7d2b74a9/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:24:02.098080 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a5a84-ac71-42a4-8f0f-1b9af43cdfd3 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:02.098371 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a5a84-ac71-42a4-8f0f-1b9af43cdfd3 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:02.098646 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a5a84-ac71-42a4-8f0f-1b9af43cdfd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:02.104383 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1359/2706] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:24:02 2022] POST /identity/v3/users => generated 283 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:24:02.108157 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3e821-c07b-40f9-8929-7440d360eb5b admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:02.118646 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3e821-c07b-40f9-8929-7440d360eb5b admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:02.126627 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-ab0a5a84-ac71-42a4-8f0f-1b9af43cdfd3 None None] MFA Rules not processed for user `01ae6a2ec7584e77975d23eb7d2b74a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:24:02.127899 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-ab0a5a84-ac71-42a4-8f0f-1b9af43cdfd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:02.162342 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:02.179352 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd54df-e90e-462c-bc10-f66b1a3a1fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:02.180023 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd54df-e90e-462c-bc10-f66b1a3a1fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:02.180305 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd54df-e90e-462c-bc10-f66b1a3a1fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:02.180581 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd54df-e90e-462c-bc10-f66b1a3a1fa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:02.181344 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccd54df-e90e-462c-bc10-f66b1a3a1fa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:02.182941 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccd54df-e90e-462c-bc10-f66b1a3a1fa4 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:02.193231 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1360/2707] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:24:02.197097 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd54df-e90e-462c-bc10-f66b1a3a1fa4 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:02.203407 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1348/2708] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:24:02 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:24:02.213257 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd54df-e90e-462c-bc10-f66b1a3a1fa4 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:02.214449 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a5a84-ac71-42a4-8f0f-1b9af43cdfd3 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:02.215850 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-ab0a5a84-ac71-42a4-8f0f-1b9af43cdfd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:02.218451 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6581ef-e7a7-459e-8f69-fd490df81bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:02.219142 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6581ef-e7a7-459e-8f69-fd490df81bc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:02.219422 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6581ef-e7a7-459e-8f69-fd490df81bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:02.219695 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6581ef-e7a7-459e-8f69-fd490df81bc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:02.220420 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6581ef-e7a7-459e-8f69-fd490df81bc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:02.222036 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6581ef-e7a7-459e-8f69-fd490df81bc0 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:02.232903 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1361/2709] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:24:02.237633 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6581ef-e7a7-459e-8f69-fd490df81bc0 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:02.248527 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6581ef-e7a7-459e-8f69-fd490df81bc0 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:02.253314 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838b22d-caf7-41bb-bba5-b09cb02aa9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:02.254184 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838b22d-caf7-41bb-bba5-b09cb02aa9f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:02.254475 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838b22d-caf7-41bb-bba5-b09cb02aa9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:02.254754 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838b22d-caf7-41bb-bba5-b09cb02aa9f3 admin admin] PATH_INFO: `/v3/projects/d6e89a456caa4492a54a899771035778/users/cbb08e4cdf97497789053bad761a4d8a/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:02.270354 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2838b22d-caf7-41bb-bba5-b09cb02aa9f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6e89a456caa4492a54a899771035778, user_id=cbb08e4cdf97497789053bad761a4d8a, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:02.273684 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2838b22d-caf7-41bb-bba5-b09cb02aa9f3 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:02.277217 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a5a84-ac71-42a4-8f0f-1b9af43cdfd3 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:02.281543 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b2b63-36f1-42b3-9ad5-4b0252fb02fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:02.282189 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b2b63-36f1-42b3-9ad5-4b0252fb02fb service cinder] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:02.282475 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b2b63-36f1-42b3-9ad5-4b0252fb02fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:02.282742 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b2b63-36f1-42b3-9ad5-4b0252fb02fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:02.291571 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1362/2710] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:24:02 2022] PUT /identity/v3/projects/d6e89a456caa4492a54a899771035778/users/cbb08e4cdf97497789053bad761a4d8a/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:24:02.292180 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b2b63-36f1-42b3-9ad5-4b0252fb02fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:02.293628 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b2b63-36f1-42b3-9ad5-4b0252fb02fb service cinder] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:02.303663 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1349/2711] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:24:02 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:24:02.306784 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d522cf-b6f2-4b93-9cd5-b674be68c2bb None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:02.307072 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d522cf-b6f2-4b93-9cd5-b674be68c2bb None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:02.307346 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d522cf-b6f2-4b93-9cd5-b674be68c2bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:02.330953 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b2b63-36f1-42b3-9ad5-4b0252fb02fb service cinder] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:02.341253 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-72d522cf-b6f2-4b93-9cd5-b674be68c2bb None None] MFA Rules not processed for user `cbb08e4cdf97497789053bad761a4d8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:24:02.341731 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b2b63-36f1-42b3-9ad5-4b0252fb02fb service cinder] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:02.342474 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-72d522cf-b6f2-4b93-9cd5-b674be68c2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:02.401738 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a808b-9077-411e-9331-fe984d03ec7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:02.402617 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a808b-9077-411e-9331-fe984d03ec7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:02.402903 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a808b-9077-411e-9331-fe984d03ec7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:02.403183 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a808b-9077-411e-9331-fe984d03ec7b admin admin] PATH_INFO: `/v3/users/76dafcc3884242eb8ab9cc3fa6da5b5d` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:02.404830 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85a808b-9077-411e-9331-fe984d03ec7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=76dafcc3884242eb8ab9cc3fa6da5b5d)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:02.406755 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85a808b-9077-411e-9331-fe984d03ec7b admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:02.412904 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1363/2712] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:24:02 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:24:02.417108 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d522cf-b6f2-4b93-9cd5-b674be68c2bb None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:02.431001 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:02.432464 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d522cf-b6f2-4b93-9cd5-b674be68c2bb None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:02.438091 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80bc207-bb3a-43dc-b21e-9766aec193f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:02.438962 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80bc207-bb3a-43dc-b21e-9766aec193f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:02.439339 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80bc207-bb3a-43dc-b21e-9766aec193f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:02.440049 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80bc207-bb3a-43dc-b21e-9766aec193f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:02.440793 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80bc207-bb3a-43dc-b21e-9766aec193f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:02.443404 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80bc207-bb3a-43dc-b21e-9766aec193f7 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:02.469384 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-e85a808b-9077-411e-9331-fe984d03ec7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76dafcc3884242eb8ab9cc3fa6da5b5d'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:02.478933 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-e85a808b-9077-411e-9331-fe984d03ec7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76dafcc3884242eb8ab9cc3fa6da5b5d'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:02.479678 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-e85a808b-9077-411e-9331-fe984d03ec7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76dafcc3884242eb8ab9cc3fa6da5b5d'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:02.480558 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-e85a808b-9077-411e-9331-fe984d03ec7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76dafcc3884242eb8ab9cc3fa6da5b5d'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:02.481249 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1364/2713] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:24:02 2022] POST /identity/v3/projects => generated 365 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:24:02.485180 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80bc207-bb3a-43dc-b21e-9766aec193f7 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:02.487343 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-d80bc207-bb3a-43dc-b21e-9766aec193f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:02.501491 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-e85a808b-9077-411e-9331-fe984d03ec7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76dafcc3884242eb8ab9cc3fa6da5b5d'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:02.518711 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1350/2714] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:24:02 2022] DELETE /identity/v3/users/76dafcc3884242eb8ab9cc3fa6da5b5d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:24:02.523584 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba7925-877c-4006-a367-5e7309e04177 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:02.523958 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba7925-877c-4006-a367-5e7309e04177 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:02.524333 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba7925-877c-4006-a367-5e7309e04177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:02.543732 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-35ba7925-877c-4006-a367-5e7309e04177 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:24:02.545018 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-35ba7925-877c-4006-a367-5e7309e04177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:02.566564 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80bc207-bb3a-43dc-b21e-9766aec193f7 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:02.585700 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:02.621766 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1351/2715] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:24:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:24:02.631769 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ba7925-877c-4006-a367-5e7309e04177 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:02.633221 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-35ba7925-877c-4006-a367-5e7309e04177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:02.636548 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b359365-245a-4da9-a0e5-d0369543a5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:02.637267 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b359365-245a-4da9-a0e5-d0369543a5cf admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:02.637555 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b359365-245a-4da9-a0e5-d0369543a5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:02.637831 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b359365-245a-4da9-a0e5-d0369543a5cf admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:02.638532 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b359365-245a-4da9-a0e5-d0369543a5cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:02.640453 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b359365-245a-4da9-a0e5-d0369543a5cf admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:02.667786 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1365/2716] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:24:02 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:24:02.672649 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b359365-245a-4da9-a0e5-d0369543a5cf admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:02.683894 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b359365-245a-4da9-a0e5-d0369543a5cf admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:02.688584 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3dc36e-b314-4076-b5cb-757a47f20c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:02.689272 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3dc36e-b314-4076-b5cb-757a47f20c3a admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:02.689559 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3dc36e-b314-4076-b5cb-757a47f20c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:02.689833 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3dc36e-b314-4076-b5cb-757a47f20c3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:02.690574 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3dc36e-b314-4076-b5cb-757a47f20c3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:02.692172 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3dc36e-b314-4076-b5cb-757a47f20c3a admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:02.695572 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ba7925-877c-4006-a367-5e7309e04177 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:02.699302 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b888db-35e4-4424-84b5-eb4dc0016064 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:02.699968 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b888db-35e4-4424-84b5-eb4dc0016064 service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:02.700244 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b888db-35e4-4424-84b5-eb4dc0016064 service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:02.700515 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b888db-35e4-4424-84b5-eb4dc0016064 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:02.702797 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1366/2717] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:24:02.706810 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3dc36e-b314-4076-b5cb-757a47f20c3a admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:02.712168 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b888db-35e4-4424-84b5-eb4dc0016064 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:02.713632 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b888db-35e4-4424-84b5-eb4dc0016064 service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:02.716168 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3dc36e-b314-4076-b5cb-757a47f20c3a admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:02.721715 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244db1ec-0496-4f4f-9054-1838c378defb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:02.722571 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244db1ec-0496-4f4f-9054-1838c378defb admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:02.722850 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244db1ec-0496-4f4f-9054-1838c378defb admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:02.723137 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244db1ec-0496-4f4f-9054-1838c378defb admin admin] PATH_INFO: `/v3/projects/4eb836a6b90e4632ab71c82ea4b488b1/users/8009064263824dc698a4a2837567d636/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:02.724998 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1352/2718] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:24:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:24:02.739329 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244db1ec-0496-4f4f-9054-1838c378defb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eb836a6b90e4632ab71c82ea4b488b1, user_id=8009064263824dc698a4a2837567d636, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:02.742592 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244db1ec-0496-4f4f-9054-1838c378defb admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:02.757476 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1367/2719] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:24:02 2022] PUT /identity/v3/projects/4eb836a6b90e4632ab71c82ea4b488b1/users/8009064263824dc698a4a2837567d636/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:24:02.761217 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b888db-35e4-4424-84b5-eb4dc0016064 service neutron] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:02.772387 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b888db-35e4-4424-84b5-eb4dc0016064 service neutron] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:02.815590 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:02.835856 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668935a0-86fe-4f28-9f3a-de4bf2422241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:02.836659 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668935a0-86fe-4f28-9f3a-de4bf2422241 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:02.836973 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668935a0-86fe-4f28-9f3a-de4bf2422241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:02.837247 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668935a0-86fe-4f28-9f3a-de4bf2422241 admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:02.837974 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668935a0-86fe-4f28-9f3a-de4bf2422241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:02.839573 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668935a0-86fe-4f28-9f3a-de4bf2422241 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:02.852627 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1353/2720] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:24:02.853810 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244db1ec-0496-4f4f-9054-1838c378defb admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:02.864367 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244db1ec-0496-4f4f-9054-1838c378defb admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:02.870378 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54703ef-b693-473b-b2c1-7dc3e1b2f640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:02.871276 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54703ef-b693-473b-b2c1-7dc3e1b2f640 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:02.871554 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54703ef-b693-473b-b2c1-7dc3e1b2f640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:02.871826 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54703ef-b693-473b-b2c1-7dc3e1b2f640 admin admin] PATH_INFO: `/v3/projects/4eb836a6b90e4632ab71c82ea4b488b1/users/8009064263824dc698a4a2837567d636/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:02.874350 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54703ef-b693-473b-b2c1-7dc3e1b2f640 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eb836a6b90e4632ab71c82ea4b488b1, user_id=8009064263824dc698a4a2837567d636, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:02.877326 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54703ef-b693-473b-b2c1-7dc3e1b2f640 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:02.888905 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1368/2721] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:24:02 2022] PUT /identity/v3/projects/4eb836a6b90e4632ab71c82ea4b488b1/users/8009064263824dc698a4a2837567d636/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:24:02.899764 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5622db-81e5-4fd3-9cc6-ff33baec7b40 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:02.900049 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5622db-81e5-4fd3-9cc6-ff33baec7b40 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:02.900349 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5622db-81e5-4fd3-9cc6-ff33baec7b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:02.928274 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-eb5622db-81e5-4fd3-9cc6-ff33baec7b40 None None] MFA Rules not processed for user `8009064263824dc698a4a2837567d636`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:24:02.929676 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-eb5622db-81e5-4fd3-9cc6-ff33baec7b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:03.002846 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1354/2722] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:24:02 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:24:03.003729 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54703ef-b693-473b-b2c1-7dc3e1b2f640 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:03.006305 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-e54703ef-b693-473b-b2c1-7dc3e1b2f640 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:03.015649 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5622db-81e5-4fd3-9cc6-ff33baec7b40 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:03.017048 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-eb5622db-81e5-4fd3-9cc6-ff33baec7b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:03.076611 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54703ef-b693-473b-b2c1-7dc3e1b2f640 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:03.077239 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5622db-81e5-4fd3-9cc6-ff33baec7b40 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:03.080769 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1da2f2-d800-4039-9adb-3fa2f94a63f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:03.081426 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1da2f2-d800-4039-9adb-3fa2f94a63f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:03.081588 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5934d446-36ef-44c1-97cf-69d181e46be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:03.081718 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1da2f2-d800-4039-9adb-3fa2f94a63f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:03.081977 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1da2f2-d800-4039-9adb-3fa2f94a63f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:03.082442 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934d446-36ef-44c1-97cf-69d181e46be0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:03.082734 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934d446-36ef-44c1-97cf-69d181e46be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:03.083006 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934d446-36ef-44c1-97cf-69d181e46be0 admin admin] PATH_INFO: `/v3/projects/65a0f87beb3a460ca877cadf492b76f6` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:03.084272 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5934d446-36ef-44c1-97cf-69d181e46be0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65a0f87beb3a460ca877cadf492b76f6)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:03.086278 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5934d446-36ef-44c1-97cf-69d181e46be0 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:03.092247 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1da2f2-d800-4039-9adb-3fa2f94a63f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:03.093723 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1da2f2-d800-4039-9adb-3fa2f94a63f7 service cinder] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:03.104639 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1355/2723] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:24:03 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:24:03.137309 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-5934d446-36ef-44c1-97cf-69d181e46be0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65a0f87beb3a460ca877cadf492b76f6', 'request_id': 'req-5934d446-36ef-44c1-97cf-69d181e46be0'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:03.143501 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-5934d446-36ef-44c1-97cf-69d181e46be0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65a0f87beb3a460ca877cadf492b76f6', 'request_id': 'req-5934d446-36ef-44c1-97cf-69d181e46be0'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:03.148052 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:03.151914 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-5934d446-36ef-44c1-97cf-69d181e46be0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65a0f87beb3a460ca877cadf492b76f6', 'request_id': 'req-5934d446-36ef-44c1-97cf-69d181e46be0'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:03.168669 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-5934d446-36ef-44c1-97cf-69d181e46be0 admin admin] The token cache is being invalidate because project 65a0f87beb3a460ca877cadf492b76f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:24:03.168989 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-5934d446-36ef-44c1-97cf-69d181e46be0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:03.169665 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-5934d446-36ef-44c1-97cf-69d181e46be0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:03.171224 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1369/2724] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:24:03 2022] DELETE /identity/v3/projects/65a0f87beb3a460ca877cadf492b76f6 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:24:03.175385 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1da2f2-d800-4039-9adb-3fa2f94a63f7 service cinder] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:03.186476 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1da2f2-d800-4039-9adb-3fa2f94a63f7 service cinder] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:03.198750 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5934d446-36ef-44c1-97cf-69d181e46be0 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:03.200237 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-5934d446-36ef-44c1-97cf-69d181e46be0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:03.244554 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611394f-ee60-4796-90de-54a1f4ac82a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:03.245455 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611394f-ee60-4796-90de-54a1f4ac82a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:03.245737 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611394f-ee60-4796-90de-54a1f4ac82a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:03.246015 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611394f-ee60-4796-90de-54a1f4ac82a4 admin admin] PATH_INFO: `/v3/users/01ae6a2ec7584e77975d23eb7d2b74a9` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:03.247216 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611394f-ee60-4796-90de-54a1f4ac82a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01ae6a2ec7584e77975d23eb7d2b74a9)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:03.249185 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611394f-ee60-4796-90de-54a1f4ac82a4 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:03.254589 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:03.260512 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5934d446-36ef-44c1-97cf-69d181e46be0 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:03.264190 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4750e7ad-ef62-4653-858b-eca214c6f3ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:03.264868 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4750e7ad-ef62-4653-858b-eca214c6f3ff service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:03.265149 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4750e7ad-ef62-4653-858b-eca214c6f3ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:03.265449 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4750e7ad-ef62-4653-858b-eca214c6f3ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:03.267252 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-4750e7ad-ef62-4653-858b-eca214c6f3ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:03.298417 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-6611394f-ee60-4796-90de-54a1f4ac82a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01ae6a2ec7584e77975d23eb7d2b74a9'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:03.306567 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-6611394f-ee60-4796-90de-54a1f4ac82a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01ae6a2ec7584e77975d23eb7d2b74a9'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:03.307384 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-6611394f-ee60-4796-90de-54a1f4ac82a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01ae6a2ec7584e77975d23eb7d2b74a9'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:03.308334 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-6611394f-ee60-4796-90de-54a1f4ac82a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01ae6a2ec7584e77975d23eb7d2b74a9'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:03.321338 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-6611394f-ee60-4796-90de-54a1f4ac82a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01ae6a2ec7584e77975d23eb7d2b74a9'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:03.328865 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4750e7ad-ef62-4653-858b-eca214c6f3ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:03.330304 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4750e7ad-ef62-4653-858b-eca214c6f3ff service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:03.334301 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1356/2725] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:24:03 2022] DELETE /identity/v3/users/01ae6a2ec7584e77975d23eb7d2b74a9 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:24:03.339634 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1370/2726] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:24:03 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:24:03.637332 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611394f-ee60-4796-90de-54a1f4ac82a4 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:03.638838 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-6611394f-ee60-4796-90de-54a1f4ac82a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:03.738167 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611394f-ee60-4796-90de-54a1f4ac82a4 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:03.744443 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d36b2-dd20-441a-8db1-7c8f974b796a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:03.745341 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d36b2-dd20-441a-8db1-7c8f974b796a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:03.745628 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d36b2-dd20-441a-8db1-7c8f974b796a admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:03.745903 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d36b2-dd20-441a-8db1-7c8f974b796a admin admin] PATH_INFO: `/v3/projects/133bdde54df24e0c96c0b1fecace9cdd` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:03.747141 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d36b2-dd20-441a-8db1-7c8f974b796a admin admin] RBAC: Authorizing `identity:delete_project(project_id=133bdde54df24e0c96c0b1fecace9cdd)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:03.749085 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d36b2-dd20-441a-8db1-7c8f974b796a admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:03.804681 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-922d36b2-dd20-441a-8db1-7c8f974b796a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '133bdde54df24e0c96c0b1fecace9cdd', 'request_id': 'req-922d36b2-dd20-441a-8db1-7c8f974b796a'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:03.812272 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-922d36b2-dd20-441a-8db1-7c8f974b796a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '133bdde54df24e0c96c0b1fecace9cdd', 'request_id': 'req-922d36b2-dd20-441a-8db1-7c8f974b796a'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:03.818214 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-922d36b2-dd20-441a-8db1-7c8f974b796a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '133bdde54df24e0c96c0b1fecace9cdd', 'request_id': 'req-922d36b2-dd20-441a-8db1-7c8f974b796a'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:03.829266 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-922d36b2-dd20-441a-8db1-7c8f974b796a admin admin] The token cache is being invalidate because project 133bdde54df24e0c96c0b1fecace9cdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:24:03.829557 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-922d36b2-dd20-441a-8db1-7c8f974b796a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:03.830213 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-922d36b2-dd20-441a-8db1-7c8f974b796a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:03.831915 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1357/2727] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:24:03 2022] DELETE /identity/v3/projects/133bdde54df24e0c96c0b1fecace9cdd => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:24:03.837573 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1444cfb-6b14-40ac-8572-4d70633178ba None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:03.837860 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1444cfb-6b14-40ac-8572-4d70633178ba None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:03.838137 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1444cfb-6b14-40ac-8572-4d70633178ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:03.855545 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-e1444cfb-6b14-40ac-8572-4d70633178ba None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:24:03.856772 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-e1444cfb-6b14-40ac-8572-4d70633178ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:03.915479 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1371/2728] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:24:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:24:03.924324 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf60e15-bd96-4bc9-a19f-ef5847c647c7 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:03.924609 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf60e15-bd96-4bc9-a19f-ef5847c647c7 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:03.924922 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf60e15-bd96-4bc9-a19f-ef5847c647c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:03.944559 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-ddf60e15-bd96-4bc9-a19f-ef5847c647c7 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:24:03.945834 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-ddf60e15-bd96-4bc9-a19f-ef5847c647c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:03.956338 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1358/2729] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:24:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:24:03.961013 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1444cfb-6b14-40ac-8572-4d70633178ba None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:03.970872 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1444cfb-6b14-40ac-8572-4d70633178ba None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:03.975472 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879cf564-9e9d-49ee-8dea-97e681982cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:03.976119 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cf564-9e9d-49ee-8dea-97e681982cef admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:03.976412 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cf564-9e9d-49ee-8dea-97e681982cef admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:03.976668 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cf564-9e9d-49ee-8dea-97e681982cef admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:03.977413 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879cf564-9e9d-49ee-8dea-97e681982cef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:24:03.977720 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879cf564-9e9d-49ee-8dea-97e681982cef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:03.979296 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879cf564-9e9d-49ee-8dea-97e681982cef admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:03.991459 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1372/2730] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:24:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:24:03.995791 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf60e15-bd96-4bc9-a19f-ef5847c647c7 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:04.005241 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf60e15-bd96-4bc9-a19f-ef5847c647c7 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:04.010644 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae5e43-0e82-4c32-be8d-708a3c949314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:04.011289 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae5e43-0e82-4c32-be8d-708a3c949314 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:04.011570 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae5e43-0e82-4c32-be8d-708a3c949314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:04.011846 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae5e43-0e82-4c32-be8d-708a3c949314 admin admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:04.012546 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ae5e43-0e82-4c32-be8d-708a3c949314 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:04.014481 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ae5e43-0e82-4c32-be8d-708a3c949314 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:04.018548 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:04.042352 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1359/2731] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:24:03 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:24:04.046560 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879cf564-9e9d-49ee-8dea-97e681982cef admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:04.057200 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879cf564-9e9d-49ee-8dea-97e681982cef admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:04.087470 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:04.114209 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1104e736-32f8-41c0-99a7-7d9df96fdcc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:04.115329 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104e736-32f8-41c0-99a7-7d9df96fdcc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:04.115624 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104e736-32f8-41c0-99a7-7d9df96fdcc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:04.115895 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104e736-32f8-41c0-99a7-7d9df96fdcc5 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:04.116592 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1104e736-32f8-41c0-99a7-7d9df96fdcc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:04.118534 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1104e736-32f8-41c0-99a7-7d9df96fdcc5 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:04.138638 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1373/2732] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:24:04 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:24:04.142686 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae5e43-0e82-4c32-be8d-708a3c949314 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:04.153662 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae5e43-0e82-4c32-be8d-708a3c949314 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:04.158172 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3014ae9-5c8c-4561-9574-91efc51929a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:04.158819 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3014ae9-5c8c-4561-9574-91efc51929a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:04.159099 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3014ae9-5c8c-4561-9574-91efc51929a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:04.159370 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3014ae9-5c8c-4561-9574-91efc51929a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:04.160089 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3014ae9-5c8c-4561-9574-91efc51929a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:04.162367 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3014ae9-5c8c-4561-9574-91efc51929a0 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:04.172032 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1360/2733] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:24:04.175773 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1104e736-32f8-41c0-99a7-7d9df96fdcc5 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:04.186528 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1104e736-32f8-41c0-99a7-7d9df96fdcc5 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:04.191093 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac45ab2-d89f-40fa-8227-dedf9493d615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:04.191740 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac45ab2-d89f-40fa-8227-dedf9493d615 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:04.192031 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac45ab2-d89f-40fa-8227-dedf9493d615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:04.192296 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac45ab2-d89f-40fa-8227-dedf9493d615 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:04.193254 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac45ab2-d89f-40fa-8227-dedf9493d615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:04.194826 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac45ab2-d89f-40fa-8227-dedf9493d615 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:04.204504 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1374/2734] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:24:04.209213 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3014ae9-5c8c-4561-9574-91efc51929a0 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:04.218959 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3014ae9-5c8c-4561-9574-91efc51929a0 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:04.223437 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db7687-05bc-4bc0-ac9a-d12d2a9ef108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:04.224995 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db7687-05bc-4bc0-ac9a-d12d2a9ef108 admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:04.225312 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db7687-05bc-4bc0-ac9a-d12d2a9ef108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:04.225590 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db7687-05bc-4bc0-ac9a-d12d2a9ef108 admin admin] PATH_INFO: `/v3/projects/ada75988032f4440ba8ffdf13657328e/users/5314cd3736594e3da92f392a5a1a4e15/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:04.240247 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db7687-05bc-4bc0-ac9a-d12d2a9ef108 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ada75988032f4440ba8ffdf13657328e, user_id=5314cd3736594e3da92f392a5a1a4e15, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:04.242913 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db7687-05bc-4bc0-ac9a-d12d2a9ef108 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:04.255908 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1361/2735] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:24:04 2022] PUT /identity/v3/projects/ada75988032f4440ba8ffdf13657328e/users/5314cd3736594e3da92f392a5a1a4e15/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:24:04.266204 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727cdd6-9d56-49b7-b1ed-4d8755ebb335 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:04.266497 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727cdd6-9d56-49b7-b1ed-4d8755ebb335 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:04.266778 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727cdd6-9d56-49b7-b1ed-4d8755ebb335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:04.294184 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-0727cdd6-9d56-49b7-b1ed-4d8755ebb335 None None] MFA Rules not processed for user `5314cd3736594e3da92f392a5a1a4e15`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:24:04.296013 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-0727cdd6-9d56-49b7-b1ed-4d8755ebb335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:04.367299 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1375/2736] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:24:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:24:04.372940 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db7687-05bc-4bc0-ac9a-d12d2a9ef108 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:04.436755 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db7687-05bc-4bc0-ac9a-d12d2a9ef108 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:04.441359 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3778c74-22b1-4b23-89f8-79e0611af9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:04.442034 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3778c74-22b1-4b23-89f8-79e0611af9e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:04.442316 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3778c74-22b1-4b23-89f8-79e0611af9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:04.442591 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3778c74-22b1-4b23-89f8-79e0611af9e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:04.443820 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3778c74-22b1-4b23-89f8-79e0611af9e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:04.445738 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3778c74-22b1-4b23-89f8-79e0611af9e4 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:04.471073 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1362/2737] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:24:04 2022] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:24:04.475249 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0727cdd6-9d56-49b7-b1ed-4d8755ebb335 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:04.486074 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0727cdd6-9d56-49b7-b1ed-4d8755ebb335 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:04.540774 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf1d362-92d5-4d9d-9085-ca9c1970c5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:04.541443 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1d362-92d5-4d9d-9085-ca9c1970c5bf admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:04.541724 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1d362-92d5-4d9d-9085-ca9c1970c5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:04.541998 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1d362-92d5-4d9d-9085-ca9c1970c5bf admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:04.542692 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf1d362-92d5-4d9d-9085-ca9c1970c5bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:04.544607 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf1d362-92d5-4d9d-9085-ca9c1970c5bf admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:04.563431 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1376/2738] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:24:04 2022] POST /identity/v3/users => generated 294 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:24:04.567535 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3778c74-22b1-4b23-89f8-79e0611af9e4 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:04.578550 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3778c74-22b1-4b23-89f8-79e0611af9e4 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:04.584792 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce011e-a263-4792-9ec4-abe07a078871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:04.585460 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce011e-a263-4792-9ec4-abe07a078871 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:04.585743 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce011e-a263-4792-9ec4-abe07a078871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:04.586017 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce011e-a263-4792-9ec4-abe07a078871 admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:04.586744 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ce011e-a263-4792-9ec4-abe07a078871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:04.588329 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ce011e-a263-4792-9ec4-abe07a078871 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:04.599921 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1363/2739] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:24:04.603933 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf1d362-92d5-4d9d-9085-ca9c1970c5bf admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:04.614362 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf1d362-92d5-4d9d-9085-ca9c1970c5bf admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:04.619934 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd0543-ad52-494a-9a1b-ed4aeff8fec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:04.620521 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd0543-ad52-494a-9a1b-ed4aeff8fec4 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:04.620838 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd0543-ad52-494a-9a1b-ed4aeff8fec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:04.621110 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd0543-ad52-494a-9a1b-ed4aeff8fec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:04.621854 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cd0543-ad52-494a-9a1b-ed4aeff8fec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:04.623455 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cd0543-ad52-494a-9a1b-ed4aeff8fec4 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:04.634268 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1377/2740] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:24:04.638336 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce011e-a263-4792-9ec4-abe07a078871 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:04.648469 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce011e-a263-4792-9ec4-abe07a078871 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:04.653155 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eba1d7d-02da-434a-b94f-fded78104e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:04.654039 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba1d7d-02da-434a-b94f-fded78104e2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:04.654621 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba1d7d-02da-434a-b94f-fded78104e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:04.654621 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba1d7d-02da-434a-b94f-fded78104e2a admin admin] PATH_INFO: `/v3/projects/c41fe7eecd8548a5b9a2991259059709/users/bd08819c0f1e4e2285c9ebde9551b4b8/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:04.671755 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eba1d7d-02da-434a-b94f-fded78104e2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c41fe7eecd8548a5b9a2991259059709, user_id=bd08819c0f1e4e2285c9ebde9551b4b8, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:04.674892 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eba1d7d-02da-434a-b94f-fded78104e2a admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:04.689018 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1364/2741] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:24:04 2022] PUT /identity/v3/projects/c41fe7eecd8548a5b9a2991259059709/users/bd08819c0f1e4e2285c9ebde9551b4b8/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:24:04.701325 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00abc2-1c9b-4d62-95cd-73209db1ca79 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:04.701614 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00abc2-1c9b-4d62-95cd-73209db1ca79 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:04.701889 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00abc2-1c9b-4d62-95cd-73209db1ca79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:04.730961 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-4e00abc2-1c9b-4d62-95cd-73209db1ca79 None None] MFA Rules not processed for user `bd08819c0f1e4e2285c9ebde9551b4b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:24:04.732175 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-4e00abc2-1c9b-4d62-95cd-73209db1ca79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:04.741121 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:04.801453 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1378/2742] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:24:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:24:04.807789 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eba1d7d-02da-434a-b94f-fded78104e2a admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:04.910767 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eba1d7d-02da-434a-b94f-fded78104e2a admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:04.916228 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b536495-cf39-4d7a-b341-2c573f26a4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:04.917020 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b536495-cf39-4d7a-b341-2c573f26a4fe admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:04.917378 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b536495-cf39-4d7a-b341-2c573f26a4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:04.918544 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b536495-cf39-4d7a-b341-2c573f26a4fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:04.918544 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b536495-cf39-4d7a-b341-2c573f26a4fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:04.920735 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b536495-cf39-4d7a-b341-2c573f26a4fe admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:04.926380 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:04.962652 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1365/2743] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:24:04 2022] POST /identity/v3/projects => generated 385 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:24:04.966548 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e00abc2-1c9b-4d62-95cd-73209db1ca79 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:04.978509 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e00abc2-1c9b-4d62-95cd-73209db1ca79 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:05.042119 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f71af-be81-440d-89fd-36a0f7a6f1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:05.042942 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f71af-be81-440d-89fd-36a0f7a6f1de admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:05.043226 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f71af-be81-440d-89fd-36a0f7a6f1de admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:05.043500 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f71af-be81-440d-89fd-36a0f7a6f1de admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:05.044208 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6f71af-be81-440d-89fd-36a0f7a6f1de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:05.046157 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6f71af-be81-440d-89fd-36a0f7a6f1de admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:05.070382 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1379/2744] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:24:04 2022] POST /identity/v3/users => generated 299 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:24:05.071749 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b536495-cf39-4d7a-b341-2c573f26a4fe admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:05.083048 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b536495-cf39-4d7a-b341-2c573f26a4fe admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:05.088301 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb7cb3f-8ff3-4c3b-a00d-6604f10d2417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:05.088669 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7cb3f-8ff3-4c3b-a00d-6604f10d2417 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:05.088981 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7cb3f-8ff3-4c3b-a00d-6604f10d2417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:05.089251 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7cb3f-8ff3-4c3b-a00d-6604f10d2417 admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:05.089974 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb7cb3f-8ff3-4c3b-a00d-6604f10d2417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:05.091612 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb7cb3f-8ff3-4c3b-a00d-6604f10d2417 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:05.104472 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1366/2745] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:24:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:24:05.109007 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f71af-be81-440d-89fd-36a0f7a6f1de admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:05.123321 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f71af-be81-440d-89fd-36a0f7a6f1de admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:05.128609 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47dc81b-887f-4cf2-9b35-020d2e6b0911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:05.129985 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47dc81b-887f-4cf2-9b35-020d2e6b0911 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:05.130311 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47dc81b-887f-4cf2-9b35-020d2e6b0911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:05.130596 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47dc81b-887f-4cf2-9b35-020d2e6b0911 admin admin] PATH_INFO: `/v3/projects/a81cab37c19d40dc8a29ca3c38a15bee/users/9fa302160a6e4c108dd16266a8160ffe/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:05.146189 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47dc81b-887f-4cf2-9b35-020d2e6b0911 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a81cab37c19d40dc8a29ca3c38a15bee, user_id=9fa302160a6e4c108dd16266a8160ffe, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:05.148611 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47dc81b-887f-4cf2-9b35-020d2e6b0911 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:05.162417 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1380/2746] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:24:05 2022] PUT /identity/v3/projects/a81cab37c19d40dc8a29ca3c38a15bee/users/9fa302160a6e4c108dd16266a8160ffe/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:24:05.166393 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb7cb3f-8ff3-4c3b-a00d-6604f10d2417 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:05.176545 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb7cb3f-8ff3-4c3b-a00d-6604f10d2417 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:05.238142 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580cbe9-f2e0-4bfa-bc01-3dd887cabc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:05.238918 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580cbe9-f2e0-4bfa-bc01-3dd887cabc64 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:05.239208 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580cbe9-f2e0-4bfa-bc01-3dd887cabc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:05.239508 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580cbe9-f2e0-4bfa-bc01-3dd887cabc64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:05.240928 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3580cbe9-f2e0-4bfa-bc01-3dd887cabc64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:05.242509 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3580cbe9-f2e0-4bfa-bc01-3dd887cabc64 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:05.253613 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1367/2747] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:24:05 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:24:05.257945 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47dc81b-887f-4cf2-9b35-020d2e6b0911 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:05.269459 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47dc81b-887f-4cf2-9b35-020d2e6b0911 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:05.275423 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d061dc5-053c-4901-9194-96280ea5a1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:05.276377 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d061dc5-053c-4901-9194-96280ea5a1d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:05.276666 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d061dc5-053c-4901-9194-96280ea5a1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:05.276978 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d061dc5-053c-4901-9194-96280ea5a1d4 admin admin] PATH_INFO: `/v3/projects/a81cab37c19d40dc8a29ca3c38a15bee/users/9fa302160a6e4c108dd16266a8160ffe/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:05.279040 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d061dc5-053c-4901-9194-96280ea5a1d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a81cab37c19d40dc8a29ca3c38a15bee, user_id=9fa302160a6e4c108dd16266a8160ffe, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:05.281731 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d061dc5-053c-4901-9194-96280ea5a1d4 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:05.293349 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1381/2748] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:24:05 2022] PUT /identity/v3/projects/a81cab37c19d40dc8a29ca3c38a15bee/users/9fa302160a6e4c108dd16266a8160ffe/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:24:05.303985 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc61d57-259a-416d-8c06-7b0bd150a5ef None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:05.304158 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc61d57-259a-416d-8c06-7b0bd150a5ef None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:05.304458 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc61d57-259a-416d-8c06-7b0bd150a5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:05.336812 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-9bc61d57-259a-416d-8c06-7b0bd150a5ef None None] MFA Rules not processed for user `9fa302160a6e4c108dd16266a8160ffe`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:24:05.338116 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-9bc61d57-259a-416d-8c06-7b0bd150a5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:05.424849 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1368/2749] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:24:05 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:24:05.434895 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d061dc5-053c-4901-9194-96280ea5a1d4 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:05.436688 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-6d061dc5-053c-4901-9194-96280ea5a1d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:05.528968 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:05.540600 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d061dc5-053c-4901-9194-96280ea5a1d4 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:05.547180 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb21c7-e066-4a31-87d5-5f226c05ac72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:05.547741 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb21c7-e066-4a31-87d5-5f226c05ac72 service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:05.548091 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb21c7-e066-4a31-87d5-5f226c05ac72 service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:05.548480 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb21c7-e066-4a31-87d5-5f226c05ac72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:05.560639 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfb21c7-e066-4a31-87d5-5f226c05ac72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:05.563517 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfb21c7-e066-4a31-87d5-5f226c05ac72 service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:05.579205 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1382/2750] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:24:05 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:24:06.188255 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc61d57-259a-416d-8c06-7b0bd150a5ef None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:06.198972 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc61d57-259a-416d-8c06-7b0bd150a5ef None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:06.204151 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d77ee-bc02-4194-b7c6-d48547afd4ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:06.205575 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d77ee-bc02-4194-b7c6-d48547afd4ec service cinder] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:06.205859 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d77ee-bc02-4194-b7c6-d48547afd4ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:06.206136 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d77ee-bc02-4194-b7c6-d48547afd4ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:06.275812 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:06.278461 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d77ee-bc02-4194-b7c6-d48547afd4ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:06.280349 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d77ee-bc02-4194-b7c6-d48547afd4ec service cinder] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:06.296691 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1369/2751] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:24:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:24:08.126479 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb21c7-e066-4a31-87d5-5f226c05ac72 service cinder] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:08.127910 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-edfb21c7-e066-4a31-87d5-5f226c05ac72 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:08.192347 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb21c7-e066-4a31-87d5-5f226c05ac72 service cinder] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:08.197274 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4de3a1e-2eed-4bd3-b569-acf1d0785e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:08.198255 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de3a1e-2eed-4bd3-b569-acf1d0785e52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:08.198539 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de3a1e-2eed-4bd3-b569-acf1d0785e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:08.198816 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de3a1e-2eed-4bd3-b569-acf1d0785e52 admin admin] PATH_INFO: `/v3/users/cbb08e4cdf97497789053bad761a4d8a` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:08.200016 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4de3a1e-2eed-4bd3-b569-acf1d0785e52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbb08e4cdf97497789053bad761a4d8a)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:08.201953 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4de3a1e-2eed-4bd3-b569-acf1d0785e52 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:08.248516 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-a4de3a1e-2eed-4bd3-b569-acf1d0785e52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbb08e4cdf97497789053bad761a4d8a'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:08.255546 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-a4de3a1e-2eed-4bd3-b569-acf1d0785e52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbb08e4cdf97497789053bad761a4d8a'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:08.262498 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-a4de3a1e-2eed-4bd3-b569-acf1d0785e52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbb08e4cdf97497789053bad761a4d8a'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:08.274711 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-a4de3a1e-2eed-4bd3-b569-acf1d0785e52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbb08e4cdf97497789053bad761a4d8a'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:08.275410 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-a4de3a1e-2eed-4bd3-b569-acf1d0785e52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbb08e4cdf97497789053bad761a4d8a'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:08.281744 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1383/2752] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:24:08 2022] DELETE /identity/v3/users/cbb08e4cdf97497789053bad761a4d8a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:24:08.286947 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ab9c5-638b-4362-a1f2-a89f0576c368 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:08.287570 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ab9c5-638b-4362-a1f2-a89f0576c368 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:08.287690 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ab9c5-638b-4362-a1f2-a89f0576c368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:08.305080 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-e08ab9c5-638b-4362-a1f2-a89f0576c368 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:24:08.306279 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-e08ab9c5-638b-4362-a1f2-a89f0576c368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:08.364188 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1370/2753] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:24:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:24:08.376537 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4de3a1e-2eed-4bd3-b569-acf1d0785e52 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:08.378010 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-a4de3a1e-2eed-4bd3-b569-acf1d0785e52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:08.435169 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4de3a1e-2eed-4bd3-b569-acf1d0785e52 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:08.438766 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a78ff1-f5ef-45f3-8b82-ef5c0671ad90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:08.439402 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a78ff1-f5ef-45f3-8b82-ef5c0671ad90 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:08.439682 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a78ff1-f5ef-45f3-8b82-ef5c0671ad90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:08.439956 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a78ff1-f5ef-45f3-8b82-ef5c0671ad90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:08.451226 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a78ff1-f5ef-45f3-8b82-ef5c0671ad90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:08.452662 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a78ff1-f5ef-45f3-8b82-ef5c0671ad90 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:08.463071 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1384/2754] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:24:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:24:08.940412 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08ab9c5-638b-4362-a1f2-a89f0576c368 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:08.942087 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-e08ab9c5-638b-4362-a1f2-a89f0576c368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:08.975962 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08ab9c5-638b-4362-a1f2-a89f0576c368 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:08.982088 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a70ec5-4359-4c7d-8d52-fae311b86dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:08.983023 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a70ec5-4359-4c7d-8d52-fae311b86dc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:08.983435 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a70ec5-4359-4c7d-8d52-fae311b86dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:08.983772 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a70ec5-4359-4c7d-8d52-fae311b86dc1 admin admin] PATH_INFO: `/v3/projects/d6e89a456caa4492a54a899771035778` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:08.985551 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a70ec5-4359-4c7d-8d52-fae311b86dc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6e89a456caa4492a54a899771035778)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:08.987638 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a70ec5-4359-4c7d-8d52-fae311b86dc1 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:09.045100 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-43a70ec5-4359-4c7d-8d52-fae311b86dc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6e89a456caa4492a54a899771035778', 'request_id': 'req-43a70ec5-4359-4c7d-8d52-fae311b86dc1'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:09.074667 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-43a70ec5-4359-4c7d-8d52-fae311b86dc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6e89a456caa4492a54a899771035778', 'request_id': 'req-43a70ec5-4359-4c7d-8d52-fae311b86dc1'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:09.084751 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-43a70ec5-4359-4c7d-8d52-fae311b86dc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6e89a456caa4492a54a899771035778', 'request_id': 'req-43a70ec5-4359-4c7d-8d52-fae311b86dc1'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:09.097189 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-43a70ec5-4359-4c7d-8d52-fae311b86dc1 admin admin] The token cache is being invalidate because project d6e89a456caa4492a54a899771035778 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:24:09.097469 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-43a70ec5-4359-4c7d-8d52-fae311b86dc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:09.098125 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-43a70ec5-4359-4c7d-8d52-fae311b86dc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:09.099785 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1371/2755] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:24:08 2022] DELETE /identity/v3/projects/d6e89a456caa4492a54a899771035778 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:24:09.103758 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a78ff1-f5ef-45f3-8b82-ef5c0671ad90 service neutron] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:09.123193 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a78ff1-f5ef-45f3-8b82-ef5c0671ad90 service neutron] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:09.130784 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:09.196103 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01179ab5-2d5f-4326-9ab1-4fc3b80e539b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:09.197163 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01179ab5-2d5f-4326-9ab1-4fc3b80e539b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:09.197449 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01179ab5-2d5f-4326-9ab1-4fc3b80e539b admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:09.197753 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01179ab5-2d5f-4326-9ab1-4fc3b80e539b admin admin] PATH_INFO: `/v3/users/8009064263824dc698a4a2837567d636` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:09.199339 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01179ab5-2d5f-4326-9ab1-4fc3b80e539b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8009064263824dc698a4a2837567d636)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:09.200877 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01179ab5-2d5f-4326-9ab1-4fc3b80e539b admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:09.249267 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-01179ab5-2d5f-4326-9ab1-4fc3b80e539b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8009064263824dc698a4a2837567d636'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:09.257575 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-01179ab5-2d5f-4326-9ab1-4fc3b80e539b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8009064263824dc698a4a2837567d636'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:09.264482 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-01179ab5-2d5f-4326-9ab1-4fc3b80e539b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8009064263824dc698a4a2837567d636'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:09.276114 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-01179ab5-2d5f-4326-9ab1-4fc3b80e539b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8009064263824dc698a4a2837567d636'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:09.276765 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-01179ab5-2d5f-4326-9ab1-4fc3b80e539b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8009064263824dc698a4a2837567d636'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:09.282842 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1385/2756] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:24:09 2022] DELETE /identity/v3/users/8009064263824dc698a4a2837567d636 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:24:09.556363 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a70ec5-4359-4c7d-8d52-fae311b86dc1 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:09.557886 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-43a70ec5-4359-4c7d-8d52-fae311b86dc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:09.571259 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a70ec5-4359-4c7d-8d52-fae311b86dc1 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:09.631807 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b017d5fe-08e8-4afc-85b1-403b4a132da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:09.632673 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017d5fe-08e8-4afc-85b1-403b4a132da7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:09.632990 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017d5fe-08e8-4afc-85b1-403b4a132da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:09.633269 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017d5fe-08e8-4afc-85b1-403b4a132da7 admin admin] PATH_INFO: `/v3/projects/4eb836a6b90e4632ab71c82ea4b488b1` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:09.634465 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b017d5fe-08e8-4afc-85b1-403b4a132da7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4eb836a6b90e4632ab71c82ea4b488b1)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:09.636379 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b017d5fe-08e8-4afc-85b1-403b4a132da7 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:09.659830 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:09.686663 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-b017d5fe-08e8-4afc-85b1-403b4a132da7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4eb836a6b90e4632ab71c82ea4b488b1', 'request_id': 'req-b017d5fe-08e8-4afc-85b1-403b4a132da7'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:09.694123 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-b017d5fe-08e8-4afc-85b1-403b4a132da7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4eb836a6b90e4632ab71c82ea4b488b1', 'request_id': 'req-b017d5fe-08e8-4afc-85b1-403b4a132da7'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:09.699696 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-b017d5fe-08e8-4afc-85b1-403b4a132da7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4eb836a6b90e4632ab71c82ea4b488b1', 'request_id': 'req-b017d5fe-08e8-4afc-85b1-403b4a132da7'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:09.710800 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-b017d5fe-08e8-4afc-85b1-403b4a132da7 admin admin] The token cache is being invalidate because project 4eb836a6b90e4632ab71c82ea4b488b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:24:09.711080 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-b017d5fe-08e8-4afc-85b1-403b4a132da7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:09.711701 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-b017d5fe-08e8-4afc-85b1-403b4a132da7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:09.713252 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1372/2757] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:24:09 2022] DELETE /identity/v3/projects/4eb836a6b90e4632ab71c82ea4b488b1 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:24:09.718146 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba768923-4d93-4eee-a890-a69ae0c5f509 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:09.718460 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba768923-4d93-4eee-a890-a69ae0c5f509 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:09.718745 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba768923-4d93-4eee-a890-a69ae0c5f509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:09.736888 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-ba768923-4d93-4eee-a890-a69ae0c5f509 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:24:09.738107 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-ba768923-4d93-4eee-a890-a69ae0c5f509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:09.798856 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1386/2758] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:24:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:24:09.807528 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc7282b-1765-426f-8d11-1f9b7b5a2da5 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:09.807943 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc7282b-1765-426f-8d11-1f9b7b5a2da5 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:09.808227 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc7282b-1765-426f-8d11-1f9b7b5a2da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:09.826925 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-ebc7282b-1765-426f-8d11-1f9b7b5a2da5 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:24:09.828138 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-ebc7282b-1765-426f-8d11-1f9b7b5a2da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:09.836739 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1373/2759] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:24:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:24:09.841073 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba768923-4d93-4eee-a890-a69ae0c5f509 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:09.852733 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba768923-4d93-4eee-a890-a69ae0c5f509 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:09.863122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3729bad-6d9b-456c-9260-5d45b84c748d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:09.863795 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3729bad-6d9b-456c-9260-5d45b84c748d admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:09.864079 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3729bad-6d9b-456c-9260-5d45b84c748d admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:09.864472 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3729bad-6d9b-456c-9260-5d45b84c748d admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:09.865979 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3729bad-6d9b-456c-9260-5d45b84c748d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:24:09.866302 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3729bad-6d9b-456c-9260-5d45b84c748d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:09.867994 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3729bad-6d9b-456c-9260-5d45b84c748d admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:09.884839 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1387/2760] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:24:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:24:09.886103 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc7282b-1765-426f-8d11-1f9b7b5a2da5 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:09.895474 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc7282b-1765-426f-8d11-1f9b7b5a2da5 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:09.902437 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a2b30d-5703-475c-b62f-5bbc1318c4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:09.903106 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2b30d-5703-475c-b62f-5bbc1318c4ce admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:09.903392 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2b30d-5703-475c-b62f-5bbc1318c4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:09.903670 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2b30d-5703-475c-b62f-5bbc1318c4ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:09.904376 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a2b30d-5703-475c-b62f-5bbc1318c4ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:09.906342 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a2b30d-5703-475c-b62f-5bbc1318c4ce admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:09.936046 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1374/2761] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:24:09 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:24:09.940081 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3729bad-6d9b-456c-9260-5d45b84c748d admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:09.950774 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3729bad-6d9b-456c-9260-5d45b84c748d admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:09.960752 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:10.010991 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d48a012-b24c-4716-82e2-9f78aa70db88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:10.011659 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48a012-b24c-4716-82e2-9f78aa70db88 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:10.011944 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48a012-b24c-4716-82e2-9f78aa70db88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:10.012226 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48a012-b24c-4716-82e2-9f78aa70db88 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:10.012952 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d48a012-b24c-4716-82e2-9f78aa70db88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:10.014867 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d48a012-b24c-4716-82e2-9f78aa70db88 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:10.039285 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1388/2762] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:24:09 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:24:10.040566 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a2b30d-5703-475c-b62f-5bbc1318c4ce admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:10.051207 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a2b30d-5703-475c-b62f-5bbc1318c4ce admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:10.056423 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59529e2e-5a93-45d3-836d-805b6073e592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:10.057120 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59529e2e-5a93-45d3-836d-805b6073e592 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:10.057409 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59529e2e-5a93-45d3-836d-805b6073e592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:10.057692 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59529e2e-5a93-45d3-836d-805b6073e592 admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:10.058441 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59529e2e-5a93-45d3-836d-805b6073e592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:10.060034 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59529e2e-5a93-45d3-836d-805b6073e592 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:10.070966 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1375/2763] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:24:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:24:10.075525 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d48a012-b24c-4716-82e2-9f78aa70db88 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:10.086626 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d48a012-b24c-4716-82e2-9f78aa70db88 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:10.091461 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2bf94-ef34-4ddb-b6e9-6d3d9d8c8940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:10.092152 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2bf94-ef34-4ddb-b6e9-6d3d9d8c8940 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:10.092438 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2bf94-ef34-4ddb-b6e9-6d3d9d8c8940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:10.092745 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2bf94-ef34-4ddb-b6e9-6d3d9d8c8940 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:10.093482 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e2bf94-ef34-4ddb-b6e9-6d3d9d8c8940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:10.095068 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e2bf94-ef34-4ddb-b6e9-6d3d9d8c8940 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:10.106049 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1389/2764] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:24:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:24:10.110085 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59529e2e-5a93-45d3-836d-805b6073e592 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:10.119964 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59529e2e-5a93-45d3-836d-805b6073e592 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:10.124557 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff14f7-1937-4b07-b8c3-862b5d585f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:10.125451 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff14f7-1937-4b07-b8c3-862b5d585f3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:10.125726 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff14f7-1937-4b07-b8c3-862b5d585f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:10.125994 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff14f7-1937-4b07-b8c3-862b5d585f3e admin admin] PATH_INFO: `/v3/projects/fc4ec1d6481d48938213d1383a8e2917/users/822de490edec42f0b64549ae90355bd8/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:10.140204 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff14f7-1937-4b07-b8c3-862b5d585f3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc4ec1d6481d48938213d1383a8e2917, user_id=822de490edec42f0b64549ae90355bd8, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:10.142919 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff14f7-1937-4b07-b8c3-862b5d585f3e admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:10.156952 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1376/2765] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:24:10 2022] PUT /identity/v3/projects/fc4ec1d6481d48938213d1383a8e2917/users/822de490edec42f0b64549ae90355bd8/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:24:10.168448 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9f655-1531-41a8-8098-05174a53b6c1 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:10.169182 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9f655-1531-41a8-8098-05174a53b6c1 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:10.169182 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9f655-1531-41a8-8098-05174a53b6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:10.197149 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-4cd9f655-1531-41a8-8098-05174a53b6c1 None None] MFA Rules not processed for user `822de490edec42f0b64549ae90355bd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:24:10.198344 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-4cd9f655-1531-41a8-8098-05174a53b6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:10.265379 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1390/2766] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:24:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:24:10.277737 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff14f7-1937-4b07-b8c3-862b5d585f3e admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:10.279561 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-e7ff14f7-1937-4b07-b8c3-862b5d585f3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:10.338136 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff14f7-1937-4b07-b8c3-862b5d585f3e admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:10.343903 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0360045-0668-4400-b6f2-d206314c283f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:10.343903 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0360045-0668-4400-b6f2-d206314c283f service cinder] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:10.343903 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0360045-0668-4400-b6f2-d206314c283f service cinder] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:10.343903 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0360045-0668-4400-b6f2-d206314c283f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:10.351364 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9f655-1531-41a8-8098-05174a53b6c1 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:10.352762 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-4cd9f655-1531-41a8-8098-05174a53b6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:10.352985 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0360045-0668-4400-b6f2-d206314c283f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:10.354426 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0360045-0668-4400-b6f2-d206314c283f service cinder] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:10.363705 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1377/2767] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:24:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:24:10.365937 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9f655-1531-41a8-8098-05174a53b6c1 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:10.371111 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c6701-a4b7-4e96-b835-2c05aeea0b77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:10.372058 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c6701-a4b7-4e96-b835-2c05aeea0b77 service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:10.372425 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c6701-a4b7-4e96-b835-2c05aeea0b77 service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:10.372762 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c6701-a4b7-4e96-b835-2c05aeea0b77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:10.374892 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-f11c6701-a4b7-4e96-b835-2c05aeea0b77 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:10.383426 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0360045-0668-4400-b6f2-d206314c283f service cinder] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:10.445019 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c6701-a4b7-4e96-b835-2c05aeea0b77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:10.446678 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c6701-a4b7-4e96-b835-2c05aeea0b77 service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:10.448681 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:10.456799 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1391/2768] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:24:10 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:24:10.462025 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0360045-0668-4400-b6f2-d206314c283f service cinder] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:10.468425 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473298e-ebe9-4aa4-83d3-1b4dd9ce14ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:10.469513 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473298e-ebe9-4aa4-83d3-1b4dd9ce14ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:10.470134 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473298e-ebe9-4aa4-83d3-1b4dd9ce14ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:10.470483 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473298e-ebe9-4aa4-83d3-1b4dd9ce14ec admin admin] PATH_INFO: `/v3/users/822de490edec42f0b64549ae90355bd8` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:10.471713 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a473298e-ebe9-4aa4-83d3-1b4dd9ce14ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=822de490edec42f0b64549ae90355bd8)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:10.474689 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a473298e-ebe9-4aa4-83d3-1b4dd9ce14ec admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:10.522443 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-a473298e-ebe9-4aa4-83d3-1b4dd9ce14ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '822de490edec42f0b64549ae90355bd8'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:10.530878 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-a473298e-ebe9-4aa4-83d3-1b4dd9ce14ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '822de490edec42f0b64549ae90355bd8'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:10.531721 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-a473298e-ebe9-4aa4-83d3-1b4dd9ce14ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '822de490edec42f0b64549ae90355bd8'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:10.532348 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-a473298e-ebe9-4aa4-83d3-1b4dd9ce14ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '822de490edec42f0b64549ae90355bd8'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:10.546538 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-a473298e-ebe9-4aa4-83d3-1b4dd9ce14ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '822de490edec42f0b64549ae90355bd8'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:10.560183 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1378/2769] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:24:10 2022] DELETE /identity/v3/users/822de490edec42f0b64549ae90355bd8 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:24:10.565044 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a7145-aa91-4682-90a4-e4be4d5d6e79 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:10.565401 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a7145-aa91-4682-90a4-e4be4d5d6e79 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:10.565734 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a7145-aa91-4682-90a4-e4be4d5d6e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:10.585109 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-237a7145-aa91-4682-90a4-e4be4d5d6e79 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:24:10.586439 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-237a7145-aa91-4682-90a4-e4be4d5d6e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:10.605302 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:10.672270 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1392/2770] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:24:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:24:10.683004 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473298e-ebe9-4aa4-83d3-1b4dd9ce14ec admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:10.684510 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-a473298e-ebe9-4aa4-83d3-1b4dd9ce14ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:10.759988 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473298e-ebe9-4aa4-83d3-1b4dd9ce14ec admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:10.763828 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f7991c-23ef-41c4-ad6c-a0a012973414 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:10.765135 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7991c-23ef-41c4-ad6c-a0a012973414 service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:10.765423 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7991c-23ef-41c4-ad6c-a0a012973414 service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:10.765722 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7991c-23ef-41c4-ad6c-a0a012973414 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:10.778293 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f7991c-23ef-41c4-ad6c-a0a012973414 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:10.779739 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f7991c-23ef-41c4-ad6c-a0a012973414 service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:10.804797 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1379/2771] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:24:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:24:11.121824 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a7145-aa91-4682-90a4-e4be4d5d6e79 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:11.125204 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-237a7145-aa91-4682-90a4-e4be4d5d6e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:11.142586 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a7145-aa91-4682-90a4-e4be4d5d6e79 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:11.149342 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf28437-2843-4162-8666-2aaca30f2be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:11.151929 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf28437-2843-4162-8666-2aaca30f2be8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:11.152355 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf28437-2843-4162-8666-2aaca30f2be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:11.152355 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf28437-2843-4162-8666-2aaca30f2be8 admin admin] PATH_INFO: `/v3/projects/fc4ec1d6481d48938213d1383a8e2917` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:11.153988 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf28437-2843-4162-8666-2aaca30f2be8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc4ec1d6481d48938213d1383a8e2917)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:11.163498 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf28437-2843-4162-8666-2aaca30f2be8 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:11.226141 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-9bf28437-2843-4162-8666-2aaca30f2be8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc4ec1d6481d48938213d1383a8e2917', 'request_id': 'req-9bf28437-2843-4162-8666-2aaca30f2be8'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:11.232541 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-9bf28437-2843-4162-8666-2aaca30f2be8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc4ec1d6481d48938213d1383a8e2917', 'request_id': 'req-9bf28437-2843-4162-8666-2aaca30f2be8'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:11.241495 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-9bf28437-2843-4162-8666-2aaca30f2be8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc4ec1d6481d48938213d1383a8e2917', 'request_id': 'req-9bf28437-2843-4162-8666-2aaca30f2be8'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:11.252848 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-9bf28437-2843-4162-8666-2aaca30f2be8 admin admin] The token cache is being invalidate because project fc4ec1d6481d48938213d1383a8e2917 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:24:11.253132 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-9bf28437-2843-4162-8666-2aaca30f2be8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:11.253769 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-9bf28437-2843-4162-8666-2aaca30f2be8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:11.255572 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1393/2772] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:24:11 2022] DELETE /identity/v3/projects/fc4ec1d6481d48938213d1383a8e2917 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:24:11.261226 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2efaf19-6613-44ce-b444-bff4ec2fd998 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:11.261595 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2efaf19-6613-44ce-b444-bff4ec2fd998 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:11.261935 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2efaf19-6613-44ce-b444-bff4ec2fd998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:11.280142 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-e2efaf19-6613-44ce-b444-bff4ec2fd998 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:24:11.281526 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-e2efaf19-6613-44ce-b444-bff4ec2fd998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:11.348033 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1380/2773] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:24:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:24:11.356607 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91db014-c48d-4b84-aa73-21121d2c3ab3 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:11.356933 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91db014-c48d-4b84-aa73-21121d2c3ab3 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:11.357217 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91db014-c48d-4b84-aa73-21121d2c3ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:11.378322 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-f91db014-c48d-4b84-aa73-21121d2c3ab3 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:24:11.379829 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-f91db014-c48d-4b84-aa73-21121d2c3ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:11.388114 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1394/2774] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:24:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:24:11.392611 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2efaf19-6613-44ce-b444-bff4ec2fd998 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:11.403180 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2efaf19-6613-44ce-b444-bff4ec2fd998 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:11.408364 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497a649-10d0-4609-92bb-9f0f7dc3c9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:11.409057 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497a649-10d0-4609-92bb-9f0f7dc3c9e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:11.409341 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497a649-10d0-4609-92bb-9f0f7dc3c9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:11.409619 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497a649-10d0-4609-92bb-9f0f7dc3c9e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:11.410354 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8497a649-10d0-4609-92bb-9f0f7dc3c9e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:24:11.410663 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8497a649-10d0-4609-92bb-9f0f7dc3c9e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:11.413160 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8497a649-10d0-4609-92bb-9f0f7dc3c9e5 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:11.419989 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:11.427466 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1381/2775] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:24:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:24:11.431322 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91db014-c48d-4b84-aa73-21121d2c3ab3 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:11.441091 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91db014-c48d-4b84-aa73-21121d2c3ab3 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:11.446519 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d966a22b-a037-4561-b601-04cc7787c6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:11.447254 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966a22b-a037-4561-b601-04cc7787c6e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:11.447469 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966a22b-a037-4561-b601-04cc7787c6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:11.447744 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966a22b-a037-4561-b601-04cc7787c6e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:11.448449 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d966a22b-a037-4561-b601-04cc7787c6e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:11.450453 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d966a22b-a037-4561-b601-04cc7787c6e6 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:11.478726 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1395/2776] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:24:11 2022] POST /identity/v3/projects => generated 359 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:24:11.482383 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497a649-10d0-4609-92bb-9f0f7dc3c9e5 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:11.493961 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497a649-10d0-4609-92bb-9f0f7dc3c9e5 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:11.551857 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de72b15f-cb74-4cf5-bd76-f984051040fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:11.552550 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de72b15f-cb74-4cf5-bd76-f984051040fd admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:11.552878 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de72b15f-cb74-4cf5-bd76-f984051040fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:11.553183 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de72b15f-cb74-4cf5-bd76-f984051040fd admin admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:11.553871 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de72b15f-cb74-4cf5-bd76-f984051040fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:11.555782 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de72b15f-cb74-4cf5-bd76-f984051040fd admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:11.575237 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1382/2777] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:24:11 2022] POST /identity/v3/users => generated 280 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:24:11.579514 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d966a22b-a037-4561-b601-04cc7787c6e6 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:11.590258 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d966a22b-a037-4561-b601-04cc7787c6e6 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:11.594772 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42352edf-2462-4627-a136-20ac3bf6fc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:11.595417 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42352edf-2462-4627-a136-20ac3bf6fc97 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:11.595698 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42352edf-2462-4627-a136-20ac3bf6fc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:11.595972 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42352edf-2462-4627-a136-20ac3bf6fc97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:11.596693 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42352edf-2462-4627-a136-20ac3bf6fc97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:11.598357 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42352edf-2462-4627-a136-20ac3bf6fc97 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:11.609422 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1396/2778] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:24:11.613288 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de72b15f-cb74-4cf5-bd76-f984051040fd admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:11.623623 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de72b15f-cb74-4cf5-bd76-f984051040fd admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:11.628291 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d18c75-e591-47d8-9cdd-ac51cb8ca89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:11.628976 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d18c75-e591-47d8-9cdd-ac51cb8ca89c admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:11.629264 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d18c75-e591-47d8-9cdd-ac51cb8ca89c admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:11.629544 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d18c75-e591-47d8-9cdd-ac51cb8ca89c admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:11.630358 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d18c75-e591-47d8-9cdd-ac51cb8ca89c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:11.631948 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d18c75-e591-47d8-9cdd-ac51cb8ca89c admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:11.641931 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1383/2779] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:24:11.646738 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42352edf-2462-4627-a136-20ac3bf6fc97 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:11.656359 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42352edf-2462-4627-a136-20ac3bf6fc97 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:11.661009 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2dc9f9-8f98-47fb-a815-b8e60b1f1fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:11.662580 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2dc9f9-8f98-47fb-a815-b8e60b1f1fa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:11.662857 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2dc9f9-8f98-47fb-a815-b8e60b1f1fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:11.663128 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2dc9f9-8f98-47fb-a815-b8e60b1f1fa4 admin admin] PATH_INFO: `/v3/projects/6439ae383e4a458b93c19f8e33f5fe91/users/8c55aa0389204070bd00ad448a36ab55/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:11.677345 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2dc9f9-8f98-47fb-a815-b8e60b1f1fa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6439ae383e4a458b93c19f8e33f5fe91, user_id=8c55aa0389204070bd00ad448a36ab55, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:11.680179 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2dc9f9-8f98-47fb-a815-b8e60b1f1fa4 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:11.692915 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1397/2780] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:24:11 2022] PUT /identity/v3/projects/6439ae383e4a458b93c19f8e33f5fe91/users/8c55aa0389204070bd00ad448a36ab55/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:24:11.703878 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55591377-d057-4669-9362-08390145a7eb None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:11.704199 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55591377-d057-4669-9362-08390145a7eb None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:11.704487 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55591377-d057-4669-9362-08390145a7eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:11.731858 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-55591377-d057-4669-9362-08390145a7eb None None] MFA Rules not processed for user `8c55aa0389204070bd00ad448a36ab55`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:24:11.733136 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-55591377-d057-4669-9362-08390145a7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:11.796079 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1384/2781] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:24:11 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:24:11.826342 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2dc9f9-8f98-47fb-a815-b8e60b1f1fa4 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:11.828015 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-9d2dc9f9-8f98-47fb-a815-b8e60b1f1fa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:11.870911 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:11.887455 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2dc9f9-8f98-47fb-a815-b8e60b1f1fa4 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:11.891118 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53120a93-6165-4819-b84f-aa76684bdab6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:11.891757 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53120a93-6165-4819-b84f-aa76684bdab6 service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:11.892039 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53120a93-6165-4819-b84f-aa76684bdab6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:11.892314 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53120a93-6165-4819-b84f-aa76684bdab6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:11.901565 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53120a93-6165-4819-b84f-aa76684bdab6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:11.902985 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53120a93-6165-4819-b84f-aa76684bdab6 service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:11.912980 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1398/2782] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:24:11 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:24:11.926572 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55591377-d057-4669-9362-08390145a7eb None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:11.991399 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55591377-d057-4669-9362-08390145a7eb None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:11.996016 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f05ab-6edd-4cd2-a4ce-c0d50400411c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:11.996915 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f05ab-6edd-4cd2-a4ce-c0d50400411c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:11.997200 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f05ab-6edd-4cd2-a4ce-c0d50400411c admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:11.997476 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f05ab-6edd-4cd2-a4ce-c0d50400411c admin admin] PATH_INFO: `/v3/users/8c55aa0389204070bd00ad448a36ab55` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:11.998669 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901f05ab-6edd-4cd2-a4ce-c0d50400411c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c55aa0389204070bd00ad448a36ab55)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:12.000567 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901f05ab-6edd-4cd2-a4ce-c0d50400411c admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:12.006494 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:12.048132 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-901f05ab-6edd-4cd2-a4ce-c0d50400411c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c55aa0389204070bd00ad448a36ab55'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:12.056156 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-901f05ab-6edd-4cd2-a4ce-c0d50400411c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c55aa0389204070bd00ad448a36ab55'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:12.056803 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-901f05ab-6edd-4cd2-a4ce-c0d50400411c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c55aa0389204070bd00ad448a36ab55'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:12.057402 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-901f05ab-6edd-4cd2-a4ce-c0d50400411c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c55aa0389204070bd00ad448a36ab55'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:12.069517 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-901f05ab-6edd-4cd2-a4ce-c0d50400411c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c55aa0389204070bd00ad448a36ab55'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:12.081593 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1385/2783] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:24:11 2022] DELETE /identity/v3/users/8c55aa0389204070bd00ad448a36ab55 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:24:12.086016 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7477da-da01-4f0d-991a-b98b3df335b6 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:12.086303 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7477da-da01-4f0d-991a-b98b3df335b6 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:12.086576 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7477da-da01-4f0d-991a-b98b3df335b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:12.103858 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-0e7477da-da01-4f0d-991a-b98b3df335b6 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:24:12.105352 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-0e7477da-da01-4f0d-991a-b98b3df335b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:12.162713 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1399/2784] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:24:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:24:12.172156 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f05ab-6edd-4cd2-a4ce-c0d50400411c admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:12.173581 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-901f05ab-6edd-4cd2-a4ce-c0d50400411c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:12.234744 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f05ab-6edd-4cd2-a4ce-c0d50400411c admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:12.238778 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a508152-7ee9-46cb-b597-9e6b3d84195f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:12.240666 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a508152-7ee9-46cb-b597-9e6b3d84195f service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:12.240666 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a508152-7ee9-46cb-b597-9e6b3d84195f service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:12.240666 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a508152-7ee9-46cb-b597-9e6b3d84195f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:12.251604 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a508152-7ee9-46cb-b597-9e6b3d84195f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:12.253078 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a508152-7ee9-46cb-b597-9e6b3d84195f service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:12.265690 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1386/2785] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:24:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:24:12.588003 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7477da-da01-4f0d-991a-b98b3df335b6 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:12.594684 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-0e7477da-da01-4f0d-991a-b98b3df335b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:12.625519 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7477da-da01-4f0d-991a-b98b3df335b6 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:12.644952 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa9cf1-5e65-4018-820f-9cad8a240e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:12.647243 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa9cf1-5e65-4018-820f-9cad8a240e29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:12.647755 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa9cf1-5e65-4018-820f-9cad8a240e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:12.649076 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa9cf1-5e65-4018-820f-9cad8a240e29 admin admin] PATH_INFO: `/v3/projects/6439ae383e4a458b93c19f8e33f5fe91` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:12.654050 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfa9cf1-5e65-4018-820f-9cad8a240e29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6439ae383e4a458b93c19f8e33f5fe91)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:12.655982 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfa9cf1-5e65-4018-820f-9cad8a240e29 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:12.740554 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-8bfa9cf1-5e65-4018-820f-9cad8a240e29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6439ae383e4a458b93c19f8e33f5fe91', 'request_id': 'req-8bfa9cf1-5e65-4018-820f-9cad8a240e29'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:12.752946 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-8bfa9cf1-5e65-4018-820f-9cad8a240e29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6439ae383e4a458b93c19f8e33f5fe91', 'request_id': 'req-8bfa9cf1-5e65-4018-820f-9cad8a240e29'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:12.773755 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-8bfa9cf1-5e65-4018-820f-9cad8a240e29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6439ae383e4a458b93c19f8e33f5fe91', 'request_id': 'req-8bfa9cf1-5e65-4018-820f-9cad8a240e29'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:12.776828 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a508152-7ee9-46cb-b597-9e6b3d84195f service neutron] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:12.778836 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-7a508152-7ee9-46cb-b597-9e6b3d84195f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:12.795577 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-8bfa9cf1-5e65-4018-820f-9cad8a240e29 admin admin] The token cache is being invalidate because project 6439ae383e4a458b93c19f8e33f5fe91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:24:12.796372 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-8bfa9cf1-5e65-4018-820f-9cad8a240e29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:12.798051 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a508152-7ee9-46cb-b597-9e6b3d84195f service neutron] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:12.799186 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-8bfa9cf1-5e65-4018-820f-9cad8a240e29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:12.801035 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1400/2786] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:24:12 2022] DELETE /identity/v3/projects/6439ae383e4a458b93c19f8e33f5fe91 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:24:12.806956 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf8362-a2b6-42ad-bf36-71acdd257edb None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:12.807431 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf8362-a2b6-42ad-bf36-71acdd257edb None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:12.807781 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf8362-a2b6-42ad-bf36-71acdd257edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:12.831958 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-5fdf8362-a2b6-42ad-bf36-71acdd257edb None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:24:12.834834 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-5fdf8362-a2b6-42ad-bf36-71acdd257edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:12.875200 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a74122-eee6-43ff-b6f8-b6944d49162b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:12.876575 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a74122-eee6-43ff-b6f8-b6944d49162b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:12.888548 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a74122-eee6-43ff-b6f8-b6944d49162b admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:12.889117 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a74122-eee6-43ff-b6f8-b6944d49162b admin admin] PATH_INFO: `/v3/users/5314cd3736594e3da92f392a5a1a4e15` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:12.891039 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a74122-eee6-43ff-b6f8-b6944d49162b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5314cd3736594e3da92f392a5a1a4e15)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:12.894145 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a74122-eee6-43ff-b6f8-b6944d49162b admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:12.919826 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1401/2787] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:24:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:24:12.939668 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:12.958039 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-00a74122-eee6-43ff-b6f8-b6944d49162b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5314cd3736594e3da92f392a5a1a4e15'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:12.968182 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-00a74122-eee6-43ff-b6f8-b6944d49162b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5314cd3736594e3da92f392a5a1a4e15'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:12.969043 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-00a74122-eee6-43ff-b6f8-b6944d49162b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5314cd3736594e3da92f392a5a1a4e15'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:12.970302 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-00a74122-eee6-43ff-b6f8-b6944d49162b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5314cd3736594e3da92f392a5a1a4e15'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:12.985649 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-00a74122-eee6-43ff-b6f8-b6944d49162b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5314cd3736594e3da92f392a5a1a4e15'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:12.994014 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a7a3a-7e12-4f4e-be32-1a9cfaa69790 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:12.994352 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a7a3a-7e12-4f4e-be32-1a9cfaa69790 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:12.994578 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a7a3a-7e12-4f4e-be32-1a9cfaa69790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:13.000742 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1387/2788] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:24:12 2022] DELETE /identity/v3/users/5314cd3736594e3da92f392a5a1a4e15 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:24:13.005828 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b20a8e-fd7d-4879-a84b-4ba16af7a2fd None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:13.006310 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b20a8e-fd7d-4879-a84b-4ba16af7a2fd None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:13.006783 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b20a8e-fd7d-4879-a84b-4ba16af7a2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:13.008827 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:13.015819 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-8f5a7a3a-7e12-4f4e-be32-1a9cfaa69790 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:24:13.017343 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-8f5a7a3a-7e12-4f4e-be32-1a9cfaa69790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:13.038527 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-61b20a8e-fd7d-4879-a84b-4ba16af7a2fd None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:24:13.039872 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-61b20a8e-fd7d-4879-a84b-4ba16af7a2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:13.113307 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1388/2789] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:24:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:24:13.119646 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1402/2790] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:24:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:24:13.129630 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b20a8e-fd7d-4879-a84b-4ba16af7a2fd None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:13.131222 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a7a3a-7e12-4f4e-be32-1a9cfaa69790 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:13.133260 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-8f5a7a3a-7e12-4f4e-be32-1a9cfaa69790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:13.145212 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b20a8e-fd7d-4879-a84b-4ba16af7a2fd None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:13.150549 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2b4cce-aebf-4b13-a6d1-0f71f32a714b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:13.151229 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b4cce-aebf-4b13-a6d1-0f71f32a714b admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:13.151511 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b4cce-aebf-4b13-a6d1-0f71f32a714b admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:13.151784 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b4cce-aebf-4b13-a6d1-0f71f32a714b admin admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:13.152514 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2b4cce-aebf-4b13-a6d1-0f71f32a714b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:24:13.152855 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2b4cce-aebf-4b13-a6d1-0f71f32a714b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:13.154454 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2b4cce-aebf-4b13-a6d1-0f71f32a714b admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:13.169137 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1389/2791] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:24:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:24:13.174063 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2b4cce-aebf-4b13-a6d1-0f71f32a714b admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:13.188061 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2b4cce-aebf-4b13-a6d1-0f71f32a714b admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:13.192889 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a95b17c-70bd-4f0e-a2cd-cf5ed9ad1a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:13.193569 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95b17c-70bd-4f0e-a2cd-cf5ed9ad1a7d admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:13.193857 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95b17c-70bd-4f0e-a2cd-cf5ed9ad1a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:13.194134 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95b17c-70bd-4f0e-a2cd-cf5ed9ad1a7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:13.194819 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a95b17c-70bd-4f0e-a2cd-cf5ed9ad1a7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:13.196720 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a95b17c-70bd-4f0e-a2cd-cf5ed9ad1a7d admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:13.204988 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a7a3a-7e12-4f4e-be32-1a9cfaa69790 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:13.211512 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da926b3c-8eb8-4b0d-95d5-67cde95628b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:13.212818 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da926b3c-8eb8-4b0d-95d5-67cde95628b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:13.213227 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da926b3c-8eb8-4b0d-95d5-67cde95628b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:13.213675 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da926b3c-8eb8-4b0d-95d5-67cde95628b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:13.224802 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da926b3c-8eb8-4b0d-95d5-67cde95628b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:13.224953 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1390/2792] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:24:13 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:24:13.226653 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da926b3c-8eb8-4b0d-95d5-67cde95628b3 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:13.229090 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a95b17c-70bd-4f0e-a2cd-cf5ed9ad1a7d admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:13.236782 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1403/2793] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:24:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:24:13.298114 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a95b17c-70bd-4f0e-a2cd-cf5ed9ad1a7d admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:13.303878 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632757ab-82c1-4849-b82f-9e576c7f2ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:13.304551 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632757ab-82c1-4849-b82f-9e576c7f2ef0 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:13.304871 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632757ab-82c1-4849-b82f-9e576c7f2ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:13.305154 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632757ab-82c1-4849-b82f-9e576c7f2ef0 admin admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:13.305894 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632757ab-82c1-4849-b82f-9e576c7f2ef0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:13.308080 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632757ab-82c1-4849-b82f-9e576c7f2ef0 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:13.328691 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1391/2794] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:24:13 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:24:13.332818 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da926b3c-8eb8-4b0d-95d5-67cde95628b3 service neutron] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:13.343765 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da926b3c-8eb8-4b0d-95d5-67cde95628b3 service neutron] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:13.348661 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f132db5c-f113-40d3-beb5-17ab78b60b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:13.351876 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132db5c-f113-40d3-beb5-17ab78b60b24 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:13.351876 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132db5c-f113-40d3-beb5-17ab78b60b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:13.351876 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132db5c-f113-40d3-beb5-17ab78b60b24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:13.351876 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f132db5c-f113-40d3-beb5-17ab78b60b24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:13.352898 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f132db5c-f113-40d3-beb5-17ab78b60b24 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:13.368806 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1404/2795] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:24:13.372743 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632757ab-82c1-4849-b82f-9e576c7f2ef0 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:13.379667 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:13.388611 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632757ab-82c1-4849-b82f-9e576c7f2ef0 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:13.397629 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7523f-81e6-4750-a034-0fc73c8d2277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:13.398744 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7523f-81e6-4750-a034-0fc73c8d2277 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:13.400187 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7523f-81e6-4750-a034-0fc73c8d2277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:13.400187 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7523f-81e6-4750-a034-0fc73c8d2277 admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:13.400691 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce7523f-81e6-4750-a034-0fc73c8d2277 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:13.402025 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce7523f-81e6-4750-a034-0fc73c8d2277 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:13.413981 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1392/2796] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:24:13.417959 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f132db5c-f113-40d3-beb5-17ab78b60b24 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:13.428247 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f132db5c-f113-40d3-beb5-17ab78b60b24 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:13.433036 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7b32e-d634-414f-b8b4-784056347c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:13.433929 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7b32e-d634-414f-b8b4-784056347c99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:13.434213 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7b32e-d634-414f-b8b4-784056347c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:13.434488 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7b32e-d634-414f-b8b4-784056347c99 admin admin] PATH_INFO: `/v3/projects/56629a43a12e42ad922d623cca4ae959/users/6f6ce9e010f54eafbd7c8fe515d5c288/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:13.451145 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d7b32e-d634-414f-b8b4-784056347c99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56629a43a12e42ad922d623cca4ae959, user_id=6f6ce9e010f54eafbd7c8fe515d5c288, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:13.453940 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d7b32e-d634-414f-b8b4-784056347c99 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:13.470898 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1405/2797] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:24:13 2022] PUT /identity/v3/projects/56629a43a12e42ad922d623cca4ae959/users/6f6ce9e010f54eafbd7c8fe515d5c288/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:24:13.481741 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b68c13-2e7e-479d-991e-bf428545965f None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:13.482201 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b68c13-2e7e-479d-991e-bf428545965f None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:13.482494 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b68c13-2e7e-479d-991e-bf428545965f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:13.512057 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-46b68c13-2e7e-479d-991e-bf428545965f None None] MFA Rules not processed for user `6f6ce9e010f54eafbd7c8fe515d5c288`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:24:13.513319 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-46b68c13-2e7e-479d-991e-bf428545965f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:13.583453 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1393/2798] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:24:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:24:13.597618 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7b32e-d634-414f-b8b4-784056347c99 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:13.603341 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-e9d7b32e-d634-414f-b8b4-784056347c99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:13.620899 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b68c13-2e7e-479d-991e-bf428545965f None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:13.622490 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-46b68c13-2e7e-479d-991e-bf428545965f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:13.669309 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7b32e-d634-414f-b8b4-784056347c99 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:13.673002 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc5df47-4dbb-472d-a162-59570940ee4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:13.673652 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5df47-4dbb-472d-a162-59570940ee4e service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:13.673935 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5df47-4dbb-472d-a162-59570940ee4e service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:13.674207 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5df47-4dbb-472d-a162-59570940ee4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:13.683705 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc5df47-4dbb-472d-a162-59570940ee4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:13.685229 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc5df47-4dbb-472d-a162-59570940ee4e service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:13.695106 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1406/2799] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:24:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:24:13.706094 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b68c13-2e7e-479d-991e-bf428545965f None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:13.711042 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b303d1-3189-4991-9a82-b038f8e7fc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:13.711937 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b303d1-3189-4991-9a82-b038f8e7fc63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:13.712219 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b303d1-3189-4991-9a82-b038f8e7fc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:13.712492 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b303d1-3189-4991-9a82-b038f8e7fc63 admin admin] PATH_INFO: `/v3/projects/ada75988032f4440ba8ffdf13657328e` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:13.713714 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b303d1-3189-4991-9a82-b038f8e7fc63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ada75988032f4440ba8ffdf13657328e)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:13.715640 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b303d1-3189-4991-9a82-b038f8e7fc63 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:13.764818 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-a7b303d1-3189-4991-9a82-b038f8e7fc63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ada75988032f4440ba8ffdf13657328e', 'request_id': 'req-a7b303d1-3189-4991-9a82-b038f8e7fc63'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:13.773037 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-a7b303d1-3189-4991-9a82-b038f8e7fc63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ada75988032f4440ba8ffdf13657328e', 'request_id': 'req-a7b303d1-3189-4991-9a82-b038f8e7fc63'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:13.778979 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-a7b303d1-3189-4991-9a82-b038f8e7fc63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ada75988032f4440ba8ffdf13657328e', 'request_id': 'req-a7b303d1-3189-4991-9a82-b038f8e7fc63'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:13.790668 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-a7b303d1-3189-4991-9a82-b038f8e7fc63 admin admin] The token cache is being invalidate because project ada75988032f4440ba8ffdf13657328e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:24:13.790962 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-a7b303d1-3189-4991-9a82-b038f8e7fc63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:13.791624 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-a7b303d1-3189-4991-9a82-b038f8e7fc63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:13.793837 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1394/2800] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:24:13 2022] DELETE /identity/v3/projects/ada75988032f4440ba8ffdf13657328e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:24:13.797862 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc5df47-4dbb-472d-a162-59570940ee4e service cinder] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:13.809498 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc5df47-4dbb-472d-a162-59570940ee4e service cinder] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:13.824163 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:13.876382 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c517f442-ae47-414c-85e4-712e5dab5259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:13.877334 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c517f442-ae47-414c-85e4-712e5dab5259 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:13.877619 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c517f442-ae47-414c-85e4-712e5dab5259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:13.877897 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c517f442-ae47-414c-85e4-712e5dab5259 admin admin] PATH_INFO: `/v3/users/bd08819c0f1e4e2285c9ebde9551b4b8` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:13.879204 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c517f442-ae47-414c-85e4-712e5dab5259 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd08819c0f1e4e2285c9ebde9551b4b8)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:13.881883 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c517f442-ae47-414c-85e4-712e5dab5259 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:13.940249 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-c517f442-ae47-414c-85e4-712e5dab5259 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd08819c0f1e4e2285c9ebde9551b4b8'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:13.955284 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-c517f442-ae47-414c-85e4-712e5dab5259 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd08819c0f1e4e2285c9ebde9551b4b8'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:13.970390 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-c517f442-ae47-414c-85e4-712e5dab5259 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd08819c0f1e4e2285c9ebde9551b4b8'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:13.988930 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-c517f442-ae47-414c-85e4-712e5dab5259 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd08819c0f1e4e2285c9ebde9551b4b8'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:13.990945 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-c517f442-ae47-414c-85e4-712e5dab5259 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd08819c0f1e4e2285c9ebde9551b4b8'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:14.000444 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1407/2801] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:24:13 2022] DELETE /identity/v3/users/bd08819c0f1e4e2285c9ebde9551b4b8 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:24:14.290761 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b303d1-3189-4991-9a82-b038f8e7fc63 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:14.292208 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-a7b303d1-3189-4991-9a82-b038f8e7fc63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:14.305766 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b303d1-3189-4991-9a82-b038f8e7fc63 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:14.313702 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:14.368687 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa2ea27-08ae-4e16-93ac-1d06ccd6673d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:14.369808 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2ea27-08ae-4e16-93ac-1d06ccd6673d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:14.370194 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2ea27-08ae-4e16-93ac-1d06ccd6673d admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:14.370590 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2ea27-08ae-4e16-93ac-1d06ccd6673d admin admin] PATH_INFO: `/v3/projects/c41fe7eecd8548a5b9a2991259059709` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:14.372165 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa2ea27-08ae-4e16-93ac-1d06ccd6673d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c41fe7eecd8548a5b9a2991259059709)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:14.374632 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa2ea27-08ae-4e16-93ac-1d06ccd6673d admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:14.423029 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-8fa2ea27-08ae-4e16-93ac-1d06ccd6673d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c41fe7eecd8548a5b9a2991259059709', 'request_id': 'req-8fa2ea27-08ae-4e16-93ac-1d06ccd6673d'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:14.431289 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-8fa2ea27-08ae-4e16-93ac-1d06ccd6673d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c41fe7eecd8548a5b9a2991259059709', 'request_id': 'req-8fa2ea27-08ae-4e16-93ac-1d06ccd6673d'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:14.437037 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-8fa2ea27-08ae-4e16-93ac-1d06ccd6673d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c41fe7eecd8548a5b9a2991259059709', 'request_id': 'req-8fa2ea27-08ae-4e16-93ac-1d06ccd6673d'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:14.448720 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-8fa2ea27-08ae-4e16-93ac-1d06ccd6673d admin admin] The token cache is being invalidate because project c41fe7eecd8548a5b9a2991259059709 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:24:14.449032 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-8fa2ea27-08ae-4e16-93ac-1d06ccd6673d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:14.449687 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-8fa2ea27-08ae-4e16-93ac-1d06ccd6673d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:14.451241 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1395/2802] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:24:14 2022] DELETE /identity/v3/projects/c41fe7eecd8548a5b9a2991259059709 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:24:14.455258 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c517f442-ae47-414c-85e4-712e5dab5259 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:14.456777 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-c517f442-ae47-414c-85e4-712e5dab5259 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:14.469701 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c517f442-ae47-414c-85e4-712e5dab5259 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:14.525938 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c3507d-dcb3-4ad0-9aa1-f14d273f595d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:14.526812 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3507d-dcb3-4ad0-9aa1-f14d273f595d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:14.527098 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3507d-dcb3-4ad0-9aa1-f14d273f595d admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:14.527378 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3507d-dcb3-4ad0-9aa1-f14d273f595d admin admin] PATH_INFO: `/v3/users/9fa302160a6e4c108dd16266a8160ffe` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:14.528564 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c3507d-dcb3-4ad0-9aa1-f14d273f595d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fa302160a6e4c108dd16266a8160ffe)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:14.530511 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c3507d-dcb3-4ad0-9aa1-f14d273f595d admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:14.571230 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:14.578560 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-d0c3507d-dcb3-4ad0-9aa1-f14d273f595d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fa302160a6e4c108dd16266a8160ffe'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:14.586169 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-d0c3507d-dcb3-4ad0-9aa1-f14d273f595d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fa302160a6e4c108dd16266a8160ffe'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:14.593103 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-d0c3507d-dcb3-4ad0-9aa1-f14d273f595d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fa302160a6e4c108dd16266a8160ffe'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:14.606040 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-d0c3507d-dcb3-4ad0-9aa1-f14d273f595d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fa302160a6e4c108dd16266a8160ffe'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:14.606687 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-d0c3507d-dcb3-4ad0-9aa1-f14d273f595d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fa302160a6e4c108dd16266a8160ffe'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:14.612681 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1408/2803] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:24:14 2022] DELETE /identity/v3/users/9fa302160a6e4c108dd16266a8160ffe => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:24:14.904906 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa2ea27-08ae-4e16-93ac-1d06ccd6673d admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:14.906451 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-8fa2ea27-08ae-4e16-93ac-1d06ccd6673d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:14.921939 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa2ea27-08ae-4e16-93ac-1d06ccd6673d admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:14.980167 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd7b62-c2c4-45c6-9ade-07caed18d0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:14.980976 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd7b62-c2c4-45c6-9ade-07caed18d0ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:14.981264 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd7b62-c2c4-45c6-9ade-07caed18d0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:14.981540 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd7b62-c2c4-45c6-9ade-07caed18d0ed admin admin] PATH_INFO: `/v3/projects/a81cab37c19d40dc8a29ca3c38a15bee` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:14.982726 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafd7b62-c2c4-45c6-9ade-07caed18d0ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=a81cab37c19d40dc8a29ca3c38a15bee)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:14.984625 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafd7b62-c2c4-45c6-9ade-07caed18d0ed admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:15.028480 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:15.032513 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-cafd7b62-c2c4-45c6-9ade-07caed18d0ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a81cab37c19d40dc8a29ca3c38a15bee', 'request_id': 'req-cafd7b62-c2c4-45c6-9ade-07caed18d0ed'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:15.041863 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-cafd7b62-c2c4-45c6-9ade-07caed18d0ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a81cab37c19d40dc8a29ca3c38a15bee', 'request_id': 'req-cafd7b62-c2c4-45c6-9ade-07caed18d0ed'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:15.047830 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-cafd7b62-c2c4-45c6-9ade-07caed18d0ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a81cab37c19d40dc8a29ca3c38a15bee', 'request_id': 'req-cafd7b62-c2c4-45c6-9ade-07caed18d0ed'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:15.058772 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-cafd7b62-c2c4-45c6-9ade-07caed18d0ed admin admin] The token cache is being invalidate because project a81cab37c19d40dc8a29ca3c38a15bee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:24:15.059058 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-cafd7b62-c2c4-45c6-9ade-07caed18d0ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:15.059696 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-cafd7b62-c2c4-45c6-9ade-07caed18d0ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:15.061262 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1396/2804] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:24:14 2022] DELETE /identity/v3/projects/a81cab37c19d40dc8a29ca3c38a15bee => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:24:15.068256 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b482d72-efcd-46c9-a192-25a90f7836cb None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:15.068547 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b482d72-efcd-46c9-a192-25a90f7836cb None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:15.068923 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b482d72-efcd-46c9-a192-25a90f7836cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:15.087133 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-3b482d72-efcd-46c9-a192-25a90f7836cb None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:24:15.088350 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-3b482d72-efcd-46c9-a192-25a90f7836cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:15.162524 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1409/2805] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:24:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:24:15.172968 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8439381a-c2ea-4c7d-8887-9b0b9c4727ad None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:15.173263 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8439381a-c2ea-4c7d-8887-9b0b9c4727ad None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:15.173545 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8439381a-c2ea-4c7d-8887-9b0b9c4727ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:15.194603 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-8439381a-c2ea-4c7d-8887-9b0b9c4727ad None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:24:15.195923 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-8439381a-c2ea-4c7d-8887-9b0b9c4727ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:15.206163 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1397/2806] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:24:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:24:15.210691 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b482d72-efcd-46c9-a192-25a90f7836cb None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:15.221922 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b482d72-efcd-46c9-a192-25a90f7836cb None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:15.237563 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de70c692-a848-4026-a413-c45b6b5ba4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:15.238438 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70c692-a848-4026-a413-c45b6b5ba4ee admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:15.240460 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70c692-a848-4026-a413-c45b6b5ba4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:15.241467 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70c692-a848-4026-a413-c45b6b5ba4ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:15.243343 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de70c692-a848-4026-a413-c45b6b5ba4ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:24:15.243666 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de70c692-a848-4026-a413-c45b6b5ba4ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:15.245323 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de70c692-a848-4026-a413-c45b6b5ba4ee admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:15.261894 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1410/2807] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:24:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:24:15.264851 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8439381a-c2ea-4c7d-8887-9b0b9c4727ad None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:15.275585 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8439381a-c2ea-4c7d-8887-9b0b9c4727ad None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:15.280665 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b23c3d-8e84-4b9b-991e-feab93738ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:15.281376 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b23c3d-8e84-4b9b-991e-feab93738ab5 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:15.281661 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b23c3d-8e84-4b9b-991e-feab93738ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:15.281942 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b23c3d-8e84-4b9b-991e-feab93738ab5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:15.282640 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b23c3d-8e84-4b9b-991e-feab93738ab5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:15.284546 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b23c3d-8e84-4b9b-991e-feab93738ab5 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:15.312559 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1398/2808] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:24:15 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:24:15.314119 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de70c692-a848-4026-a413-c45b6b5ba4ee admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:15.324776 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de70c692-a848-4026-a413-c45b6b5ba4ee admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:15.387392 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c0436-dd5e-4b61-9bc2-5e2f93412b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:15.388070 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c0436-dd5e-4b61-9bc2-5e2f93412b3f admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:15.388358 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c0436-dd5e-4b61-9bc2-5e2f93412b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:15.388634 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c0436-dd5e-4b61-9bc2-5e2f93412b3f admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:15.389371 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604c0436-dd5e-4b61-9bc2-5e2f93412b3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:15.391284 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604c0436-dd5e-4b61-9bc2-5e2f93412b3f admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:15.410502 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1411/2809] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:24:15 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:24:15.414848 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b23c3d-8e84-4b9b-991e-feab93738ab5 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:15.425454 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b23c3d-8e84-4b9b-991e-feab93738ab5 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:15.430652 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f78e7-5212-415a-8979-85b6743f9ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:15.431303 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f78e7-5212-415a-8979-85b6743f9ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:15.431585 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f78e7-5212-415a-8979-85b6743f9ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:15.431857 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f78e7-5212-415a-8979-85b6743f9ca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:15.432574 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f78e7-5212-415a-8979-85b6743f9ca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:15.434190 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f78e7-5212-415a-8979-85b6743f9ca9 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:15.448017 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1399/2810] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:24:15.449343 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c0436-dd5e-4b61-9bc2-5e2f93412b3f admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:15.459766 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c0436-dd5e-4b61-9bc2-5e2f93412b3f admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:15.464435 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f0b53-d633-495e-baf7-13612e8a2143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:15.465131 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f0b53-d633-495e-baf7-13612e8a2143 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:15.465415 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f0b53-d633-495e-baf7-13612e8a2143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:15.465719 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f0b53-d633-495e-baf7-13612e8a2143 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:15.466485 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044f0b53-d633-495e-baf7-13612e8a2143 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:15.468116 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044f0b53-d633-495e-baf7-13612e8a2143 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:15.478745 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1412/2811] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:24:15.483137 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f78e7-5212-415a-8979-85b6743f9ca9 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:15.493782 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f78e7-5212-415a-8979-85b6743f9ca9 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:15.498782 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f8f841-ac5d-4604-9933-7da58b90702b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:15.499654 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8f841-ac5d-4604-9933-7da58b90702b admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:15.499934 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8f841-ac5d-4604-9933-7da58b90702b admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:15.500208 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8f841-ac5d-4604-9933-7da58b90702b admin admin] PATH_INFO: `/v3/projects/63cce128f52243e39d6a9a8532f25c17/users/23c9ae593ea34586a24c89c4094b1897/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:15.514738 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f8f841-ac5d-4604-9933-7da58b90702b admin admin] RBAC: Authorizing `identity:create_grant(project_id=63cce128f52243e39d6a9a8532f25c17, user_id=23c9ae593ea34586a24c89c4094b1897, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:15.517411 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f8f841-ac5d-4604-9933-7da58b90702b admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:15.530173 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1400/2812] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:24:15 2022] PUT /identity/v3/projects/63cce128f52243e39d6a9a8532f25c17/users/23c9ae593ea34586a24c89c4094b1897/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:24:15.542487 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45180a0c-4554-4de1-b56c-ea8b172b553b None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:15.542815 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45180a0c-4554-4de1-b56c-ea8b172b553b None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:15.543100 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45180a0c-4554-4de1-b56c-ea8b172b553b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:15.569466 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-45180a0c-4554-4de1-b56c-ea8b172b553b None None] MFA Rules not processed for user `23c9ae593ea34586a24c89c4094b1897`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:24:15.570670 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-45180a0c-4554-4de1-b56c-ea8b172b553b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:15.579634 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:15.635741 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1413/2813] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:24:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:24:15.640243 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f8f841-ac5d-4604-9933-7da58b90702b admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:15.701709 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f8f841-ac5d-4604-9933-7da58b90702b admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:15.706320 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56edba4-d481-4391-b3f8-4c23a6e9eb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:15.706971 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56edba4-d481-4391-b3f8-4c23a6e9eb1c admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:15.707249 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56edba4-d481-4391-b3f8-4c23a6e9eb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:15.707520 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56edba4-d481-4391-b3f8-4c23a6e9eb1c admin admin] PATH_INFO: `/v3/projects` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:15.708262 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56edba4-d481-4391-b3f8-4c23a6e9eb1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:15.710193 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56edba4-d481-4391-b3f8-4c23a6e9eb1c admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:15.735097 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1401/2814] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:24:15 2022] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:24:15.739005 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45180a0c-4554-4de1-b56c-ea8b172b553b None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:15.750238 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45180a0c-4554-4de1-b56c-ea8b172b553b None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:15.809075 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e407ae6-7d8e-4a88-92a5-7d0906ba5647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:15.809755 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e407ae6-7d8e-4a88-92a5-7d0906ba5647 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:15.810041 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e407ae6-7d8e-4a88-92a5-7d0906ba5647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:15.810321 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e407ae6-7d8e-4a88-92a5-7d0906ba5647 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:15.811018 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e407ae6-7d8e-4a88-92a5-7d0906ba5647 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:15.813139 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e407ae6-7d8e-4a88-92a5-7d0906ba5647 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:15.833755 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1414/2815] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:24:15 2022] POST /identity/v3/users => generated 296 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:24:15.837521 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56edba4-d481-4391-b3f8-4c23a6e9eb1c admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:15.847863 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56edba4-d481-4391-b3f8-4c23a6e9eb1c admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:15.853263 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f43804-ef19-457e-81a9-f1876732fed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:15.854044 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f43804-ef19-457e-81a9-f1876732fed9 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:15.854331 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f43804-ef19-457e-81a9-f1876732fed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:15.854631 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f43804-ef19-457e-81a9-f1876732fed9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:15.855617 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f43804-ef19-457e-81a9-f1876732fed9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:15.857256 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f43804-ef19-457e-81a9-f1876732fed9 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:15.868920 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1402/2816] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:24:15.873339 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e407ae6-7d8e-4a88-92a5-7d0906ba5647 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:15.883846 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e407ae6-7d8e-4a88-92a5-7d0906ba5647 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:15.888629 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c20ae-9ce2-463f-bb96-718dc6edb1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:15.889645 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c20ae-9ce2-463f-bb96-718dc6edb1eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:15.890108 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c20ae-9ce2-463f-bb96-718dc6edb1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:15.890453 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c20ae-9ce2-463f-bb96-718dc6edb1eb admin admin] PATH_INFO: `/v3/projects/0bb5e66ac40545a59bc55552a3c2393c/users/8d47d815d5cf436796a09b76fa446db7/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:15.908110 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837c20ae-9ce2-463f-bb96-718dc6edb1eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bb5e66ac40545a59bc55552a3c2393c, user_id=8d47d815d5cf436796a09b76fa446db7, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:15.910889 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837c20ae-9ce2-463f-bb96-718dc6edb1eb admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:15.925648 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1415/2817] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:24:15 2022] PUT /identity/v3/projects/0bb5e66ac40545a59bc55552a3c2393c/users/8d47d815d5cf436796a09b76fa446db7/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:24:15.929672 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f43804-ef19-457e-81a9-f1876732fed9 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:15.940318 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f43804-ef19-457e-81a9-f1876732fed9 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:15.986068 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:16.007323 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4e60b-9850-4649-b671-f9c5b1d5c6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:16.008098 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4e60b-9850-4649-b671-f9c5b1d5c6e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:16.008459 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4e60b-9850-4649-b671-f9c5b1d5c6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:16.008856 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4e60b-9850-4649-b671-f9c5b1d5c6e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:16.009667 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d4e60b-9850-4649-b671-f9c5b1d5c6e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:16.011323 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d4e60b-9850-4649-b671-f9c5b1d5c6e8 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:16.025415 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1403/2818] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:24:16.026723 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c20ae-9ce2-463f-bb96-718dc6edb1eb admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:16.038065 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c20ae-9ce2-463f-bb96-718dc6edb1eb admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:16.042685 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed86979-0f91-4368-927f-bda62b122302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:16.043590 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed86979-0f91-4368-927f-bda62b122302 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:16.043869 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed86979-0f91-4368-927f-bda62b122302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:16.044139 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed86979-0f91-4368-927f-bda62b122302 admin admin] PATH_INFO: `/v3/projects/0bb5e66ac40545a59bc55552a3c2393c/users/8d47d815d5cf436796a09b76fa446db7/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:16.046116 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed86979-0f91-4368-927f-bda62b122302 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bb5e66ac40545a59bc55552a3c2393c, user_id=8d47d815d5cf436796a09b76fa446db7, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:16.048786 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed86979-0f91-4368-927f-bda62b122302 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:16.059839 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1416/2819] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:24:16 2022] PUT /identity/v3/projects/0bb5e66ac40545a59bc55552a3c2393c/users/8d47d815d5cf436796a09b76fa446db7/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:24:16.070570 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc967ba-e121-481d-b5f5-8b3e2324818f None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:16.070865 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc967ba-e121-481d-b5f5-8b3e2324818f None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:16.071149 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc967ba-e121-481d-b5f5-8b3e2324818f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:16.099277 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-fbc967ba-e121-481d-b5f5-8b3e2324818f None None] MFA Rules not processed for user `8d47d815d5cf436796a09b76fa446db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:24:16.100493 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-fbc967ba-e121-481d-b5f5-8b3e2324818f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:16.181601 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1404/2820] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:24:16 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:24:16.193167 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed86979-0f91-4368-927f-bda62b122302 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:16.194883 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-6ed86979-0f91-4368-927f-bda62b122302 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:16.253907 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed86979-0f91-4368-927f-bda62b122302 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:16.258390 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb984f52-30d6-44a6-a206-1c2f9e509a3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:16.259036 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb984f52-30d6-44a6-a206-1c2f9e509a3a service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:16.259333 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb984f52-30d6-44a6-a206-1c2f9e509a3a service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:16.259597 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb984f52-30d6-44a6-a206-1c2f9e509a3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:16.269203 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb984f52-30d6-44a6-a206-1c2f9e509a3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:16.270590 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb984f52-30d6-44a6-a206-1c2f9e509a3a service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:16.292868 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1417/2821] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:24:16 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:24:16.666381 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc967ba-e121-481d-b5f5-8b3e2324818f None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:16.746430 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc967ba-e121-481d-b5f5-8b3e2324818f None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:16.751147 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766cde41-c245-49db-a833-6f46224a9d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:16.752022 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766cde41-c245-49db-a833-6f46224a9d7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:16.752304 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766cde41-c245-49db-a833-6f46224a9d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:16.752586 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766cde41-c245-49db-a833-6f46224a9d7f admin admin] PATH_INFO: `/v3/users/23c9ae593ea34586a24c89c4094b1897` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:16.753830 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766cde41-c245-49db-a833-6f46224a9d7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=23c9ae593ea34586a24c89c4094b1897)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:16.756481 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766cde41-c245-49db-a833-6f46224a9d7f admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:16.809091 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-766cde41-c245-49db-a833-6f46224a9d7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23c9ae593ea34586a24c89c4094b1897'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:16.817095 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-766cde41-c245-49db-a833-6f46224a9d7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23c9ae593ea34586a24c89c4094b1897'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:16.819112 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-766cde41-c245-49db-a833-6f46224a9d7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23c9ae593ea34586a24c89c4094b1897'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:16.819718 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-766cde41-c245-49db-a833-6f46224a9d7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23c9ae593ea34586a24c89c4094b1897'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:16.832281 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:16.838243 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-766cde41-c245-49db-a833-6f46224a9d7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23c9ae593ea34586a24c89c4094b1897'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:16.855576 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1405/2822] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:24:16 2022] DELETE /identity/v3/users/23c9ae593ea34586a24c89c4094b1897 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:24:16.860827 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86ef87-1d50-4ede-8d0c-9aee91b65561 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:16.861299 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86ef87-1d50-4ede-8d0c-9aee91b65561 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:16.861402 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86ef87-1d50-4ede-8d0c-9aee91b65561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:16.873862 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:16.881689 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-3c86ef87-1d50-4ede-8d0c-9aee91b65561 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:24:16.883572 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-3c86ef87-1d50-4ede-8d0c-9aee91b65561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:16.948602 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1418/2823] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:24:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:24:16.955169 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766cde41-c245-49db-a833-6f46224a9d7f admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:16.956937 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-766cde41-c245-49db-a833-6f46224a9d7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:17.022084 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766cde41-c245-49db-a833-6f46224a9d7f admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:17.025964 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e6729-cecb-4839-9661-4cda36ad9cc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:17.026664 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e6729-cecb-4839-9661-4cda36ad9cc7 service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:17.026946 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e6729-cecb-4839-9661-4cda36ad9cc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:17.027232 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e6729-cecb-4839-9661-4cda36ad9cc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:17.037434 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e6729-cecb-4839-9661-4cda36ad9cc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:17.038895 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e6729-cecb-4839-9661-4cda36ad9cc7 service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:17.050988 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1406/2824] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:24:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:24:17.318426 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86ef87-1d50-4ede-8d0c-9aee91b65561 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:17.320398 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-3c86ef87-1d50-4ede-8d0c-9aee91b65561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:17.334029 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86ef87-1d50-4ede-8d0c-9aee91b65561 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:17.338716 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9fe8d-0d00-4a9d-91bf-4ceb338d2744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:17.339583 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9fe8d-0d00-4a9d-91bf-4ceb338d2744 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:17.339874 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9fe8d-0d00-4a9d-91bf-4ceb338d2744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:17.340152 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9fe8d-0d00-4a9d-91bf-4ceb338d2744 admin admin] PATH_INFO: `/v3/projects/63cce128f52243e39d6a9a8532f25c17` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:17.341522 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f9fe8d-0d00-4a9d-91bf-4ceb338d2744 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63cce128f52243e39d6a9a8532f25c17)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:17.343430 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f9fe8d-0d00-4a9d-91bf-4ceb338d2744 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:17.392348 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-52f9fe8d-0d00-4a9d-91bf-4ceb338d2744 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63cce128f52243e39d6a9a8532f25c17', 'request_id': 'req-52f9fe8d-0d00-4a9d-91bf-4ceb338d2744'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:17.398436 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-52f9fe8d-0d00-4a9d-91bf-4ceb338d2744 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63cce128f52243e39d6a9a8532f25c17', 'request_id': 'req-52f9fe8d-0d00-4a9d-91bf-4ceb338d2744'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:17.405771 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-52f9fe8d-0d00-4a9d-91bf-4ceb338d2744 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63cce128f52243e39d6a9a8532f25c17', 'request_id': 'req-52f9fe8d-0d00-4a9d-91bf-4ceb338d2744'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:17.417691 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-52f9fe8d-0d00-4a9d-91bf-4ceb338d2744 admin admin] The token cache is being invalidate because project 63cce128f52243e39d6a9a8532f25c17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:24:17.417977 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-52f9fe8d-0d00-4a9d-91bf-4ceb338d2744 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:17.418607 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-52f9fe8d-0d00-4a9d-91bf-4ceb338d2744 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:17.420146 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1419/2825] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:24:17 2022] DELETE /identity/v3/projects/63cce128f52243e39d6a9a8532f25c17 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:24:17.424033 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e6729-cecb-4839-9661-4cda36ad9cc7 service neutron] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:17.433645 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e6729-cecb-4839-9661-4cda36ad9cc7 service neutron] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:17.489273 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7664bf-a1e7-4ca1-9d2b-16aeafd5892d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:17.490149 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7664bf-a1e7-4ca1-9d2b-16aeafd5892d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:17.490434 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7664bf-a1e7-4ca1-9d2b-16aeafd5892d admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:17.490711 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7664bf-a1e7-4ca1-9d2b-16aeafd5892d admin admin] PATH_INFO: `/v3/users/8d47d815d5cf436796a09b76fa446db7` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:17.491894 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7664bf-a1e7-4ca1-9d2b-16aeafd5892d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d47d815d5cf436796a09b76fa446db7)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:17.493846 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7664bf-a1e7-4ca1-9d2b-16aeafd5892d admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:17.539780 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-3a7664bf-a1e7-4ca1-9d2b-16aeafd5892d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d47d815d5cf436796a09b76fa446db7'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:17.548071 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-3a7664bf-a1e7-4ca1-9d2b-16aeafd5892d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d47d815d5cf436796a09b76fa446db7'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:17.548688 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-3a7664bf-a1e7-4ca1-9d2b-16aeafd5892d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d47d815d5cf436796a09b76fa446db7'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:17.549304 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-3a7664bf-a1e7-4ca1-9d2b-16aeafd5892d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d47d815d5cf436796a09b76fa446db7'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:17.562453 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-3a7664bf-a1e7-4ca1-9d2b-16aeafd5892d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d47d815d5cf436796a09b76fa446db7'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:17.574979 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1407/2826] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:24:17 2022] DELETE /identity/v3/users/8d47d815d5cf436796a09b76fa446db7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:24:17.847451 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9fe8d-0d00-4a9d-91bf-4ceb338d2744 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:17.848980 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-52f9fe8d-0d00-4a9d-91bf-4ceb338d2744 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:17.863824 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9fe8d-0d00-4a9d-91bf-4ceb338d2744 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:17.920417 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a4de5-ed8e-4fc8-b5ad-57f08f74f13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:17.921309 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a4de5-ed8e-4fc8-b5ad-57f08f74f13a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:17.921590 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a4de5-ed8e-4fc8-b5ad-57f08f74f13a admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:17.921863 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a4de5-ed8e-4fc8-b5ad-57f08f74f13a admin admin] PATH_INFO: `/v3/projects/0bb5e66ac40545a59bc55552a3c2393c` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:17.923033 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9a4de5-ed8e-4fc8-b5ad-57f08f74f13a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bb5e66ac40545a59bc55552a3c2393c)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:17.924950 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9a4de5-ed8e-4fc8-b5ad-57f08f74f13a admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:17.959167 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:17.975854 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-0b9a4de5-ed8e-4fc8-b5ad-57f08f74f13a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bb5e66ac40545a59bc55552a3c2393c', 'request_id': 'req-0b9a4de5-ed8e-4fc8-b5ad-57f08f74f13a'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:17.981595 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-0b9a4de5-ed8e-4fc8-b5ad-57f08f74f13a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bb5e66ac40545a59bc55552a3c2393c', 'request_id': 'req-0b9a4de5-ed8e-4fc8-b5ad-57f08f74f13a'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:17.990362 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-0b9a4de5-ed8e-4fc8-b5ad-57f08f74f13a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bb5e66ac40545a59bc55552a3c2393c', 'request_id': 'req-0b9a4de5-ed8e-4fc8-b5ad-57f08f74f13a'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:18.004399 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-0b9a4de5-ed8e-4fc8-b5ad-57f08f74f13a admin admin] The token cache is being invalidate because project 0bb5e66ac40545a59bc55552a3c2393c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:24:18.005254 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-0b9a4de5-ed8e-4fc8-b5ad-57f08f74f13a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:18.006447 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-0b9a4de5-ed8e-4fc8-b5ad-57f08f74f13a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:18.008095 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1420/2827] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:24:17 2022] DELETE /identity/v3/projects/0bb5e66ac40545a59bc55552a3c2393c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:24:18.013779 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29902c01-64b8-405d-b61a-8ba5a211242a None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:18.014171 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29902c01-64b8-405d-b61a-8ba5a211242a None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:18.014364 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29902c01-64b8-405d-b61a-8ba5a211242a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:18.022257 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:18.034112 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-29902c01-64b8-405d-b61a-8ba5a211242a None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:24:18.035330 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-29902c01-64b8-405d-b61a-8ba5a211242a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:18.094962 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1408/2828] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:24:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:24:18.103580 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc7c6e-da36-4e0a-8bc3-5c37847b4181 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:18.103867 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc7c6e-da36-4e0a-8bc3-5c37847b4181 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:18.104144 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc7c6e-da36-4e0a-8bc3-5c37847b4181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:18.122926 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-a1bc7c6e-da36-4e0a-8bc3-5c37847b4181 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:24:18.124126 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-a1bc7c6e-da36-4e0a-8bc3-5c37847b4181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:18.133526 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1421/2829] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:24:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:24:18.137553 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29902c01-64b8-405d-b61a-8ba5a211242a None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:18.147477 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29902c01-64b8-405d-b61a-8ba5a211242a None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:18.152106 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b23ae3-f38d-491b-be23-94d9da0b04d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:18.152781 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b23ae3-f38d-491b-be23-94d9da0b04d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:18.153065 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b23ae3-f38d-491b-be23-94d9da0b04d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:18.153360 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b23ae3-f38d-491b-be23-94d9da0b04d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:18.154060 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b23ae3-f38d-491b-be23-94d9da0b04d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:24:18.154390 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b23ae3-f38d-491b-be23-94d9da0b04d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:18.155975 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b23ae3-f38d-491b-be23-94d9da0b04d6 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:18.167587 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1409/2830] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:24:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:24:18.171814 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc7c6e-da36-4e0a-8bc3-5c37847b4181 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:18.181668 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc7c6e-da36-4e0a-8bc3-5c37847b4181 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:18.186206 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f3eac2-c10c-46eb-a8d3-8eb3bcc96ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:18.186855 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3eac2-c10c-46eb-a8d3-8eb3bcc96ca9 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:18.187134 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3eac2-c10c-46eb-a8d3-8eb3bcc96ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:18.187408 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3eac2-c10c-46eb-a8d3-8eb3bcc96ca9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:18.188092 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f3eac2-c10c-46eb-a8d3-8eb3bcc96ca9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:18.190000 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f3eac2-c10c-46eb-a8d3-8eb3bcc96ca9 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:18.217343 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1422/2831] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:24:18 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:24:18.221523 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b23ae3-f38d-491b-be23-94d9da0b04d6 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:18.231821 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b23ae3-f38d-491b-be23-94d9da0b04d6 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:18.288172 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e17a1-8bbd-4cae-b2a7-0f7751462658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:18.288875 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e17a1-8bbd-4cae-b2a7-0f7751462658 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:18.289166 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e17a1-8bbd-4cae-b2a7-0f7751462658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:18.289447 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e17a1-8bbd-4cae-b2a7-0f7751462658 admin admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:18.290150 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20e17a1-8bbd-4cae-b2a7-0f7751462658 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:18.292065 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20e17a1-8bbd-4cae-b2a7-0f7751462658 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:18.312890 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1410/2832] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:24:18 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:24:18.316319 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f3eac2-c10c-46eb-a8d3-8eb3bcc96ca9 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:18.327194 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f3eac2-c10c-46eb-a8d3-8eb3bcc96ca9 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:18.331801 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf921c-8052-416c-986a-e807ea1bc605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:18.332452 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf921c-8052-416c-986a-e807ea1bc605 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:18.332841 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf921c-8052-416c-986a-e807ea1bc605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:18.333290 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf921c-8052-416c-986a-e807ea1bc605 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:18.334083 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecf921c-8052-416c-986a-e807ea1bc605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:18.335677 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecf921c-8052-416c-986a-e807ea1bc605 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:18.346214 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1423/2833] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:24:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:24:18.350072 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e17a1-8bbd-4cae-b2a7-0f7751462658 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:18.360424 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e17a1-8bbd-4cae-b2a7-0f7751462658 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:18.366339 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc27ab6b-709c-4a46-ae05-5d2a5ff2873f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:18.367000 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27ab6b-709c-4a46-ae05-5d2a5ff2873f admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:18.367282 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27ab6b-709c-4a46-ae05-5d2a5ff2873f admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:18.367619 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27ab6b-709c-4a46-ae05-5d2a5ff2873f admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:18.368404 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc27ab6b-709c-4a46-ae05-5d2a5ff2873f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:18.370051 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc27ab6b-709c-4a46-ae05-5d2a5ff2873f admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:18.384426 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1411/2834] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:24:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:24:18.385736 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf921c-8052-416c-986a-e807ea1bc605 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:18.396252 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf921c-8052-416c-986a-e807ea1bc605 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:18.400992 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef8f62d-7d30-4c83-9036-6abd6f3d3d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:18.401908 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8f62d-7d30-4c83-9036-6abd6f3d3d5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:18.402197 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8f62d-7d30-4c83-9036-6abd6f3d3d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:18.402478 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8f62d-7d30-4c83-9036-6abd6f3d3d5f admin admin] PATH_INFO: `/v3/projects/28ae92b035e34c0dac11b1574c3fbcb0/users/3e739f1b586447bb82d901ef5b411e7a/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:18.416892 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef8f62d-7d30-4c83-9036-6abd6f3d3d5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=28ae92b035e34c0dac11b1574c3fbcb0, user_id=3e739f1b586447bb82d901ef5b411e7a, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:18.419532 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef8f62d-7d30-4c83-9036-6abd6f3d3d5f admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:18.432807 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1424/2835] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:24:18 2022] PUT /identity/v3/projects/28ae92b035e34c0dac11b1574c3fbcb0/users/3e739f1b586447bb82d901ef5b411e7a/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:24:18.495657 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f3b6c-df93-43b0-9563-07fa1dc1900a None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:18.495944 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f3b6c-df93-43b0-9563-07fa1dc1900a None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:18.496222 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f3b6c-df93-43b0-9563-07fa1dc1900a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:18.522903 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-df0f3b6c-df93-43b0-9563-07fa1dc1900a None None] MFA Rules not processed for user `3e739f1b586447bb82d901ef5b411e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:24:18.524104 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-df0f3b6c-df93-43b0-9563-07fa1dc1900a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:18.583521 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:18.587301 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1412/2836] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:24:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:24:18.591649 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef8f62d-7d30-4c83-9036-6abd6f3d3d5f admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:18.651721 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef8f62d-7d30-4c83-9036-6abd6f3d3d5f admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:18.656259 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fd8d28-e74e-4641-ae46-986ae23498f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:18.656928 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd8d28-e74e-4641-ae46-986ae23498f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:18.657213 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd8d28-e74e-4641-ae46-986ae23498f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:18.657490 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd8d28-e74e-4641-ae46-986ae23498f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:18.658173 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fd8d28-e74e-4641-ae46-986ae23498f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:18.660051 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fd8d28-e74e-4641-ae46-986ae23498f6 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:18.685969 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1425/2837] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:24:18 2022] POST /identity/v3/projects => generated 375 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:24:18.690420 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f3b6c-df93-43b0-9563-07fa1dc1900a None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:18.701842 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f3b6c-df93-43b0-9563-07fa1dc1900a None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:18.761799 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b607632c-0cd4-4a73-b749-0c660ad0a945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:18.762509 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607632c-0cd4-4a73-b749-0c660ad0a945 admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:18.762790 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607632c-0cd4-4a73-b749-0c660ad0a945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:18.763060 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607632c-0cd4-4a73-b749-0c660ad0a945 admin admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:18.763897 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b607632c-0cd4-4a73-b749-0c660ad0a945 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:18.765866 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b607632c-0cd4-4a73-b749-0c660ad0a945 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:18.787791 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1413/2838] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:24:18 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:24:18.791738 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fd8d28-e74e-4641-ae46-986ae23498f6 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:18.803074 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fd8d28-e74e-4641-ae46-986ae23498f6 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:18.807783 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca26f4ec-f286-4a24-a420-0a7dd48bec7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:18.808447 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26f4ec-f286-4a24-a420-0a7dd48bec7c admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:18.808784 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26f4ec-f286-4a24-a420-0a7dd48bec7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:18.809068 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26f4ec-f286-4a24-a420-0a7dd48bec7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:18.809887 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca26f4ec-f286-4a24-a420-0a7dd48bec7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:18.811594 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca26f4ec-f286-4a24-a420-0a7dd48bec7c admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:18.823498 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1426/2839] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:24:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:24:18.827578 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b607632c-0cd4-4a73-b749-0c660ad0a945 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:18.838480 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b607632c-0cd4-4a73-b749-0c660ad0a945 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:18.845311 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b58fc-5306-4cf9-ba38-b15fb8056625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:18.845981 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b58fc-5306-4cf9-ba38-b15fb8056625 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:18.846265 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b58fc-5306-4cf9-ba38-b15fb8056625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:18.846542 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b58fc-5306-4cf9-ba38-b15fb8056625 admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:18.847269 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18b58fc-5306-4cf9-ba38-b15fb8056625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:18.849589 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18b58fc-5306-4cf9-ba38-b15fb8056625 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:18.860736 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1414/2840] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:24:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:24:18.865417 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca26f4ec-f286-4a24-a420-0a7dd48bec7c admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:18.875442 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca26f4ec-f286-4a24-a420-0a7dd48bec7c admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:18.880298 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a711a75-1170-4903-a6f4-8b0a9cefc0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:18.881244 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a711a75-1170-4903-a6f4-8b0a9cefc0eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:18.881529 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a711a75-1170-4903-a6f4-8b0a9cefc0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:18.881808 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a711a75-1170-4903-a6f4-8b0a9cefc0eb admin admin] PATH_INFO: `/v3/projects/488609fddf6d448cbdfa4f258eaed50f/users/4684b92bf5184ce39cf4f66529d3d470/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:18.898082 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a711a75-1170-4903-a6f4-8b0a9cefc0eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=488609fddf6d448cbdfa4f258eaed50f, user_id=4684b92bf5184ce39cf4f66529d3d470, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:18.900686 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a711a75-1170-4903-a6f4-8b0a9cefc0eb admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:18.914501 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1427/2841] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:24:18 2022] PUT /identity/v3/projects/488609fddf6d448cbdfa4f258eaed50f/users/4684b92bf5184ce39cf4f66529d3d470/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:24:18.924651 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc0fae-d2ed-4c30-b350-3c20c108dc6f None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:18.924976 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc0fae-d2ed-4c30-b350-3c20c108dc6f None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:18.925242 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc0fae-d2ed-4c30-b350-3c20c108dc6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:18.952272 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-22bc0fae-d2ed-4c30-b350-3c20c108dc6f None None] MFA Rules not processed for user `4684b92bf5184ce39cf4f66529d3d470`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:24:18.953537 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-22bc0fae-d2ed-4c30-b350-3c20c108dc6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:19.017363 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1415/2842] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:24:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:24:19.022221 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a711a75-1170-4903-a6f4-8b0a9cefc0eb admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:19.031128 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:19.087585 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a711a75-1170-4903-a6f4-8b0a9cefc0eb admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:19.092279 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9533ffb-7b78-4484-99f6-d15cda55f749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:19.092957 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9533ffb-7b78-4484-99f6-d15cda55f749 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:19.093238 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9533ffb-7b78-4484-99f6-d15cda55f749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:19.093509 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9533ffb-7b78-4484-99f6-d15cda55f749 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:19.094253 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9533ffb-7b78-4484-99f6-d15cda55f749 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:19.096130 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9533ffb-7b78-4484-99f6-d15cda55f749 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:19.122626 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1428/2843] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:24:19 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:24:19.126543 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc0fae-d2ed-4c30-b350-3c20c108dc6f None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:19.137162 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc0fae-d2ed-4c30-b350-3c20c108dc6f None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:19.193316 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4bf36-4986-4503-bfb4-6b704afa86da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:19.194481 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4bf36-4986-4503-bfb4-6b704afa86da admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:19.194911 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4bf36-4986-4503-bfb4-6b704afa86da admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:19.195192 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4bf36-4986-4503-bfb4-6b704afa86da admin admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:19.195893 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b4bf36-4986-4503-bfb4-6b704afa86da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:19.197869 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b4bf36-4986-4503-bfb4-6b704afa86da admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:19.212943 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:19.220036 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1416/2844] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:24:19 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:24:19.223814 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9533ffb-7b78-4484-99f6-d15cda55f749 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:19.234351 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9533ffb-7b78-4484-99f6-d15cda55f749 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:19.239225 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20ae34-4917-4290-ba63-f9f874f10774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:19.239880 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20ae34-4917-4290-ba63-f9f874f10774 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:19.240160 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20ae34-4917-4290-ba63-f9f874f10774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:19.240490 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20ae34-4917-4290-ba63-f9f874f10774 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:19.241542 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac20ae34-4917-4290-ba63-f9f874f10774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:19.243130 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac20ae34-4917-4290-ba63-f9f874f10774 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:19.253779 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1429/2845] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:24:19.258480 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4bf36-4986-4503-bfb4-6b704afa86da admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:19.268374 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4bf36-4986-4503-bfb4-6b704afa86da admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:19.274366 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f2fff9-e85d-4ebb-8910-0cebc5550e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:19.275269 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f2fff9-e85d-4ebb-8910-0cebc5550e69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:19.275546 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f2fff9-e85d-4ebb-8910-0cebc5550e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:19.275818 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f2fff9-e85d-4ebb-8910-0cebc5550e69 admin admin] PATH_INFO: `/v3/projects/9cf054e08c7746b68c10cff0be0b5778/users/7e628b945bb648a2b870a2649ece0e4d/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:19.290662 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f2fff9-e85d-4ebb-8910-0cebc5550e69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cf054e08c7746b68c10cff0be0b5778, user_id=7e628b945bb648a2b870a2649ece0e4d, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:19.293332 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f2fff9-e85d-4ebb-8910-0cebc5550e69 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:19.306411 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1417/2846] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:24:19 2022] PUT /identity/v3/projects/9cf054e08c7746b68c10cff0be0b5778/users/7e628b945bb648a2b870a2649ece0e4d/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:24:19.311910 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20ae34-4917-4290-ba63-f9f874f10774 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:19.323438 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20ae34-4917-4290-ba63-f9f874f10774 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:19.388725 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45fcd6d-e957-4a4f-8e55-1a13bf3da34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:19.389634 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fcd6d-e957-4a4f-8e55-1a13bf3da34d admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:19.389634 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fcd6d-e957-4a4f-8e55-1a13bf3da34d admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:19.389862 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fcd6d-e957-4a4f-8e55-1a13bf3da34d admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:19.390649 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45fcd6d-e957-4a4f-8e55-1a13bf3da34d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:19.392246 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45fcd6d-e957-4a4f-8e55-1a13bf3da34d admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:19.406255 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1430/2847] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:24:19.407872 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f2fff9-e85d-4ebb-8910-0cebc5550e69 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:19.418656 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f2fff9-e85d-4ebb-8910-0cebc5550e69 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:19.423522 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07cb214-d50f-4eed-a9a5-ee04d666f2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:19.424416 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07cb214-d50f-4eed-a9a5-ee04d666f2cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:19.424716 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07cb214-d50f-4eed-a9a5-ee04d666f2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:19.425016 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07cb214-d50f-4eed-a9a5-ee04d666f2cd admin admin] PATH_INFO: `/v3/projects/9cf054e08c7746b68c10cff0be0b5778/users/7e628b945bb648a2b870a2649ece0e4d/roles/5a64bd8372704de98e75436ff69e46b3` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:19.427000 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07cb214-d50f-4eed-a9a5-ee04d666f2cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cf054e08c7746b68c10cff0be0b5778, user_id=7e628b945bb648a2b870a2649ece0e4d, role_id=5a64bd8372704de98e75436ff69e46b3)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:19.429788 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07cb214-d50f-4eed-a9a5-ee04d666f2cd admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:19.440958 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1418/2848] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:24:19 2022] PUT /identity/v3/projects/9cf054e08c7746b68c10cff0be0b5778/users/7e628b945bb648a2b870a2649ece0e4d/roles/5a64bd8372704de98e75436ff69e46b3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:24:19.453146 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5fe141-9819-47f9-b6cf-ef1caec71ee0 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:19.453434 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5fe141-9819-47f9-b6cf-ef1caec71ee0 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:19.453709 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5fe141-9819-47f9-b6cf-ef1caec71ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:19.480865 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-3c5fe141-9819-47f9-b6cf-ef1caec71ee0 None None] MFA Rules not processed for user `7e628b945bb648a2b870a2649ece0e4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:24:19.482068 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-3c5fe141-9819-47f9-b6cf-ef1caec71ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:19.549786 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1431/2849] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:24:19 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:24:19.561548 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07cb214-d50f-4eed-a9a5-ee04d666f2cd admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:19.563248 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-b07cb214-d50f-4eed-a9a5-ee04d666f2cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:19.623466 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07cb214-d50f-4eed-a9a5-ee04d666f2cd admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:19.627111 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df59eb3-9503-443c-baa7-ce255887a660 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:19.627752 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df59eb3-9503-443c-baa7-ce255887a660 service cinder] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:19.628041 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df59eb3-9503-443c-baa7-ce255887a660 service cinder] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:19.628307 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df59eb3-9503-443c-baa7-ce255887a660 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:19.696203 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df59eb3-9503-443c-baa7-ce255887a660 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:19.697582 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df59eb3-9503-443c-baa7-ce255887a660 service cinder] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:19.706982 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1419/2850] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:24:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:24:19.771115 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5fe141-9819-47f9-b6cf-ef1caec71ee0 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:19.772515 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-3c5fe141-9819-47f9-b6cf-ef1caec71ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:19.776176 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:19.864885 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5fe141-9819-47f9-b6cf-ef1caec71ee0 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:19.870770 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63286f5a-8110-4483-9c3e-c5c9b08367f9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f0f9248178049cda6571fa365a21225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:19.871448 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63286f5a-8110-4483-9c3e-c5c9b08367f9 service placement] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:19.871831 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63286f5a-8110-4483-9c3e-c5c9b08367f9 service placement] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:19.872192 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63286f5a-8110-4483-9c3e-c5c9b08367f9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:19.874368 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-63286f5a-8110-4483-9c3e-c5c9b08367f9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:19.889918 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63286f5a-8110-4483-9c3e-c5c9b08367f9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:19.891558 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63286f5a-8110-4483-9c3e-c5c9b08367f9 service placement] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:19.903608 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1432/2851] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:24:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:24:22.252669 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df59eb3-9503-443c-baa7-ce255887a660 service cinder] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:22.254092 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-9df59eb3-9503-443c-baa7-ce255887a660 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:22.265886 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df59eb3-9503-443c-baa7-ce255887a660 service cinder] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:22.269560 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e56a1f0-a3cf-4f5a-a6c9-14cb922773d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:22.270215 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e56a1f0-a3cf-4f5a-a6c9-14cb922773d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:22.270502 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e56a1f0-a3cf-4f5a-a6c9-14cb922773d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:22.270779 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e56a1f0-a3cf-4f5a-a6c9-14cb922773d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:22.329244 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e56a1f0-a3cf-4f5a-a6c9-14cb922773d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:22.330592 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e56a1f0-a3cf-4f5a-a6c9-14cb922773d9 service cinder] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:22.340133 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1420/2852] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:24:22 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:24:23.960374 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63286f5a-8110-4483-9c3e-c5c9b08367f9 service placement] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:23.970095 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63286f5a-8110-4483-9c3e-c5c9b08367f9 service placement] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:23.976130 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f559fc-d5d3-4266-bb63-a918afb7f070 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:23.976827 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f559fc-d5d3-4266-bb63-a918afb7f070 service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:23.977115 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f559fc-d5d3-4266-bb63-a918afb7f070 service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:23.977397 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f559fc-d5d3-4266-bb63-a918afb7f070 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:23.987031 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f559fc-d5d3-4266-bb63-a918afb7f070 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:23.988445 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f559fc-d5d3-4266-bb63-a918afb7f070 service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:23.999250 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1433/2853] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:24:23 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:24:30.969693 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e56a1f0-a3cf-4f5a-a6c9-14cb922773d9 service cinder] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:30.982742 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:31.032079 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e56a1f0-a3cf-4f5a-a6c9-14cb922773d9 service cinder] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:31.036486 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df549697-c4a6-44c8-b088-11ec96abfba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:31.037458 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df549697-c4a6-44c8-b088-11ec96abfba5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:31.037733 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df549697-c4a6-44c8-b088-11ec96abfba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:31.038003 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df549697-c4a6-44c8-b088-11ec96abfba5 admin admin] PATH_INFO: `/v3/users/3e739f1b586447bb82d901ef5b411e7a` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:31.039168 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df549697-c4a6-44c8-b088-11ec96abfba5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e739f1b586447bb82d901ef5b411e7a)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:31.041118 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df549697-c4a6-44c8-b088-11ec96abfba5 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:31.088164 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-df549697-c4a6-44c8-b088-11ec96abfba5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e739f1b586447bb82d901ef5b411e7a'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:31.096473 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-df549697-c4a6-44c8-b088-11ec96abfba5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e739f1b586447bb82d901ef5b411e7a'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:31.097114 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-df549697-c4a6-44c8-b088-11ec96abfba5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e739f1b586447bb82d901ef5b411e7a'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:31.097724 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-df549697-c4a6-44c8-b088-11ec96abfba5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e739f1b586447bb82d901ef5b411e7a'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:31.109869 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-df549697-c4a6-44c8-b088-11ec96abfba5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e739f1b586447bb82d901ef5b411e7a'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:31.122423 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1421/2854] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:24:30 2022] DELETE /identity/v3/users/3e739f1b586447bb82d901ef5b411e7a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:24:31.127231 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7b422-d63b-4b82-85d3-55fced47baf0 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:31.127712 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7b422-d63b-4b82-85d3-55fced47baf0 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:31.127848 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7b422-d63b-4b82-85d3-55fced47baf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:31.161764 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-30e7b422-d63b-4b82-85d3-55fced47baf0 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:24:31.163086 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-30e7b422-d63b-4b82-85d3-55fced47baf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:31.233475 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1434/2855] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:24:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:24:31.243897 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df549697-c4a6-44c8-b088-11ec96abfba5 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:31.245522 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-df549697-c4a6-44c8-b088-11ec96abfba5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:31.309944 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df549697-c4a6-44c8-b088-11ec96abfba5 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:31.313698 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c0410-608c-4ff6-a021-93f2c1605a0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:31.314442 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c0410-608c-4ff6-a021-93f2c1605a0b service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:31.314792 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c0410-608c-4ff6-a021-93f2c1605a0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:31.315132 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c0410-608c-4ff6-a021-93f2c1605a0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:31.325041 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6c0410-608c-4ff6-a021-93f2c1605a0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:31.326471 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6c0410-608c-4ff6-a021-93f2c1605a0b service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:31.337737 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1422/2856] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:24:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:24:31.788122 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e7b422-d63b-4b82-85d3-55fced47baf0 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:31.789645 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-30e7b422-d63b-4b82-85d3-55fced47baf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:31.802120 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e7b422-d63b-4b82-85d3-55fced47baf0 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:31.807061 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc660d-91dd-48b3-bd54-f0d033b57cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:31.807962 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc660d-91dd-48b3-bd54-f0d033b57cc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:31.808273 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc660d-91dd-48b3-bd54-f0d033b57cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:31.808687 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc660d-91dd-48b3-bd54-f0d033b57cc1 admin admin] PATH_INFO: `/v3/projects/28ae92b035e34c0dac11b1574c3fbcb0` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:31.809914 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc660d-91dd-48b3-bd54-f0d033b57cc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28ae92b035e34c0dac11b1574c3fbcb0)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:31.811839 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc660d-91dd-48b3-bd54-f0d033b57cc1 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:31.875385 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-fefc660d-91dd-48b3-bd54-f0d033b57cc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28ae92b035e34c0dac11b1574c3fbcb0', 'request_id': 'req-fefc660d-91dd-48b3-bd54-f0d033b57cc1'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:31.879347 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:31.882759 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-fefc660d-91dd-48b3-bd54-f0d033b57cc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28ae92b035e34c0dac11b1574c3fbcb0', 'request_id': 'req-fefc660d-91dd-48b3-bd54-f0d033b57cc1'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:31.893293 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-fefc660d-91dd-48b3-bd54-f0d033b57cc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28ae92b035e34c0dac11b1574c3fbcb0', 'request_id': 'req-fefc660d-91dd-48b3-bd54-f0d033b57cc1'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:31.908408 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-fefc660d-91dd-48b3-bd54-f0d033b57cc1 admin admin] The token cache is being invalidate because project 28ae92b035e34c0dac11b1574c3fbcb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:24:31.908725 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-fefc660d-91dd-48b3-bd54-f0d033b57cc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:31.909378 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-fefc660d-91dd-48b3-bd54-f0d033b57cc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:31.914493 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1435/2857] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:24:31 2022] DELETE /identity/v3/projects/28ae92b035e34c0dac11b1574c3fbcb0 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:24:31.915644 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c0410-608c-4ff6-a021-93f2c1605a0b service neutron] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:31.925896 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c0410-608c-4ff6-a021-93f2c1605a0b service neutron] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:31.959626 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:31.985340 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048200f-7f4e-44d9-9864-fc0f0fa70767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:31.986220 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048200f-7f4e-44d9-9864-fc0f0fa70767 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:31.986508 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048200f-7f4e-44d9-9864-fc0f0fa70767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:31.986784 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048200f-7f4e-44d9-9864-fc0f0fa70767 admin admin] PATH_INFO: `/v3/users/4684b92bf5184ce39cf4f66529d3d470` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:31.987975 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c048200f-7f4e-44d9-9864-fc0f0fa70767 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4684b92bf5184ce39cf4f66529d3d470)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:31.989950 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c048200f-7f4e-44d9-9864-fc0f0fa70767 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:32.035426 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-c048200f-7f4e-44d9-9864-fc0f0fa70767 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4684b92bf5184ce39cf4f66529d3d470'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:32.042831 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-c048200f-7f4e-44d9-9864-fc0f0fa70767 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4684b92bf5184ce39cf4f66529d3d470'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:32.043461 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-c048200f-7f4e-44d9-9864-fc0f0fa70767 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4684b92bf5184ce39cf4f66529d3d470'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:32.044075 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-c048200f-7f4e-44d9-9864-fc0f0fa70767 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4684b92bf5184ce39cf4f66529d3d470'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:32.056931 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-c048200f-7f4e-44d9-9864-fc0f0fa70767 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4684b92bf5184ce39cf4f66529d3d470'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:32.071891 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1423/2858] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:24:31 2022] DELETE /identity/v3/users/4684b92bf5184ce39cf4f66529d3d470 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:24:32.336988 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc660d-91dd-48b3-bd54-f0d033b57cc1 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:32.338524 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-fefc660d-91dd-48b3-bd54-f0d033b57cc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:32.353364 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc660d-91dd-48b3-bd54-f0d033b57cc1 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:32.411476 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad1e58-3f2f-4350-8dfb-ed6e98cecef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:32.412994 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad1e58-3f2f-4350-8dfb-ed6e98cecef8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:32.413273 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad1e58-3f2f-4350-8dfb-ed6e98cecef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:32.413552 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad1e58-3f2f-4350-8dfb-ed6e98cecef8 admin admin] PATH_INFO: `/v3/projects/488609fddf6d448cbdfa4f258eaed50f` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:32.414849 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfad1e58-3f2f-4350-8dfb-ed6e98cecef8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=488609fddf6d448cbdfa4f258eaed50f)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:32.416819 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfad1e58-3f2f-4350-8dfb-ed6e98cecef8 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:32.466148 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-cfad1e58-3f2f-4350-8dfb-ed6e98cecef8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '488609fddf6d448cbdfa4f258eaed50f', 'request_id': 'req-cfad1e58-3f2f-4350-8dfb-ed6e98cecef8'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:32.471525 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-cfad1e58-3f2f-4350-8dfb-ed6e98cecef8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '488609fddf6d448cbdfa4f258eaed50f', 'request_id': 'req-cfad1e58-3f2f-4350-8dfb-ed6e98cecef8'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:32.479155 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-cfad1e58-3f2f-4350-8dfb-ed6e98cecef8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '488609fddf6d448cbdfa4f258eaed50f', 'request_id': 'req-cfad1e58-3f2f-4350-8dfb-ed6e98cecef8'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:32.490444 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-cfad1e58-3f2f-4350-8dfb-ed6e98cecef8 admin admin] The token cache is being invalidate because project 488609fddf6d448cbdfa4f258eaed50f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:24:32.490724 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-cfad1e58-3f2f-4350-8dfb-ed6e98cecef8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:32.491351 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-cfad1e58-3f2f-4350-8dfb-ed6e98cecef8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:32.492924 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1436/2859] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:24:32 2022] DELETE /identity/v3/projects/488609fddf6d448cbdfa4f258eaed50f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:24:32.496827 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048200f-7f4e-44d9-9864-fc0f0fa70767 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:32.498331 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-c048200f-7f4e-44d9-9864-fc0f0fa70767 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:32.511181 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048200f-7f4e-44d9-9864-fc0f0fa70767 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:32.568037 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57facb4-6285-44a2-999f-44291a18eb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:32.569054 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57facb4-6285-44a2-999f-44291a18eb53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:32.569328 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57facb4-6285-44a2-999f-44291a18eb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:32.569597 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57facb4-6285-44a2-999f-44291a18eb53 admin admin] PATH_INFO: `/v3/users/7e628b945bb648a2b870a2649ece0e4d` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:32.570765 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57facb4-6285-44a2-999f-44291a18eb53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e628b945bb648a2b870a2649ece0e4d)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:32.572664 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57facb4-6285-44a2-999f-44291a18eb53 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:32.618065 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-a57facb4-6285-44a2-999f-44291a18eb53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e628b945bb648a2b870a2649ece0e4d'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:32.625181 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-a57facb4-6285-44a2-999f-44291a18eb53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e628b945bb648a2b870a2649ece0e4d'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:32.625777 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-a57facb4-6285-44a2-999f-44291a18eb53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e628b945bb648a2b870a2649ece0e4d'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:32.626366 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-a57facb4-6285-44a2-999f-44291a18eb53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e628b945bb648a2b870a2649ece0e4d'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:32.628250 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:32.640090 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-a57facb4-6285-44a2-999f-44291a18eb53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e628b945bb648a2b870a2649ece0e4d'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:32.653103 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1424/2860] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:24:32 2022] DELETE /identity/v3/users/7e628b945bb648a2b870a2649ece0e4d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:24:32.918143 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad1e58-3f2f-4350-8dfb-ed6e98cecef8 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:32.919596 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-cfad1e58-3f2f-4350-8dfb-ed6e98cecef8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:32.934749 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad1e58-3f2f-4350-8dfb-ed6e98cecef8 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:32.999821 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b149a37f-2bc3-43a2-a16b-b8c00ac980df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:33.000604 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149a37f-2bc3-43a2-a16b-b8c00ac980df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:33.000931 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149a37f-2bc3-43a2-a16b-b8c00ac980df admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:33.001207 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149a37f-2bc3-43a2-a16b-b8c00ac980df admin admin] PATH_INFO: `/v3/projects/9cf054e08c7746b68c10cff0be0b5778` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:33.002414 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b149a37f-2bc3-43a2-a16b-b8c00ac980df admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cf054e08c7746b68c10cff0be0b5778)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:33.004331 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b149a37f-2bc3-43a2-a16b-b8c00ac980df admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:33.023035 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:33.056297 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-b149a37f-2bc3-43a2-a16b-b8c00ac980df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cf054e08c7746b68c10cff0be0b5778', 'request_id': 'req-b149a37f-2bc3-43a2-a16b-b8c00ac980df'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:33.062379 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-b149a37f-2bc3-43a2-a16b-b8c00ac980df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cf054e08c7746b68c10cff0be0b5778', 'request_id': 'req-b149a37f-2bc3-43a2-a16b-b8c00ac980df'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:33.071170 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-b149a37f-2bc3-43a2-a16b-b8c00ac980df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cf054e08c7746b68c10cff0be0b5778', 'request_id': 'req-b149a37f-2bc3-43a2-a16b-b8c00ac980df'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:33.082949 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-b149a37f-2bc3-43a2-a16b-b8c00ac980df admin admin] The token cache is being invalidate because project 9cf054e08c7746b68c10cff0be0b5778 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:24:33.083362 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-b149a37f-2bc3-43a2-a16b-b8c00ac980df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:33.085026 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-b149a37f-2bc3-43a2-a16b-b8c00ac980df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:33.086706 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1437/2861] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:24:32 2022] DELETE /identity/v3/projects/9cf054e08c7746b68c10cff0be0b5778 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:24:33.091541 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1a647-d357-4c78-947f-de929e480e3a None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:33.092019 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1a647-d357-4c78-947f-de929e480e3a None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:33.092182 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1a647-d357-4c78-947f-de929e480e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:33.110888 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-20b1a647-d357-4c78-947f-de929e480e3a None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:24:33.112091 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-20b1a647-d357-4c78-947f-de929e480e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:33.171939 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1425/2862] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:24:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:24:33.180119 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40497a-d599-4a76-a9d4-e85388ab6043 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:33.180434 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40497a-d599-4a76-a9d4-e85388ab6043 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:33.180737 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40497a-d599-4a76-a9d4-e85388ab6043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:33.199143 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-bc40497a-d599-4a76-a9d4-e85388ab6043 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:24:33.200350 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-bc40497a-d599-4a76-a9d4-e85388ab6043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:33.208181 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1438/2863] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:24:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:24:33.212456 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b1a647-d357-4c78-947f-de929e480e3a None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:33.222477 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b1a647-d357-4c78-947f-de929e480e3a None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:33.227194 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ebb5a5-e0df-42d4-a302-9bcdb9d3237a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:33.227875 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ebb5a5-e0df-42d4-a302-9bcdb9d3237a admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:33.228164 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ebb5a5-e0df-42d4-a302-9bcdb9d3237a admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:33.228446 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ebb5a5-e0df-42d4-a302-9bcdb9d3237a admin admin] PATH_INFO: `/v3/domains` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:33.229264 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ebb5a5-e0df-42d4-a302-9bcdb9d3237a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:24:33.229573 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ebb5a5-e0df-42d4-a302-9bcdb9d3237a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:33.231412 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ebb5a5-e0df-42d4-a302-9bcdb9d3237a admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:33.243989 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1426/2864] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jun 20 06:24:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:24:33.248335 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc40497a-d599-4a76-a9d4-e85388ab6043 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:33.258440 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc40497a-d599-4a76-a9d4-e85388ab6043 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:33.263050 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c134a8-5eb2-49e4-8478-16f44e0c4300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:33.263698 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c134a8-5eb2-49e4-8478-16f44e0c4300 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:33.263985 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c134a8-5eb2-49e4-8478-16f44e0c4300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:33.264265 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c134a8-5eb2-49e4-8478-16f44e0c4300 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:33.264990 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c134a8-5eb2-49e4-8478-16f44e0c4300 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:33.266883 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c134a8-5eb2-49e4-8478-16f44e0c4300 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:33.291931 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1439/2865] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jun 20 06:24:33 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:24:33.295846 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ebb5a5-e0df-42d4-a302-9bcdb9d3237a admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:33.306553 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ebb5a5-e0df-42d4-a302-9bcdb9d3237a admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:33.365407 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa80be-dc61-4ccc-b4e1-0377d062845d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:33.366138 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa80be-dc61-4ccc-b4e1-0377d062845d admin admin] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:33.366451 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa80be-dc61-4ccc-b4e1-0377d062845d admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:33.366723 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa80be-dc61-4ccc-b4e1-0377d062845d admin admin] PATH_INFO: `/v3/users` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:33.367441 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baa80be-dc61-4ccc-b4e1-0377d062845d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:33.369425 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baa80be-dc61-4ccc-b4e1-0377d062845d admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:33.389010 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1427/2866] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jun 20 06:24:33 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:24:33.393036 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c134a8-5eb2-49e4-8478-16f44e0c4300 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:33.403762 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c134a8-5eb2-49e4-8478-16f44e0c4300 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:33.408291 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c6a3c-7acd-4c0f-b9ba-2aa7828d63d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:33.408969 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c6a3c-7acd-4c0f-b9ba-2aa7828d63d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:33.409254 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c6a3c-7acd-4c0f-b9ba-2aa7828d63d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:33.409529 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c6a3c-7acd-4c0f-b9ba-2aa7828d63d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:33.410277 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c6a3c-7acd-4c0f-b9ba-2aa7828d63d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:33.412208 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c6a3c-7acd-4c0f-b9ba-2aa7828d63d3 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:33.422486 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1440/2867] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:24:33.426250 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa80be-dc61-4ccc-b4e1-0377d062845d admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:33.437221 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa80be-dc61-4ccc-b4e1-0377d062845d admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:33.441869 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a6b6a-60e4-4129-9502-cffc4c8b2d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:33.442528 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a6b6a-60e4-4129-9502-cffc4c8b2d71 admin admin] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:33.442816 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a6b6a-60e4-4129-9502-cffc4c8b2d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:33.443664 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a6b6a-60e4-4129-9502-cffc4c8b2d71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:33.444581 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501a6b6a-60e4-4129-9502-cffc4c8b2d71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:33.446226 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501a6b6a-60e4-4129-9502-cffc4c8b2d71 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:33.459784 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1428/2868] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jun 20 06:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:24:33.461582 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c6a3c-7acd-4c0f-b9ba-2aa7828d63d3 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:33.471585 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c6a3c-7acd-4c0f-b9ba-2aa7828d63d3 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:33.476814 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b74204-eae0-4c08-9d79-a7a64fb5f667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:33.477690 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b74204-eae0-4c08-9d79-a7a64fb5f667 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:33.477967 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b74204-eae0-4c08-9d79-a7a64fb5f667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:33.478239 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b74204-eae0-4c08-9d79-a7a64fb5f667 admin admin] PATH_INFO: `/v3/projects/5e9f0b8b08094447bf8366b66c92c8d3/users/a0f8537b2b3342eab05668363cfd8154/roles/c34cf84397a64ab0ad2a06daa8e13d88` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:33.493626 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b74204-eae0-4c08-9d79-a7a64fb5f667 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e9f0b8b08094447bf8366b66c92c8d3, user_id=a0f8537b2b3342eab05668363cfd8154, role_id=c34cf84397a64ab0ad2a06daa8e13d88)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:33.496335 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b74204-eae0-4c08-9d79-a7a64fb5f667 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:33.510473 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1441/2869] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jun 20 06:24:33 2022] PUT /identity/v3/projects/5e9f0b8b08094447bf8366b66c92c8d3/users/a0f8537b2b3342eab05668363cfd8154/roles/c34cf84397a64ab0ad2a06daa8e13d88 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:24:33.521391 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59620c55-7a7d-4dc1-88c7-a4cfede876a7 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:33.521829 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59620c55-7a7d-4dc1-88c7-a4cfede876a7 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:33.522102 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59620c55-7a7d-4dc1-88c7-a4cfede876a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:33.548256 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-59620c55-7a7d-4dc1-88c7-a4cfede876a7 None None] MFA Rules not processed for user `a0f8537b2b3342eab05668363cfd8154`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:24:33.549481 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-59620c55-7a7d-4dc1-88c7-a4cfede876a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:33.577892 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:33.614084 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1429/2870] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:24:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:24:33.624686 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b74204-eae0-4c08-9d79-a7a64fb5f667 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:33.626397 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-e4b74204-eae0-4c08-9d79-a7a64fb5f667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:33.683075 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b74204-eae0-4c08-9d79-a7a64fb5f667 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:33.686676 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31763601-bfcb-42ea-9152-c87101fb9ced service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19bd2ac77c5d48d49b58712f4025e279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:33.687304 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31763601-bfcb-42ea-9152-c87101fb9ced service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:33.687582 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31763601-bfcb-42ea-9152-c87101fb9ced service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:33.687854 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31763601-bfcb-42ea-9152-c87101fb9ced service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:33.696884 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31763601-bfcb-42ea-9152-c87101fb9ced service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:33.698298 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31763601-bfcb-42ea-9152-c87101fb9ced service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:33.706980 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1442/2871] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:24:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:24:37.954943 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59620c55-7a7d-4dc1-88c7-a4cfede876a7 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:37.956438 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-59620c55-7a7d-4dc1-88c7-a4cfede876a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:38.015043 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59620c55-7a7d-4dc1-88c7-a4cfede876a7 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:38.018547 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec5743b-1ebc-4a8a-9a32-99fbb4a22981 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:38.019210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5743b-1ebc-4a8a-9a32-99fbb4a22981 service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:38.019487 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5743b-1ebc-4a8a-9a32-99fbb4a22981 service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:38.019759 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5743b-1ebc-4a8a-9a32-99fbb4a22981 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:38.021568 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-6ec5743b-1ebc-4a8a-9a32-99fbb4a22981 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:38.088282 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec5743b-1ebc-4a8a-9a32-99fbb4a22981 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:38.089765 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec5743b-1ebc-4a8a-9a32-99fbb4a22981 service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:38.100258 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1430/2872] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:24:37 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:24:39.131691 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e937f-b311-47c9-a75f-3db8eaad71c5 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:39.132291 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e937f-b311-47c9-a75f-3db8eaad71c5 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:39.132658 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e937f-b311-47c9-a75f-3db8eaad71c5 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:39.134467 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1443/2873] 10.222.0.39 () {54 vars in 921 bytes} [Mon Jun 20 06:24:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:24:39.141137 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff268fe6-d61e-46ff-bfb4-72e5000f0495 None None] REQUEST_METHOD: `POST` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:39.141663 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff268fe6-d61e-46ff-bfb4-72e5000f0495 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:39.141663 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff268fe6-d61e-46ff-bfb4-72e5000f0495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:39.183209 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.auth.core [None req-ff268fe6-d61e-46ff-bfb4-72e5000f0495 None None] MFA Rules not processed for user `83e77cb05c4546c7a98ada817573edf3`. Rule list: `[]` (Enabled: `True`). {{(pid=80272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:24:39.184439 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-ff268fe6-d61e-46ff-bfb4-72e5000f0495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:39.191846 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1431/2874] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Jun 20 06:24:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:24:39.209324 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e937f-b311-47c9-a75f-3db8eaad71c5 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:39.222964 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e937f-b311-47c9-a75f-3db8eaad71c5 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:39.228299 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299786e-272c-43e5-a6cc-c29e32f90999 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:39.229057 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299786e-272c-43e5-a6cc-c29e32f90999 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:39.229540 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299786e-272c-43e5-a6cc-c29e32f90999 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:39.230211 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299786e-272c-43e5-a6cc-c29e32f90999 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:39.240887 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f299786e-272c-43e5-a6cc-c29e32f90999 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:39.242557 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f299786e-272c-43e5-a6cc-c29e32f90999 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:39.251383 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1444/2875] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:24:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:24:39.353101 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a11383-3a6f-4b52-b67b-2b706314f6a4 None None] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:39.353475 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a11383-3a6f-4b52-b67b-2b706314f6a4 None None] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:39.353750 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a11383-3a6f-4b52-b67b-2b706314f6a4 None None] PATH_INFO: `/` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:39.355451 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1432/2876] 10.222.0.39 () {54 vars in 921 bytes} [Mon Jun 20 06:24:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:24:39.360801 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c26b6c-c552-4d02-bf5d-34ec56a2b34d None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:39.361168 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c26b6c-c552-4d02-bf5d-34ec56a2b34d None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:39.361510 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c26b6c-c552-4d02-bf5d-34ec56a2b34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:39.382432 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-25c26b6c-c552-4d02-bf5d-34ec56a2b34d None None] MFA Rules not processed for user `3cee106502e54829ad802ee41c9165fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:24:39.383757 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-25c26b6c-c552-4d02-bf5d-34ec56a2b34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:39.425234 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:39.492496 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1445/2877] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Jun 20 06:24:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:24:39.503831 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a11383-3a6f-4b52-b67b-2b706314f6a4 None None] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:39.516219 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a11383-3a6f-4b52-b67b-2b706314f6a4 None None] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:39.519935 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75fbc3b-9c74-4ec9-a072-07d4910ba7a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:39.523453 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75fbc3b-9c74-4ec9-a072-07d4910ba7a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:39.523453 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75fbc3b-9c74-4ec9-a072-07d4910ba7a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:39.523453 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75fbc3b-9c74-4ec9-a072-07d4910ba7a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:39.534932 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75fbc3b-9c74-4ec9-a072-07d4910ba7a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:39.536282 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75fbc3b-9c74-4ec9-a072-07d4910ba7a6 service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:39.550350 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1433/2878] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:24:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:24:40.032334 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c26b6c-c552-4d02-bf5d-34ec56a2b34d None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:40.034194 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-25c26b6c-c552-4d02-bf5d-34ec56a2b34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:40.055512 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c26b6c-c552-4d02-bf5d-34ec56a2b34d None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:40.062912 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5552a48c-2f66-483b-9552-324d94c7f5da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cee106502e54829ad802ee41c9165fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:40.063576 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5552a48c-2f66-483b-9552-324d94c7f5da service nova] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:40.063862 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5552a48c-2f66-483b-9552-324d94c7f5da service nova] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:40.064141 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5552a48c-2f66-483b-9552-324d94c7f5da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:40.066304 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-5552a48c-2f66-483b-9552-324d94c7f5da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:40.082522 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5552a48c-2f66-483b-9552-324d94c7f5da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:40.084454 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5552a48c-2f66-483b-9552-324d94c7f5da service nova] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:40.096966 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1446/2879] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:24:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:24:40.964420 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75fbc3b-9c74-4ec9-a072-07d4910ba7a6 service neutron] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:40.965956 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-c75fbc3b-9c74-4ec9-a072-07d4910ba7a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:41.098515 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:41.123509 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75fbc3b-9c74-4ec9-a072-07d4910ba7a6 service neutron] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:41.130760 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080885ea-4959-4541-812a-97866b15522c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:41.135795 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080885ea-4959-4541-812a-97866b15522c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:41.136177 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080885ea-4959-4541-812a-97866b15522c admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:41.136761 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080885ea-4959-4541-812a-97866b15522c admin admin] PATH_INFO: `/v3/users/6f6ce9e010f54eafbd7c8fe515d5c288` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:41.139190 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080885ea-4959-4541-812a-97866b15522c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f6ce9e010f54eafbd7c8fe515d5c288)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:41.141663 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080885ea-4959-4541-812a-97866b15522c admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:41.231480 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-080885ea-4959-4541-812a-97866b15522c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f6ce9e010f54eafbd7c8fe515d5c288'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:41.246355 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-080885ea-4959-4541-812a-97866b15522c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f6ce9e010f54eafbd7c8fe515d5c288'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:41.248166 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-080885ea-4959-4541-812a-97866b15522c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f6ce9e010f54eafbd7c8fe515d5c288'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:41.248893 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-080885ea-4959-4541-812a-97866b15522c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f6ce9e010f54eafbd7c8fe515d5c288'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:41.281067 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-080885ea-4959-4541-812a-97866b15522c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f6ce9e010f54eafbd7c8fe515d5c288'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:41.307897 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1434/2880] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:24:40 2022] DELETE /identity/v3/users/6f6ce9e010f54eafbd7c8fe515d5c288 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:24:41.312425 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2e34e-16a9-47fb-add6-a94b05a21c16 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:41.312924 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2e34e-16a9-47fb-add6-a94b05a21c16 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:41.313035 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2e34e-16a9-47fb-add6-a94b05a21c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:41.347968 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-cca2e34e-16a9-47fb-add6-a94b05a21c16 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:24:41.349536 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-cca2e34e-16a9-47fb-add6-a94b05a21c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:41.465652 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1447/2881] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:24:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:24:41.478166 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080885ea-4959-4541-812a-97866b15522c admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:41.479718 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-080885ea-4959-4541-812a-97866b15522c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:41.582499 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080885ea-4959-4541-812a-97866b15522c admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:41.587839 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11186cf4-b47d-4ea6-83f4-9f637932edc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:41.589808 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11186cf4-b47d-4ea6-83f4-9f637932edc5 service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:41.590090 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11186cf4-b47d-4ea6-83f4-9f637932edc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:41.590371 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11186cf4-b47d-4ea6-83f4-9f637932edc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:41.611091 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11186cf4-b47d-4ea6-83f4-9f637932edc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:41.614052 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11186cf4-b47d-4ea6-83f4-9f637932edc5 service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:41.629656 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1435/2882] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:24:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:24:42.258399 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca2e34e-16a9-47fb-add6-a94b05a21c16 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:42.266295 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-cca2e34e-16a9-47fb-add6-a94b05a21c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:42.280186 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca2e34e-16a9-47fb-add6-a94b05a21c16 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:42.292738 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a511af93-7a2d-4afc-b403-662e4553c4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:42.293559 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511af93-7a2d-4afc-b403-662e4553c4bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:42.293846 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511af93-7a2d-4afc-b403-662e4553c4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:42.294128 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511af93-7a2d-4afc-b403-662e4553c4bc admin admin] PATH_INFO: `/v3/projects/56629a43a12e42ad922d623cca4ae959` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:42.295448 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a511af93-7a2d-4afc-b403-662e4553c4bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=56629a43a12e42ad922d623cca4ae959)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:42.297413 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a511af93-7a2d-4afc-b403-662e4553c4bc admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:42.377786 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-a511af93-7a2d-4afc-b403-662e4553c4bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56629a43a12e42ad922d623cca4ae959', 'request_id': 'req-a511af93-7a2d-4afc-b403-662e4553c4bc'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:42.388351 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-a511af93-7a2d-4afc-b403-662e4553c4bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56629a43a12e42ad922d623cca4ae959', 'request_id': 'req-a511af93-7a2d-4afc-b403-662e4553c4bc'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:42.402982 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-a511af93-7a2d-4afc-b403-662e4553c4bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56629a43a12e42ad922d623cca4ae959', 'request_id': 'req-a511af93-7a2d-4afc-b403-662e4553c4bc'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:42.416057 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-a511af93-7a2d-4afc-b403-662e4553c4bc admin admin] The token cache is being invalidate because project 56629a43a12e42ad922d623cca4ae959 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:24:42.416346 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-a511af93-7a2d-4afc-b403-662e4553c4bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:42.417472 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-a511af93-7a2d-4afc-b403-662e4553c4bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:42.419634 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1448/2883] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:24:42 2022] DELETE /identity/v3/projects/56629a43a12e42ad922d623cca4ae959 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:24:47.437973 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11186cf4-b47d-4ea6-83f4-9f637932edc5 service neutron] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:47.439367 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-11186cf4-b47d-4ea6-83f4-9f637932edc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:47.453168 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11186cf4-b47d-4ea6-83f4-9f637932edc5 service neutron] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:47.512137 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d282d4be-399d-48c8-8172-7cab00e40d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:47.513045 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282d4be-399d-48c8-8172-7cab00e40d84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:47.513327 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282d4be-399d-48c8-8172-7cab00e40d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:47.513625 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282d4be-399d-48c8-8172-7cab00e40d84 admin admin] PATH_INFO: `/v3/users/a0f8537b2b3342eab05668363cfd8154` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:47.514804 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d282d4be-399d-48c8-8172-7cab00e40d84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0f8537b2b3342eab05668363cfd8154)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:47.516707 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d282d4be-399d-48c8-8172-7cab00e40d84 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:47.527383 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:47.565337 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-d282d4be-399d-48c8-8172-7cab00e40d84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0f8537b2b3342eab05668363cfd8154'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:47.573069 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-d282d4be-399d-48c8-8172-7cab00e40d84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0f8537b2b3342eab05668363cfd8154'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:47.573676 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-d282d4be-399d-48c8-8172-7cab00e40d84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0f8537b2b3342eab05668363cfd8154'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:47.574265 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-d282d4be-399d-48c8-8172-7cab00e40d84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0f8537b2b3342eab05668363cfd8154'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:47.586544 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-d282d4be-399d-48c8-8172-7cab00e40d84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0f8537b2b3342eab05668363cfd8154'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:47.598318 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1436/2884] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:24:47 2022] DELETE /identity/v3/users/a0f8537b2b3342eab05668363cfd8154 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:24:47.602976 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990607c-f7fb-4be1-9240-71c000ccb970 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:47.603450 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990607c-f7fb-4be1-9240-71c000ccb970 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:47.603555 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990607c-f7fb-4be1-9240-71c000ccb970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:47.622694 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-e990607c-f7fb-4be1-9240-71c000ccb970 None None] MFA Rules not processed for user `665bc0e94a714a5594465a5b89b022aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:24:47.623885 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-e990607c-f7fb-4be1-9240-71c000ccb970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:47.649145 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:47.684037 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1449/2885] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jun 20 06:24:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:24:47.693583 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d282d4be-399d-48c8-8172-7cab00e40d84 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:47.695511 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-d282d4be-399d-48c8-8172-7cab00e40d84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:47.753840 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d282d4be-399d-48c8-8172-7cab00e40d84 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:47.757468 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2360cf26-37ee-40af-9eb2-537d1f42272e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:47.758126 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360cf26-37ee-40af-9eb2-537d1f42272e service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:47.758389 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360cf26-37ee-40af-9eb2-537d1f42272e service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:47.758666 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360cf26-37ee-40af-9eb2-537d1f42272e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:47.767583 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2360cf26-37ee-40af-9eb2-537d1f42272e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:47.769073 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2360cf26-37ee-40af-9eb2-537d1f42272e service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:47.778779 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1437/2886] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:24:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:24:48.047645 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e990607c-f7fb-4be1-9240-71c000ccb970 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:48.049201 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-e990607c-f7fb-4be1-9240-71c000ccb970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:48.064883 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e990607c-f7fb-4be1-9240-71c000ccb970 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:48.069997 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ef369-9833-43c0-8399-7ecf0f4e24a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:48.070918 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ef369-9833-43c0-8399-7ecf0f4e24a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:48.071227 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ef369-9833-43c0-8399-7ecf0f4e24a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:48.071420 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ef369-9833-43c0-8399-7ecf0f4e24a2 admin admin] PATH_INFO: `/v3/projects/5e9f0b8b08094447bf8366b66c92c8d3` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:48.072637 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681ef369-9833-43c0-8399-7ecf0f4e24a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e9f0b8b08094447bf8366b66c92c8d3)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:48.074785 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681ef369-9833-43c0-8399-7ecf0f4e24a2 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:48.126173 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-681ef369-9833-43c0-8399-7ecf0f4e24a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e9f0b8b08094447bf8366b66c92c8d3', 'request_id': 'req-681ef369-9833-43c0-8399-7ecf0f4e24a2'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:48.132086 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-681ef369-9833-43c0-8399-7ecf0f4e24a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e9f0b8b08094447bf8366b66c92c8d3', 'request_id': 'req-681ef369-9833-43c0-8399-7ecf0f4e24a2'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:48.139818 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-681ef369-9833-43c0-8399-7ecf0f4e24a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e9f0b8b08094447bf8366b66c92c8d3', 'request_id': 'req-681ef369-9833-43c0-8399-7ecf0f4e24a2'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:48.152479 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-681ef369-9833-43c0-8399-7ecf0f4e24a2 admin admin] The token cache is being invalidate because project 5e9f0b8b08094447bf8366b66c92c8d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:24:48.152800 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-681ef369-9833-43c0-8399-7ecf0f4e24a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:48.153449 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-681ef369-9833-43c0-8399-7ecf0f4e24a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:24:48.155001 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1450/2887] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:24:48 2022] DELETE /identity/v3/projects/5e9f0b8b08094447bf8366b66c92c8d3 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:24:57.774510 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:DELETE=10,keystone:SELECT=48,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:58.150804 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=40,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:25:07.452529 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2360cf26-37ee-40af-9eb2-537d1f42272e service neutron] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:25:07.462707 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2360cf26-37ee-40af-9eb2-537d1f42272e service neutron] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:25:07.511066 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4641ce6-507b-4f3c-8ec2-be3846195bf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:25:07.511652 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4641ce6-507b-4f3c-8ec2-be3846195bf5 service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:25:07.511934 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4641ce6-507b-4f3c-8ec2-be3846195bf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:25:07.512209 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4641ce6-507b-4f3c-8ec2-be3846195bf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:25:07.513970 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-c4641ce6-507b-4f3c-8ec2-be3846195bf5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:25:07.592210 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4641ce6-507b-4f3c-8ec2-be3846195bf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:25:07.593657 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4641ce6-507b-4f3c-8ec2-be3846195bf5 service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:25:07.612433 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1438/2888] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:25:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:25:17.609907 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=61 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:25:19.928102 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ef369-9833-43c0-8399-7ecf0f4e24a2 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:25:19.929678 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-681ef369-9833-43c0-8399-7ecf0f4e24a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:25:19.942570 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ef369-9833-43c0-8399-7ecf0f4e24a2 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:25:19.946145 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b1410-407c-4774-ad71-f9cddca7b7ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:25:19.946777 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b1410-407c-4774-ad71-f9cddca7b7ca service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:25:19.947058 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b1410-407c-4774-ad71-f9cddca7b7ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:25:19.947332 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b1410-407c-4774-ad71-f9cddca7b7ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:25:19.949087 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-0b9b1410-407c-4774-ad71-f9cddca7b7ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:25:20.011465 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b1410-407c-4774-ad71-f9cddca7b7ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:25:20.012917 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b1410-407c-4774-ad71-f9cddca7b7ca service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:25:20.022640 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1451/2889] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:25:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:25:26.161523 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4641ce6-507b-4f3c-8ec2-be3846195bf5 service neutron] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:25:26.162980 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-c4641ce6-507b-4f3c-8ec2-be3846195bf5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:25:26.228892 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b1410-407c-4774-ad71-f9cddca7b7ca service neutron] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:25:26.230885 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-0b9b1410-407c-4774-ad71-f9cddca7b7ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:25:26.247192 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b1410-407c-4774-ad71-f9cddca7b7ca service neutron] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:25:26.253086 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2727587d-346f-4848-9459-b93ea3226069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:25:26.254183 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727587d-346f-4848-9459-b93ea3226069 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:25:26.254292 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727587d-346f-4848-9459-b93ea3226069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:25:26.254512 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727587d-346f-4848-9459-b93ea3226069 admin admin] PATH_INFO: `/v3/users/b19967e2b09342e9ac006151002bf71a` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:25:26.255738 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2727587d-346f-4848-9459-b93ea3226069 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b19967e2b09342e9ac006151002bf71a)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:25:26.257597 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4641ce6-507b-4f3c-8ec2-be3846195bf5 service neutron] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:25:26.257985 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2727587d-346f-4848-9459-b93ea3226069 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:25:26.263593 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd0c57-040a-4e19-95b7-359e5bba5e58 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f0f9248178049cda6571fa365a21225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:25:26.264354 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd0c57-040a-4e19-95b7-359e5bba5e58 service placement] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:25:26.264637 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd0c57-040a-4e19-95b7-359e5bba5e58 service placement] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:25:26.265075 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd0c57-040a-4e19-95b7-359e5bba5e58 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:25:26.267072 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-aacd0c57-040a-4e19-95b7-359e5bba5e58 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:25:26.280113 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacd0c57-040a-4e19-95b7-359e5bba5e58 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:25:26.281872 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacd0c57-040a-4e19-95b7-359e5bba5e58 service placement] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:25:26.296175 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1439/2890] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:25:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:25:26.309319 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-2727587d-346f-4848-9459-b93ea3226069 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b19967e2b09342e9ac006151002bf71a'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:25:26.317888 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-2727587d-346f-4848-9459-b93ea3226069 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b19967e2b09342e9ac006151002bf71a'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:25:26.325626 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-2727587d-346f-4848-9459-b93ea3226069 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b19967e2b09342e9ac006151002bf71a'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:25:26.338655 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-2727587d-346f-4848-9459-b93ea3226069 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b19967e2b09342e9ac006151002bf71a'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:25:26.339369 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-2727587d-346f-4848-9459-b93ea3226069 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b19967e2b09342e9ac006151002bf71a'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:25:26.345350 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1452/2891] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:25:26 2022] DELETE /identity/v3/users/b19967e2b09342e9ac006151002bf71a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:25:26.516767 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd0c57-040a-4e19-95b7-359e5bba5e58 service placement] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:25:26.529467 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd0c57-040a-4e19-95b7-359e5bba5e58 service placement] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:25:26.589517 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34341040-54d8-447e-8a1e-bd7eb7ffb233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:25:26.590692 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34341040-54d8-447e-8a1e-bd7eb7ffb233 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:25:26.590692 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34341040-54d8-447e-8a1e-bd7eb7ffb233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:25:26.590933 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34341040-54d8-447e-8a1e-bd7eb7ffb233 admin admin] PATH_INFO: `/v3/projects/7bcde2f2809247979837902b91d6a6cb` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:25:26.592124 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34341040-54d8-447e-8a1e-bd7eb7ffb233 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bcde2f2809247979837902b91d6a6cb)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:25:26.594038 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34341040-54d8-447e-8a1e-bd7eb7ffb233 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:25:26.645165 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-34341040-54d8-447e-8a1e-bd7eb7ffb233 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bcde2f2809247979837902b91d6a6cb', 'request_id': 'req-34341040-54d8-447e-8a1e-bd7eb7ffb233'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:25:26.652845 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-34341040-54d8-447e-8a1e-bd7eb7ffb233 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bcde2f2809247979837902b91d6a6cb', 'request_id': 'req-34341040-54d8-447e-8a1e-bd7eb7ffb233'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:25:26.658349 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-34341040-54d8-447e-8a1e-bd7eb7ffb233 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bcde2f2809247979837902b91d6a6cb', 'request_id': 'req-34341040-54d8-447e-8a1e-bd7eb7ffb233'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:25:26.669300 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-34341040-54d8-447e-8a1e-bd7eb7ffb233 admin admin] The token cache is being invalidate because project 7bcde2f2809247979837902b91d6a6cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:25:26.669591 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-34341040-54d8-447e-8a1e-bd7eb7ffb233 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:25:26.670218 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-34341040-54d8-447e-8a1e-bd7eb7ffb233 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:25:26.671761 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1440/2892] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:25:26 2022] DELETE /identity/v3/projects/7bcde2f2809247979837902b91d6a6cb => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:25:26.675745 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2727587d-346f-4848-9459-b93ea3226069 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:25:26.677208 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-2727587d-346f-4848-9459-b93ea3226069 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:25:26.691241 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2727587d-346f-4848-9459-b93ea3226069 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:25:26.750607 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2902697b-b72c-4048-98a4-6538454f51c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:25:26.751551 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902697b-b72c-4048-98a4-6538454f51c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:25:26.751832 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902697b-b72c-4048-98a4-6538454f51c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:25:26.752106 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902697b-b72c-4048-98a4-6538454f51c1 admin admin] PATH_INFO: `/v3/users/d741439ce8c343fc9f2dbbb1ec28066c` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:25:26.762573 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:25:26.766732 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2902697b-b72c-4048-98a4-6538454f51c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d741439ce8c343fc9f2dbbb1ec28066c)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:25:26.768997 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2902697b-b72c-4048-98a4-6538454f51c1 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:25:26.814721 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-2902697b-b72c-4048-98a4-6538454f51c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd741439ce8c343fc9f2dbbb1ec28066c'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:25:26.821652 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-2902697b-b72c-4048-98a4-6538454f51c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd741439ce8c343fc9f2dbbb1ec28066c'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:25:26.829192 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-2902697b-b72c-4048-98a4-6538454f51c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd741439ce8c343fc9f2dbbb1ec28066c'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:25:26.841217 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-2902697b-b72c-4048-98a4-6538454f51c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd741439ce8c343fc9f2dbbb1ec28066c'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:25:26.841867 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-2902697b-b72c-4048-98a4-6538454f51c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd741439ce8c343fc9f2dbbb1ec28066c'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:25:26.847681 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1453/2893] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:25:26 2022] DELETE /identity/v3/users/d741439ce8c343fc9f2dbbb1ec28066c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:25:27.024079 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34341040-54d8-447e-8a1e-bd7eb7ffb233 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:25:27.025332 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-34341040-54d8-447e-8a1e-bd7eb7ffb233 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:25:27.040001 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34341040-54d8-447e-8a1e-bd7eb7ffb233 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:25:27.058398 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:25:27.102392 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe238e3-0f40-4ec5-945c-7afcf1e5ab42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:25:27.103255 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe238e3-0f40-4ec5-945c-7afcf1e5ab42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:25:27.103531 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe238e3-0f40-4ec5-945c-7afcf1e5ab42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:25:27.103801 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe238e3-0f40-4ec5-945c-7afcf1e5ab42 admin admin] PATH_INFO: `/v3/projects/92ced46eec104b358b23bfdec193c211` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:25:27.114156 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe238e3-0f40-4ec5-945c-7afcf1e5ab42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92ced46eec104b358b23bfdec193c211)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:25:27.116048 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe238e3-0f40-4ec5-945c-7afcf1e5ab42 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:25:27.161694 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-5fe238e3-0f40-4ec5-945c-7afcf1e5ab42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92ced46eec104b358b23bfdec193c211', 'request_id': 'req-5fe238e3-0f40-4ec5-945c-7afcf1e5ab42'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:25:27.170296 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-5fe238e3-0f40-4ec5-945c-7afcf1e5ab42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92ced46eec104b358b23bfdec193c211', 'request_id': 'req-5fe238e3-0f40-4ec5-945c-7afcf1e5ab42'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:25:27.175819 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-5fe238e3-0f40-4ec5-945c-7afcf1e5ab42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92ced46eec104b358b23bfdec193c211', 'request_id': 'req-5fe238e3-0f40-4ec5-945c-7afcf1e5ab42'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:25:27.187788 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-5fe238e3-0f40-4ec5-945c-7afcf1e5ab42 admin admin] The token cache is being invalidate because project 92ced46eec104b358b23bfdec193c211 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:25:27.188070 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-5fe238e3-0f40-4ec5-945c-7afcf1e5ab42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:25:27.188693 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-5fe238e3-0f40-4ec5-945c-7afcf1e5ab42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:25:27.190265 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1441/2894] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:25:27 2022] DELETE /identity/v3/projects/92ced46eec104b358b23bfdec193c211 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:25:36.844129 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=28,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:25:37.184926 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=46,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:26:33.724314 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2902697b-b72c-4048-98a4-6538454f51c1 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:26:33.725770 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-2902697b-b72c-4048-98a4-6538454f51c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:26:33.783604 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2902697b-b72c-4048-98a4-6538454f51c1 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:26:33.830190 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec22f4-a796-4078-9a57-e6b736cbe043 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:26:33.830830 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec22f4-a796-4078-9a57-e6b736cbe043 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:26:33.831112 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec22f4-a796-4078-9a57-e6b736cbe043 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:26:33.831386 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec22f4-a796-4078-9a57-e6b736cbe043 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:26:33.833147 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-10ec22f4-a796-4078-9a57-e6b736cbe043 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:26:33.890079 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ec22f4-a796-4078-9a57-e6b736cbe043 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:26:33.891507 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ec22f4-a796-4078-9a57-e6b736cbe043 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:26:33.901047 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1454/2895] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:26:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:26:34.933886 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe238e3-0f40-4ec5-945c-7afcf1e5ab42 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:26:34.935383 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-5fe238e3-0f40-4ec5-945c-7afcf1e5ab42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:26:34.948548 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe238e3-0f40-4ec5-945c-7afcf1e5ab42 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:26:34.952294 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde79cb-bb99-4ea5-9b9d-e8f74d9a0398 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:26:34.952999 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde79cb-bb99-4ea5-9b9d-e8f74d9a0398 service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:26:34.953285 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde79cb-bb99-4ea5-9b9d-e8f74d9a0398 service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:26:34.953566 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde79cb-bb99-4ea5-9b9d-e8f74d9a0398 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:26:34.955383 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-2dde79cb-bb99-4ea5-9b9d-e8f74d9a0398 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:26:35.055080 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde79cb-bb99-4ea5-9b9d-e8f74d9a0398 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:26:35.056999 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde79cb-bb99-4ea5-9b9d-e8f74d9a0398 service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:26:35.077853 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1442/2896] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:26:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:26:36.013575 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec22f4-a796-4078-9a57-e6b736cbe043 service neutron] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:26:36.022224 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec22f4-a796-4078-9a57-e6b736cbe043 service neutron] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:26:36.025901 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ed6c84-8b6e-4648-ad7d-74ee7f4eb020 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:26:36.026555 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed6c84-8b6e-4648-ad7d-74ee7f4eb020 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:26:36.026823 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed6c84-8b6e-4648-ad7d-74ee7f4eb020 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:26:36.027106 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed6c84-8b6e-4648-ad7d-74ee7f4eb020 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:26:36.028895 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-92ed6c84-8b6e-4648-ad7d-74ee7f4eb020 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:26:36.038751 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ed6c84-8b6e-4648-ad7d-74ee7f4eb020 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:26:36.040652 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ed6c84-8b6e-4648-ad7d-74ee7f4eb020 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:26:36.048687 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1455/2897] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:26:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:26:38.880497 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde79cb-bb99-4ea5-9b9d-e8f74d9a0398 service neutron] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:26:38.881994 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-2dde79cb-bb99-4ea5-9b9d-e8f74d9a0398 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:26:38.893248 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde79cb-bb99-4ea5-9b9d-e8f74d9a0398 service neutron] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:26:38.896909 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa6ef5-777a-4238-9f87-5d967a708977 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e77cb05c4546c7a98ada817573edf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:26:38.897549 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa6ef5-777a-4238-9f87-5d967a708977 service neutron] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:26:38.897831 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa6ef5-777a-4238-9f87-5d967a708977 service neutron] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:26:38.898106 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa6ef5-777a-4238-9f87-5d967a708977 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:26:38.899784 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-a8aa6ef5-777a-4238-9f87-5d967a708977 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:26:38.961662 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa6ef5-777a-4238-9f87-5d967a708977 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:26:38.963709 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa6ef5-777a-4238-9f87-5d967a708977 service neutron] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:26:38.973445 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1443/2898] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:26:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:26:45.267363 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ed6c84-8b6e-4648-ad7d-74ee7f4eb020 service neutron] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:26:45.269070 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-92ed6c84-8b6e-4648-ad7d-74ee7f4eb020 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:26:45.285376 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ed6c84-8b6e-4648-ad7d-74ee7f4eb020 service neutron] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:26:45.290165 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8dc96-7e9e-4e46-a4b3-5c0886b5abfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:26:45.291784 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8dc96-7e9e-4e46-a4b3-5c0886b5abfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:26:45.292163 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8dc96-7e9e-4e46-a4b3-5c0886b5abfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:26:45.292523 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8dc96-7e9e-4e46-a4b3-5c0886b5abfb admin admin] PATH_INFO: `/v3/users/d8ff165426d14c09a7221a910ca7febc` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:26:45.293750 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d8dc96-7e9e-4e46-a4b3-5c0886b5abfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8ff165426d14c09a7221a910ca7febc)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:26:45.295794 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d8dc96-7e9e-4e46-a4b3-5c0886b5abfb admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:26:45.344351 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-b5d8dc96-7e9e-4e46-a4b3-5c0886b5abfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8ff165426d14c09a7221a910ca7febc'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:26:45.348104 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:26:45.353780 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-b5d8dc96-7e9e-4e46-a4b3-5c0886b5abfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8ff165426d14c09a7221a910ca7febc'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:26:45.362429 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-b5d8dc96-7e9e-4e46-a4b3-5c0886b5abfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8ff165426d14c09a7221a910ca7febc'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:26:45.376606 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-b5d8dc96-7e9e-4e46-a4b3-5c0886b5abfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8ff165426d14c09a7221a910ca7febc'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:26:45.377343 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-b5d8dc96-7e9e-4e46-a4b3-5c0886b5abfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8ff165426d14c09a7221a910ca7febc'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:26:45.383513 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1456/2899] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:26:45 2022] DELETE /identity/v3/users/d8ff165426d14c09a7221a910ca7febc => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:26:45.557903 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa6ef5-777a-4238-9f87-5d967a708977 service neutron] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:26:45.568160 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa6ef5-777a-4238-9f87-5d967a708977 service neutron] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:26:45.621324 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=100 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:26:45.630134 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a91f1-03f8-4f74-b1db-8c9d58af6b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:26:45.630994 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a91f1-03f8-4f74-b1db-8c9d58af6b11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:26:45.631273 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a91f1-03f8-4f74-b1db-8c9d58af6b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:26:45.631546 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a91f1-03f8-4f74-b1db-8c9d58af6b11 admin admin] PATH_INFO: `/v3/projects/4c7d8d09f3b94090bbb08abbc1842a42` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:26:45.632758 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671a91f1-03f8-4f74-b1db-8c9d58af6b11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c7d8d09f3b94090bbb08abbc1842a42)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:26:45.635263 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671a91f1-03f8-4f74-b1db-8c9d58af6b11 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:26:45.679693 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-671a91f1-03f8-4f74-b1db-8c9d58af6b11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c7d8d09f3b94090bbb08abbc1842a42', 'request_id': 'req-671a91f1-03f8-4f74-b1db-8c9d58af6b11'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:26:45.686155 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-671a91f1-03f8-4f74-b1db-8c9d58af6b11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c7d8d09f3b94090bbb08abbc1842a42', 'request_id': 'req-671a91f1-03f8-4f74-b1db-8c9d58af6b11'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:26:45.691606 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-671a91f1-03f8-4f74-b1db-8c9d58af6b11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c7d8d09f3b94090bbb08abbc1842a42', 'request_id': 'req-671a91f1-03f8-4f74-b1db-8c9d58af6b11'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:26:45.702680 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-671a91f1-03f8-4f74-b1db-8c9d58af6b11 admin admin] The token cache is being invalidate because project 4c7d8d09f3b94090bbb08abbc1842a42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:26:45.702963 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-671a91f1-03f8-4f74-b1db-8c9d58af6b11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:26:45.703579 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-671a91f1-03f8-4f74-b1db-8c9d58af6b11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:26:45.705116 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1444/2900] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:26:45 2022] DELETE /identity/v3/projects/4c7d8d09f3b94090bbb08abbc1842a42 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:26:45.709172 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8dc96-7e9e-4e46-a4b3-5c0886b5abfb admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:26:45.710510 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-b5d8dc96-7e9e-4e46-a4b3-5c0886b5abfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:26:45.724034 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8dc96-7e9e-4e46-a4b3-5c0886b5abfb admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:26:45.778886 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c93bb6-1943-487c-a349-3aa68aea84fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:26:45.779870 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c93bb6-1943-487c-a349-3aa68aea84fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:26:45.780184 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c93bb6-1943-487c-a349-3aa68aea84fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:26:45.780468 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c93bb6-1943-487c-a349-3aa68aea84fc admin admin] PATH_INFO: `/v3/users/4e1cacb3d3f24cec84cb6eab9a89a911` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:26:45.781730 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c93bb6-1943-487c-a349-3aa68aea84fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e1cacb3d3f24cec84cb6eab9a89a911)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:26:45.783665 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c93bb6-1943-487c-a349-3aa68aea84fc admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:26:45.829298 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-84c93bb6-1943-487c-a349-3aa68aea84fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e1cacb3d3f24cec84cb6eab9a89a911'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:26:45.836318 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-84c93bb6-1943-487c-a349-3aa68aea84fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e1cacb3d3f24cec84cb6eab9a89a911'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:26:45.844040 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-84c93bb6-1943-487c-a349-3aa68aea84fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e1cacb3d3f24cec84cb6eab9a89a911'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:26:45.856210 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-84c93bb6-1943-487c-a349-3aa68aea84fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e1cacb3d3f24cec84cb6eab9a89a911'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:26:45.856884 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-84c93bb6-1943-487c-a349-3aa68aea84fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e1cacb3d3f24cec84cb6eab9a89a911'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:26:45.862895 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1457/2901] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:26:45 2022] DELETE /identity/v3/users/4e1cacb3d3f24cec84cb6eab9a89a911 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:26:46.035252 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a91f1-03f8-4f74-b1db-8c9d58af6b11 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:26:46.036713 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-671a91f1-03f8-4f74-b1db-8c9d58af6b11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:26:46.053173 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a91f1-03f8-4f74-b1db-8c9d58af6b11 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:26:46.110095 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b0ad46-9d3a-4bdc-bd68-3be5753ef703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:26:46.110954 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0ad46-9d3a-4bdc-bd68-3be5753ef703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:26:46.111234 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0ad46-9d3a-4bdc-bd68-3be5753ef703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:26:46.111505 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0ad46-9d3a-4bdc-bd68-3be5753ef703 admin admin] PATH_INFO: `/v3/projects/11a9cb779bcd494f9d6e4b9d98a2d883` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:26:46.112690 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b0ad46-9d3a-4bdc-bd68-3be5753ef703 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11a9cb779bcd494f9d6e4b9d98a2d883)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:26:46.114608 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b0ad46-9d3a-4bdc-bd68-3be5753ef703 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:26:46.159958 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-d6b0ad46-9d3a-4bdc-bd68-3be5753ef703 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11a9cb779bcd494f9d6e4b9d98a2d883', 'request_id': 'req-d6b0ad46-9d3a-4bdc-bd68-3be5753ef703'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:26:46.166633 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-d6b0ad46-9d3a-4bdc-bd68-3be5753ef703 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11a9cb779bcd494f9d6e4b9d98a2d883', 'request_id': 'req-d6b0ad46-9d3a-4bdc-bd68-3be5753ef703'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:26:46.172317 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-d6b0ad46-9d3a-4bdc-bd68-3be5753ef703 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11a9cb779bcd494f9d6e4b9d98a2d883', 'request_id': 'req-d6b0ad46-9d3a-4bdc-bd68-3be5753ef703'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:26:46.183678 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-d6b0ad46-9d3a-4bdc-bd68-3be5753ef703 admin admin] The token cache is being invalidate because project 11a9cb779bcd494f9d6e4b9d98a2d883 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:26:46.183962 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-d6b0ad46-9d3a-4bdc-bd68-3be5753ef703 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:26:46.184589 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-d6b0ad46-9d3a-4bdc-bd68-3be5753ef703 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:26:46.186141 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1445/2902] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:26:46 2022] DELETE /identity/v3/projects/11a9cb779bcd494f9d6e4b9d98a2d883 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:26:55.859174 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=65,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:26:56.180150 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=78,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:27:08.375119 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd21f1-210e-41ab-a56d-af2e33d90fe9 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:27:08.375609 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd21f1-210e-41ab-a56d-af2e33d90fe9 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:27:08.375724 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd21f1-210e-41ab-a56d-af2e33d90fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:27:08.434950 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-05fd21f1-210e-41ab-a56d-af2e33d90fe9 None None] MFA Rules not processed for user `8c0f131484cb48d289cae1f473ec2fbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:27:08.436161 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-05fd21f1-210e-41ab-a56d-af2e33d90fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:27:08.499391 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1458/2903] 10.222.0.39 () {58 vars in 967 bytes} [Mon Jun 20 06:27:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:27:08.544465 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b0ad46-9d3a-4bdc-bd68-3be5753ef703 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:27:08.545865 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-d6b0ad46-9d3a-4bdc-bd68-3be5753ef703 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:27:08.636556 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b0ad46-9d3a-4bdc-bd68-3be5753ef703 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:27:08.641582 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f45edf9-f04f-4394-a11e-50f60268b87a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b490cf71bc468da5ea2be04239e33f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:27:08.642230 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45edf9-f04f-4394-a11e-50f60268b87a service swift] REQUEST_METHOD: `GET` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:27:08.642509 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45edf9-f04f-4394-a11e-50f60268b87a service swift] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:27:08.642782 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45edf9-f04f-4394-a11e-50f60268b87a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:27:08.651709 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f45edf9-f04f-4394-a11e-50f60268b87a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:27:08.653434 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f45edf9-f04f-4394-a11e-50f60268b87a service swift] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:27:08.661409 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1446/2904] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Jun 20 06:27:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 06:27:15.182052 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd21f1-210e-41ab-a56d-af2e33d90fe9 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:27:15.184044 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-05fd21f1-210e-41ab-a56d-af2e33d90fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:27:15.250812 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd21f1-210e-41ab-a56d-af2e33d90fe9 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:27:15.255145 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231408b1-84c5-4b27-9260-a0c3a640b4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:27:15.256015 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231408b1-84c5-4b27-9260-a0c3a640b4a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:27:15.256297 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231408b1-84c5-4b27-9260-a0c3a640b4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:27:15.256570 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231408b1-84c5-4b27-9260-a0c3a640b4a5 admin admin] PATH_INFO: `/v3/users/c7e9f3f1a65e4204887ee69de7cf2f58` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:27:15.257806 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231408b1-84c5-4b27-9260-a0c3a640b4a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7e9f3f1a65e4204887ee69de7cf2f58)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:27:15.259715 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231408b1-84c5-4b27-9260-a0c3a640b4a5 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:27:15.314400 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-231408b1-84c5-4b27-9260-a0c3a640b4a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7e9f3f1a65e4204887ee69de7cf2f58'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:27:15.322139 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-231408b1-84c5-4b27-9260-a0c3a640b4a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7e9f3f1a65e4204887ee69de7cf2f58'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:27:15.329972 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-231408b1-84c5-4b27-9260-a0c3a640b4a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7e9f3f1a65e4204887ee69de7cf2f58'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:27:15.331931 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:27:15.344885 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-231408b1-84c5-4b27-9260-a0c3a640b4a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7e9f3f1a65e4204887ee69de7cf2f58'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:27:15.345586 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-231408b1-84c5-4b27-9260-a0c3a640b4a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7e9f3f1a65e4204887ee69de7cf2f58'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:27:15.352253 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1459/2905] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:27:15 2022] DELETE /identity/v3/users/c7e9f3f1a65e4204887ee69de7cf2f58 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:27:15.529955 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f45edf9-f04f-4394-a11e-50f60268b87a service swift] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:27:15.540939 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f45edf9-f04f-4394-a11e-50f60268b87a service swift] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:27:15.609141 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab313813-f1e0-4b6d-b039-abefb84a1a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:27:15.610003 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab313813-f1e0-4b6d-b039-abefb84a1a36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:27:15.610285 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab313813-f1e0-4b6d-b039-abefb84a1a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:27:15.610559 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab313813-f1e0-4b6d-b039-abefb84a1a36 admin admin] PATH_INFO: `/v3/projects/205a62429cea49ba80167ac7866639f0` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:27:15.611771 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab313813-f1e0-4b6d-b039-abefb84a1a36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=205a62429cea49ba80167ac7866639f0)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:27:15.613732 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab313813-f1e0-4b6d-b039-abefb84a1a36 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:27:15.664681 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-ab313813-f1e0-4b6d-b039-abefb84a1a36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '205a62429cea49ba80167ac7866639f0', 'request_id': 'req-ab313813-f1e0-4b6d-b039-abefb84a1a36'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:27:15.673250 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-ab313813-f1e0-4b6d-b039-abefb84a1a36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '205a62429cea49ba80167ac7866639f0', 'request_id': 'req-ab313813-f1e0-4b6d-b039-abefb84a1a36'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:27:15.678867 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-ab313813-f1e0-4b6d-b039-abefb84a1a36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '205a62429cea49ba80167ac7866639f0', 'request_id': 'req-ab313813-f1e0-4b6d-b039-abefb84a1a36'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:27:15.686898 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:27:15.690931 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-ab313813-f1e0-4b6d-b039-abefb84a1a36 admin admin] The token cache is being invalidate because project 205a62429cea49ba80167ac7866639f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:27:15.691426 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-ab313813-f1e0-4b6d-b039-abefb84a1a36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:27:15.692429 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-ab313813-f1e0-4b6d-b039-abefb84a1a36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:27:15.694084 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1447/2906] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:27:15 2022] DELETE /identity/v3/projects/205a62429cea49ba80167ac7866639f0 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:27:15.698868 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231408b1-84c5-4b27-9260-a0c3a640b4a5 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:27:15.700252 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-231408b1-84c5-4b27-9260-a0c3a640b4a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:27:15.713268 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231408b1-84c5-4b27-9260-a0c3a640b4a5 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:27:15.768891 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f8332d-8622-41f8-815d-8f2017ca5466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:27:15.769767 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f8332d-8622-41f8-815d-8f2017ca5466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:27:15.770054 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f8332d-8622-41f8-815d-8f2017ca5466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:27:15.770334 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f8332d-8622-41f8-815d-8f2017ca5466 admin admin] PATH_INFO: `/v3/users/4ef44ce62f72486c938bfbb37b947e7f` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:27:15.771559 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f8332d-8622-41f8-815d-8f2017ca5466 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ef44ce62f72486c938bfbb37b947e7f)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:27:15.773559 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f8332d-8622-41f8-815d-8f2017ca5466 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:27:15.820283 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-81f8332d-8622-41f8-815d-8f2017ca5466 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ef44ce62f72486c938bfbb37b947e7f'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:27:15.828081 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-81f8332d-8622-41f8-815d-8f2017ca5466 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ef44ce62f72486c938bfbb37b947e7f'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:27:15.834827 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-81f8332d-8622-41f8-815d-8f2017ca5466 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ef44ce62f72486c938bfbb37b947e7f'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:27:15.847012 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-81f8332d-8622-41f8-815d-8f2017ca5466 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ef44ce62f72486c938bfbb37b947e7f'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:27:15.847642 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-81f8332d-8622-41f8-815d-8f2017ca5466 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ef44ce62f72486c938bfbb37b947e7f'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:27:15.853397 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1460/2907] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jun 20 06:27:15 2022] DELETE /identity/v3/users/4ef44ce62f72486c938bfbb37b947e7f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:27:16.026657 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab313813-f1e0-4b6d-b039-abefb84a1a36 admin admin] Authenticating user token {{(pid=80272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:27:16.028089 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.fernet_utils [None req-ab313813-f1e0-4b6d-b039-abefb84a1a36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:27:16.040906 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab313813-f1e0-4b6d-b039-abefb84a1a36 admin admin] Validating token access rules against request {{(pid=80272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:27:16.098761 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb085129-731f-4061-82a0-1f392938e784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665bc0e94a714a5594465a5b89b022aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e16e10aec7d4a579d849fde0e5b0904', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:27:16.099613 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb085129-731f-4061-82a0-1f392938e784 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:27:16.099900 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb085129-731f-4061-82a0-1f392938e784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:27:16.100177 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb085129-731f-4061-82a0-1f392938e784 admin admin] PATH_INFO: `/v3/projects/4e045776b6a5494d9731ca9d5f646100` {{(pid=80272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:27:16.101366 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb085129-731f-4061-82a0-1f392938e784 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e045776b6a5494d9731ca9d5f646100)` {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:27:16.103271 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb085129-731f-4061-82a0-1f392938e784 admin admin] RBAC: Authorization granted {{(pid=80272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:27:16.149315 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-bb085129-731f-4061-82a0-1f392938e784 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e045776b6a5494d9731ca9d5f646100', 'request_id': 'req-bb085129-731f-4061-82a0-1f392938e784'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:27:16.156165 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-bb085129-731f-4061-82a0-1f392938e784 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e045776b6a5494d9731ca9d5f646100', 'request_id': 'req-bb085129-731f-4061-82a0-1f392938e784'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:27:16.161732 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-bb085129-731f-4061-82a0-1f392938e784 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e045776b6a5494d9731ca9d5f646100', 'request_id': 'req-bb085129-731f-4061-82a0-1f392938e784'} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:27:16.173577 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-bb085129-731f-4061-82a0-1f392938e784 admin admin] The token cache is being invalidate because project 4e045776b6a5494d9731ca9d5f646100 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:27:16.173920 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-bb085129-731f-4061-82a0-1f392938e784 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:27:16.174650 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG keystone.notifications [None req-bb085129-731f-4061-82a0-1f392938e784 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:27:16.176408 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: [pid: 80272|app: 0|req: 1448/2908] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jun 20 06:27:16 2022] DELETE /identity/v3/projects/4e045776b6a5494d9731ca9d5f646100 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:27:25.849922 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=59,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:27:26.170397 dv-cinder-804035-47-iscsi devstack@keystone.service[80272]: DEBUG dbcounter [-] [80272] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:29:24.370749 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f8332d-8622-41f8-815d-8f2017ca5466 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:29:24.372139 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-81f8332d-8622-41f8-815d-8f2017ca5466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:29:24.442132 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f8332d-8622-41f8-815d-8f2017ca5466 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:29:24.499757 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b214f-ddd0-4f80-9541-07013813c969 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f0f9248178049cda6571fa365a21225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b349043204b34d1794818184ffe6505c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:29:24.500406 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b214f-ddd0-4f80-9541-07013813c969 service placement] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:29:24.500685 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b214f-ddd0-4f80-9541-07013813c969 service placement] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:29:24.500981 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b214f-ddd0-4f80-9541-07013813c969 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:29:24.503280 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-5a8b214f-ddd0-4f80-9541-07013813c969 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:29:24.514362 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8b214f-ddd0-4f80-9541-07013813c969 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:29:24.515926 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8b214f-ddd0-4f80-9541-07013813c969 service placement] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:29:24.526274 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1461/2909] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jun 20 06:29:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:29:34.522054 dv-cinder-804035-47-iscsi devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=58 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}